2024-04-25T10:13:35.792 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T10:13:35.792 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --owner scheduled_pdonnell@teuthology --verbose --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067 -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067/orig.config.yaml 2024-04-25T10:13:35.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T10:13:35.935 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} email: pdonnell@redhat.com first_in_suite: false job_id: '7673067' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - Replacing daemon mds sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKhrdBcUKRAufK275Fpz8uZqxmbtxfTsPeEw9SBMHHwumAkv6XVCXObyFYoTjmrQZK+exh8o4xtP23uK4jsyLV0= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBByz/BXNq8ZDSj7ExMmCOGA67lgJA6r4W8c4vBUga7sLTj9u3X9lkn1sAPtM47kkqi86uhV4JzCLkNkqShjTexQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mds_thrash: null - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T10:13:35.935 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T10:13:35.936 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T10:13:35.936 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T10:13:35.937 INFO:teuthology.task.internal:Checking packages... 2024-04-25T10:13:35.961 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T10:13:35.961 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T10:13:35.961 INFO:teuthology.packaging:ref: None 2024-04-25T10:13:35.961 INFO:teuthology.packaging:tag: None 2024-04-25T10:13:35.961 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T10:13:35.961 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:13:35.961 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T10:13:36.150 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291.g994e2f20 2024-04-25T10:13:36.151 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T10:13:36.158 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T10:13:36.158 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T10:13:36.201 INFO:teuthology.task.internal:Saving configuration 2024-04-25T10:13:36.226 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T10:13:36.340 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T10:13:36.360 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 10:08:30.470097', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKhrdBcUKRAufK275Fpz8uZqxmbtxfTsPeEw9SBMHHwumAkv6XVCXObyFYoTjmrQZK+exh8o4xtP23uK4jsyLV0='} 2024-04-25T10:13:36.377 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 10:08:30.472033', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBByz/BXNq8ZDSj7ExMmCOGA67lgJA6r4W8c4vBUga7sLTj9u3X9lkn1sAPtM47kkqi86uhV4JzCLkNkqShjTexQ='} 2024-04-25T10:13:36.377 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T10:13:36.384 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T10:13:36.384 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T10:13:36.384 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T10:13:36.450 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8132625f70>, signals=[15]) 2024-04-25T10:13:36.451 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T10:13:36.459 INFO:teuthology.task.internal:Opening connections... 2024-04-25T10:13:36.459 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:13:36.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:13:36.552 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T10:13:36.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:13:36.633 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T10:13:36.642 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-04-25T10:13:36.660 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-04-25T10:13:36.661 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-04-25T10:13:36.719 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-04-25T10:13:36.719 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-04-25T10:13:36.719 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-04-25T10:13:36.719 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-04-25T10:13:36.719 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-04-25T10:13:36.719 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-04-25T10:13:36.720 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T10:13:36.720 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-04-25T10:13:36.720 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-04-25T10:13:36.720 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T10:13:36.720 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-04-25T10:13:36.720 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T10:13:36.720 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T10:13:36.720 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T10:13:36.721 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-04-25T10:13:36.755 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-04-25T10:13:36.773 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-04-25T10:13:36.773 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-25T10:13:36.830 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-04-25T10:13:36.830 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-04-25T10:13:36.830 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-04-25T10:13:36.830 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-04-25T10:13:36.830 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-04-25T10:13:36.830 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-04-25T10:13:36.830 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T10:13:36.831 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-04-25T10:13:36.831 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-04-25T10:13:36.831 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T10:13:36.831 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-04-25T10:13:36.831 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T10:13:36.831 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T10:13:36.831 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T10:13:36.833 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-25T10:13:36.862 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T10:13:36.873 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T10:13:36.880 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T10:13:36.880 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-04-25T10:13:36.882 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-04-25T10:13:36.897 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T10:13:36.905 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T10:13:36.905 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-04-25T10:13:36.939 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-04-25T10:13:36.978 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T10:13:37.027 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T10:13:37.074 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T10:13:37.075 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-25T10:13:37.075 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-25T10:13:37.075 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T10:13:37.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:13:37.093 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-25T10:13:37.272 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T10:13:37.272 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T10:13:37.273 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-04-25T10:13:37.291 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-437.el9.x86_64 2024-04-25T10:13:37.291 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T10:13:37.291 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T10:13:37.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum upgrade -y linux-firmware 2024-04-25T10:13:40.058 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 7.1 MB/s | 8.0 MB 00:01 2024-04-25T10:13:42.568 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-04-25T10:13:46.793 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T10:13:48.302 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-04-25T10:14:07.372 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:18 2024-04-25T10:14:12.568 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-25T10:14:14.611 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-04-25T10:14:14.612 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2024-04-25T10:14:14.612 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-04-25T10:14:14.722 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T10:14:14.722 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T10:14:14.895 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-25T10:14:14.896 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-25T10:14:14.898 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi019.front.sepia.ceph.com to complete... 2024-04-25T10:14:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25 10:14:27 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-25T10:14:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:FINISHED --2024-04-25 10:14:27-- 2024-04-25T10:14:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:Total wall clock time: 12s 2024-04-25T10:14:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:Downloaded: 1 files, 341M in 12s (28.8 MB/s) 2024-04-25T10:14:27.025 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T10:14:27.025 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-25T10:14:29.215 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying... ######################################## 2024-04-25T10:14:29.331 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing... ######################################## 2024-04-25T10:14:29.439 INFO:teuthology.orchestra.run.smithi019.stdout:Updating / installing... 2024-04-25T10:14:37.734 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-25T10:15:17.962 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-25T10:15:17.962 DEBUG:teuthology.orchestra.run.smithi019:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-25T10:15:18.047 INFO:teuthology.orchestra.run.smithi019.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T10:15:18.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T10:15:18.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T10:15:18.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T10:15:18.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T10:15:18.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T10:15:18.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T10:15:18.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T10:15:18.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T10:15:18.056 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T10:15:18.057 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T10:15:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T10:15:18.059 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-25T10:15:18.060 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T10:15:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T10:15:18.062 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T10:15:18.063 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-25T10:15:18.064 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T10:15:18.065 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T10:15:18.066 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T10:15:18.067 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T10:15:18.068 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T10:15:18.069 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T10:15:18.070 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T10:15:18.071 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T10:15:18.072 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T10:15:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T10:15:18.074 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T10:15:18.075 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T10:15:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T10:15:18.077 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T10:15:18.078 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T10:15:18.079 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T10:15:18.080 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T10:15:18.081 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T10:15:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T10:15:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-25T10:15:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T10:15:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T10:15:18.086 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T10:15:18.087 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T10:15:18.088 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T10:15:18.089 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T10:15:18.090 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T10:15:18.091 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-25T10:15:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-25T10:15:18.093 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T10:15:18.094 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T10:15:18.095 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-25T10:15:18.096 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-25T10:15:18.097 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-25T10:15:18.098 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T10:15:18.099 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T10:15:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T10:15:18.101 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T10:15:18.102 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T10:15:18.103 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T10:15:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T10:15:18.105 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T10:15:18.106 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T10:15:18.107 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T10:15:18.108 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T10:15:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-25T10:15:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-25T10:15:18.111 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T10:15:18.112 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T10:15:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T10:15:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T10:15:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-25T10:15:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-25T10:15:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T10:15:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-25T10:15:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-25T10:15:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T10:15:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-25T10:15:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T10:15:18.113 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T10:15:18.114 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T10:15:18.115 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T10:15:18.116 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T10:15:18.117 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T10:15:18.118 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T10:15:18.119 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-25T10:15:18.120 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-25T10:15:18.121 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-25T10:15:18.122 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-25T10:15:18.123 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T10:15:18.124 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T10:15:18.125 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T10:15:18.126 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-25T10:15:18.127 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T10:15:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T10:15:18.129 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T10:15:18.130 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T10:15:18.131 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T10:15:18.132 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-25T10:15:18.133 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T10:15:18.134 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T10:15:18.135 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T10:15:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T10:15:18.137 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-25T10:15:18.138 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T10:15:18.139 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T10:15:18.140 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T10:15:18.141 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T10:15:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T10:15:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T10:15:18.144 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-25T10:15:18.145 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-25T10:15:18.146 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T10:15:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-25T10:15:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T10:15:18.149 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T10:15:18.150 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T10:15:18.151 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T10:15:18.152 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T10:15:18.153 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-25T10:15:18.154 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-25T10:15:18.155 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-25T10:15:18.156 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T10:15:18.157 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T10:15:18.158 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T10:15:18.159 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T10:15:18.160 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-25T10:15:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T10:15:18.162 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T10:15:18.163 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T10:15:18.164 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T10:15:18.165 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-25T10:15:18.166 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T10:15:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-25T10:15:18.168 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-25T10:15:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T10:15:18.170 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T10:15:18.171 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T10:15:18.172 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T10:15:18.173 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T10:15:18.174 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T10:15:18.175 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T10:15:18.176 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T10:15:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T10:15:18.178 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T10:15:18.179 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T10:15:18.180 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T10:15:18.181 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T10:15:18.182 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T10:15:18.183 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T10:15:18.184 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-25T10:15:18.185 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T10:15:18.186 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T10:15:18.187 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T10:15:18.188 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T10:15:18.188 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T10:15:18.188 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T10:15:18.188 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T10:15:18.188 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T10:15:18.188 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T10:15:18.188 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T10:15:18.188 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T10:15:18.188 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T10:15:18.188 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T10:15:18.188 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T10:15:18.193 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T10:15:18.193 DEBUG:teuthology.orchestra.run.smithi019:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-25T10:15:18.216 INFO:teuthology.orchestra.run.smithi019.stdout:postinstall scriptlet (using /bin/sh): 2024-04-25T10:15:18.216 INFO:teuthology.orchestra.run.smithi019.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T10:15:18.216 INFO:teuthology.orchestra.run.smithi019.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T10:15:18.216 INFO:teuthology.orchestra.run.smithi019.stdout:fi 2024-04-25T10:15:18.216 INFO:teuthology.orchestra.run.smithi019.stdout:for file in vmlinuz System.map config; do 2024-04-25T10:15:18.216 INFO:teuthology.orchestra.run.smithi019.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout: fi 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout:done 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout:fi 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout:fi 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T10:15:18.217 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-25T10:15:18.218 INFO:teuthology.orchestra.run.smithi019.stdout:fi 2024-04-25T10:15:18.218 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2024-04-25T10:15:18.299 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2024-04-25T10:15:18.299 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2024-04-25T10:15:18.299 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2024-04-25T10:15:18.299 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 68.el9 2024-04-25T10:15:18.299 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2024-04-25T10:15:18.299 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-25T10:15:18.299 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2024-04-25T10:15:18.299 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8264254 2024-04-25T10:15:18.299 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2024-04-25T10:15:18.299 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-25T10:15:18.299 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:15:18.300 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T10:15:18.301 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T10:15:18.301 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 6.9.0-rc3-g806ec36b2112 2024-04-25T10:15:18.301 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T10:15:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-04-25T10:15:20.494 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-25T10:15:20.534 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-04-25T10:15:20.536 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-04-25T10:15:20.566 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.H1RlMKNNo3 2024-04-25T10:15:20.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.H1RlMKNNo3 2024-04-25T10:15:20.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.H1RlMKNNo3 2024-04-25T10:15:20.788 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.H1RlMKNNo3 is 6KB 2024-04-25T10:15:20.838 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.H1RlMKNNo3 2024-04-25T10:15:20.853 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T10:15:20.915 INFO:teuthology.orchestra.run.smithi019.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-25T10:15:20.916 INFO:teuthology.orchestra.run.smithi019.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-25T10:15:20.916 INFO:teuthology.orchestra.run.smithi019.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-25T10:15:20.916 INFO:teuthology.orchestra.run.smithi019.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-25T10:15:20.917 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-25T10:15:21.095 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-04-25T10:15:51.098 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T10:15:51.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-04-25T10:15:51.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:16:09.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-04-25T10:16:18.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-04-25T10:16:18.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:16:36.894 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-04-25T10:16:48.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-04-25T10:16:48.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:16:51.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-04-25T10:17:06.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-04-25T10:17:06.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:17:07.422 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-04-25T10:17:07.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-04-25T10:17:07.982 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T10:17:07.982 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-04-25T10:17:08.021 INFO:teuthology.orchestra.run.smithi019.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T10:17:08.021 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T10:17:08.021 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T10:17:08.021 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T10:17:09.024 DEBUG:teuthology.parallel:result is None 2024-04-25T10:17:09.025 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T10:17:09.032 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T10:17:09.032 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T10:17:09.039 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T10:17:09.079 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T10:17:09.086 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T10:17:09.096 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T10:17:09.096 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T10:17:09.125 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T10:17:09.210 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T10:17:09.217 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T10:17:09.217 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T10:17:09.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:17:09.233 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T10:17:09.238 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T10:17:09.314 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:17:09.345 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:17:09.345 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:17:09.403 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:17:09.407 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T10:17:09.414 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T10:17:09.414 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T10:17:09.418 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T10:17:09.473 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T10:17:09.482 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T10:17:09.483 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T10:17:09.486 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T10:17:09.519 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T10:17:09.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T10:17:09.714 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T10:17:09.778 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T10:17:09.857 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:17:09.857 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T10:17:09.917 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T10:17:09.961 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T10:17:10.012 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T10:17:10.096 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T10:17:10.137 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:17:10.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T10:17:10.203 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-04-25T10:17:10.208 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-04-25T10:17:10.285 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T10:17:10.305 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T10:17:10.666 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T10:17:10.674 INFO:teuthology.task.internal:Starting timer... 2024-04-25T10:17:10.674 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T10:17:10.695 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T10:17:10.703 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T10:17:10.703 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2024-04-25T10:17:10.828 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2024-04-25T10:17:10.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-04-25T10:17:10.901 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-04-25T10:17:10.902 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T10:17:10.903 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2024-04-25T10:17:10.966 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2024-04-25T10:17:10.967 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-04-25T10:17:10.994 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-04-25T10:17:10.994 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive'} 2024-04-25T10:17:10.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T10:17:11.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:17:11.078 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T10:17:11.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:17:11.103 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T10:17:11.103 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2024-04-25T10:17:11.179 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-04-25T10:17:11.204 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T10:17:11.214 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T10:17:11.220 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T10:17:11.430 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T10:17:11.446 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T10:17:11.448 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi112.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T10:22:24.601 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com')] 2024-04-25T10:22:24.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-04-25T10:22:24.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:22:24.720 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-04-25T10:22:24.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-04-25T10:22:24.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-25T10:22:24.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:22:24.953 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-25T10:22:24.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-25T10:22:24.990 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T10:22:25.003 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T10:22:25.004 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T10:22:25.004 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:22:25.012 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T10:22:25.012 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:22:25.056 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T10:22:25.069 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T10:22:25.092 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-04-25T10:22:25.102 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-04-25T10:22:25.108 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T10:22:25.115 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T10:22:25.127 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T10:22:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T10:22:25.188 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-04-25T10:22:25.191 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T10:22:25.191 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-04-25T10:22:25.191 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:22:25.191 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:22:25.191 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:22:25.191 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:22:25.235 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2024-04-25T10:22:25.272 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2024-04-25T10:22:25.316 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T10:22:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T10:22:25.513 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-04-25T10:22:25.522 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T10:22:25.522 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-04-25T10:22:25.522 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:22:25.522 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:22:25.522 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:22:25.522 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:22:25.524 INFO:teuthology.run_tasks:Running task install... 2024-04-25T10:22:25.532 DEBUG:teuthology.task.install:project ceph 2024-04-25T10:22:25.532 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T10:22:25.532 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T10:22:25.533 INFO:teuthology.task.install:Using flavor: default 2024-04-25T10:22:25.538 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T10:22:25.538 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T10:22:25.539 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T10:22:25.539 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:22:25.542 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T10:22:25.542 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:22:25.687 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T10:22:25.688 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T10:22:25.759 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T10:22:25.759 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T10:22:25.795 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T10:22:25.795 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:22:25.795 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T10:22:25.822 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T10:22:25.822 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T10:22:25.881 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T10:22:25.881 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:22:25.881 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T10:22:25.889 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T10:22:25.965 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T10:22:25.977 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T10:22:25.977 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T10:22:26.029 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-04-25T10:22:26.031 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-04-25T10:22:26.110 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T10:22:26.231 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T10:22:26.257 INFO:teuthology.orchestra.run.smithi112.stdout:48 files removed 2024-04-25T10:22:26.284 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T10:22:26.313 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2024-04-25T10:22:26.317 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2024-04-25T10:22:26.644 INFO:teuthology.orchestra.run.smithi019.stdout:48 files removed 2024-04-25T10:22:26.683 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T10:22:26.862 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 264 kB/s | 84 kB 00:00 2024-04-25T10:22:27.221 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 37 kB/s | 12 kB 00:00 2024-04-25T10:22:27.530 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 6.9 kB/s | 1.9 kB 00:00 2024-04-25T10:22:27.546 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 200 kB/s | 84 kB 00:00 2024-04-25T10:22:28.089 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 26 kB/s | 12 kB 00:00 2024-04-25T10:22:28.706 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2024-04-25T10:22:29.747 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.0 MB 00:02 2024-04-25T10:22:30.329 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.0 MB 00:01 2024-04-25T10:22:33.638 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 19 MB 00:02 2024-04-25T10:22:33.740 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 19 MB 00:02 2024-04-25T10:22:38.256 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-25T10:22:38.640 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.2 MB 00:01 2024-04-25T10:22:39.890 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-04-25T10:22:40.166 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-04-25T10:22:42.320 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-25T10:22:43.075 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 7.0 MB/s | 21 MB 00:02 2024-04-25T10:22:47.401 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-25T10:22:49.225 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-04-25T10:22:49.535 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T10:22:49.535 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T10:22:49.546 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T10:22:49.546 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T10:22:49.547 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T10:22:49.548 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T10:22:49.550 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T10:22:49.552 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T10:22:49.553 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T10:22:49.612 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T10:22:49.626 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-04-25T10:22:49.626 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-25T10:22:49.626 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-04-25T10:22:49.626 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T10:22:49.626 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T10:22:49.626 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T10:22:49.627 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T10:22:49.628 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T10:22:49.629 INFO:teuthology.orchestra.run.smithi112.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T10:22:49.630 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T10:22:49.631 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T10:22:49.632 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T10:22:49.633 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T10:22:49.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T10:22:49.635 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T10:22:49.636 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T10:22:49.637 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T10:22:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T10:22:49.638 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2024-04-25T10:22:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T10:22:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:22:49.638 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T10:22:49.638 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-04-25T10:22:49.638 INFO:teuthology.orchestra.run.smithi112.stdout:Install 148 Packages 2024-04-25T10:22:49.638 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 4 Packages 2024-04-25T10:22:49.638 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:22:49.639 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 214 M 2024-04-25T10:22:49.639 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T10:22:50.977 INFO:teuthology.orchestra.run.smithi112.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 10 kB/s | 6.6 kB 00:00 2024-04-25T10:22:51.610 INFO:teuthology.orchestra.run.smithi112.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 1.3 MB/s | 863 kB 00:00 2024-04-25T10:22:51.719 INFO:teuthology.orchestra.run.smithi112.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 1.3 MB/s | 147 kB 00:00 2024-04-25T10:22:51.742 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T10:22:51.744 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T10:22:51.765 INFO:teuthology.orchestra.run.smithi019.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T10:22:51.766 INFO:teuthology.orchestra.run.smithi019.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T10:22:51.768 INFO:teuthology.orchestra.run.smithi019.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T10:22:51.769 INFO:teuthology.orchestra.run.smithi019.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T10:22:51.772 INFO:teuthology.orchestra.run.smithi019.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T10:22:51.775 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T10:22:51.776 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T10:22:51.853 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-04-25T10:22:51.874 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================= 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================= 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T10:22:51.875 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T10:22:51.876 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T10:22:51.877 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T10:22:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T10:22:51.879 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T10:22:51.880 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T10:22:51.881 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T10:22:51.882 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T10:22:51.883 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T10:22:51.884 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T10:22:51.885 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-04-25T10:22:51.886 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================= 2024-04-25T10:22:51.887 INFO:teuthology.orchestra.run.smithi019.stdout:Install 148 Packages 2024-04-25T10:22:51.887 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 4 Packages 2024-04-25T10:22:51.887 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:22:51.887 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 214 M 2024-04-25T10:22:51.887 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-04-25T10:22:52.311 INFO:teuthology.orchestra.run.smithi112.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 3.8 MB/s | 2.3 MB 00:00 2024-04-25T10:22:52.386 INFO:teuthology.orchestra.run.smithi112.stdout:(5/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 2.6 MB/s | 5.4 MB 00:02 2024-04-25T10:22:52.687 INFO:teuthology.orchestra.run.smithi112.stdout:(6/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 4.0 MB/s | 1.5 MB 00:00 2024-04-25T10:22:52.995 INFO:teuthology.orchestra.run.smithi112.stdout:(7/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 8.0 MB/s | 4.9 MB 00:00 2024-04-25T10:22:53.226 INFO:teuthology.orchestra.run.smithi019.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-04-25T10:22:54.068 INFO:teuthology.orchestra.run.smithi019.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 1.0 MB/s | 863 kB 00:00 2024-04-25T10:22:54.112 INFO:teuthology.orchestra.run.smithi112.stdout:(8/152): ceph-common-19.0.0-3291.g994e2f20.el9. 5.2 MB/s | 20 MB 00:03 2024-04-25T10:22:54.201 INFO:teuthology.orchestra.run.smithi019.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 1.1 MB/s | 147 kB 00:00 2024-04-25T10:22:54.287 INFO:teuthology.orchestra.run.smithi112.stdout:(9/152): ceph-radosgw-19.0.0-3291.g994e2f20.el9 7.8 MB/s | 10 MB 00:01 2024-04-25T10:22:54.312 INFO:teuthology.orchestra.run.smithi112.stdout:(10/152): ceph-selinux-19.0.0-3291.g994e2f20.el 126 kB/s | 25 kB 00:00 2024-04-25T10:22:54.422 INFO:teuthology.orchestra.run.smithi112.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 2.0 MB/s | 224 kB 00:00 2024-04-25T10:22:54.521 INFO:teuthology.orchestra.run.smithi112.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 270 kB/s | 27 kB 00:00 2024-04-25T10:22:54.638 INFO:teuthology.orchestra.run.smithi112.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 271 kB/s | 32 kB 00:00 2024-04-25T10:22:54.880 INFO:teuthology.orchestra.run.smithi112.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 3.1 MB/s | 756 kB 00:00 2024-04-25T10:22:55.005 INFO:teuthology.orchestra.run.smithi112.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.2 MB/s | 158 kB 00:00 2024-04-25T10:22:55.114 INFO:teuthology.orchestra.run.smithi112.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 1.1 MB/s | 127 kB 00:00 2024-04-25T10:22:55.260 INFO:teuthology.orchestra.run.smithi019.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 2.1 MB/s | 2.3 MB 00:01 2024-04-25T10:22:55.598 INFO:teuthology.orchestra.run.smithi112.stdout:(17/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 6.1 MB/s | 18 MB 00:02 2024-04-25T10:22:55.752 INFO:teuthology.orchestra.run.smithi019.stdout:(5/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 3.1 MB/s | 1.5 MB 00:00 2024-04-25T10:22:55.932 INFO:teuthology.orchestra.run.smithi112.stdout:(18/152): libradosstriper1-19.0.0-3291.g994e2f2 608 kB/s | 497 kB 00:00 2024-04-25T10:22:56.040 INFO:teuthology.orchestra.run.smithi112.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 416 kB/s | 45 kB 00:00 2024-04-25T10:22:56.166 INFO:teuthology.orchestra.run.smithi112.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 1.1 MB/s | 135 kB 00:00 2024-04-25T10:22:56.227 INFO:teuthology.orchestra.run.smithi019.stdout:(6/152): ceph-common-19.0.0-3291.g994e2f20.el9. 5.8 MB/s | 20 MB 00:03 2024-04-25T10:22:56.282 INFO:teuthology.orchestra.run.smithi112.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 1.4 MB/s | 161 kB 00:00 2024-04-25T10:22:56.391 INFO:teuthology.orchestra.run.smithi112.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 2.9 MB/s | 321 kB 00:00 2024-04-25T10:22:56.502 INFO:teuthology.orchestra.run.smithi019.stdout:(7/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 1.5 MB/s | 5.4 MB 00:03 2024-04-25T10:22:56.516 INFO:teuthology.orchestra.run.smithi112.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 2.3 MB/s | 298 kB 00:00 2024-04-25T10:22:56.667 INFO:teuthology.orchestra.run.smithi112.stdout:(24/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 4.8 MB/s | 5.2 MB 00:01 2024-04-25T10:22:56.684 INFO:teuthology.orchestra.run.smithi112.stdout:(25/152): python3-rgw-19.0.0-3291.g994e2f20.el9 596 kB/s | 100 kB 00:00 2024-04-25T10:22:56.776 INFO:teuthology.orchestra.run.smithi112.stdout:(26/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 795 kB/s | 86 kB 00:00 2024-04-25T10:22:56.901 INFO:teuthology.orchestra.run.smithi112.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.3 MB/s | 169 kB 00:00 2024-04-25T10:22:56.902 INFO:teuthology.orchestra.run.smithi019.stdout:(8/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 4.2 MB/s | 4.9 MB 00:01 2024-04-25T10:22:56.994 INFO:teuthology.orchestra.run.smithi019.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 278 kB/s | 25 kB 00:00 2024-04-25T10:22:57.009 INFO:teuthology.orchestra.run.smithi112.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 315 kB/s | 34 kB 00:00 2024-04-25T10:22:57.135 INFO:teuthology.orchestra.run.smithi112.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.1 MB/s | 142 kB 00:00 2024-04-25T10:22:57.410 INFO:teuthology.orchestra.run.smithi112.stdout:(30/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 4.2 MB/s | 3.0 MB 00:00 2024-04-25T10:22:57.778 INFO:teuthology.orchestra.run.smithi019.stdout:(10/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 11 MB/s | 18 MB 00:01 2024-04-25T10:22:57.862 INFO:teuthology.orchestra.run.smithi019.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 2.7 MB/s | 224 kB 00:00 2024-04-25T10:22:57.937 INFO:teuthology.orchestra.run.smithi019.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 365 kB/s | 27 kB 00:00 2024-04-25T10:22:58.020 INFO:teuthology.orchestra.run.smithi019.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 385 kB/s | 32 kB 00:00 2024-04-25T10:22:58.196 INFO:teuthology.orchestra.run.smithi019.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 4.2 MB/s | 756 kB 00:00 2024-04-25T10:22:58.235 INFO:teuthology.orchestra.run.smithi112.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 3.2 MB/s | 3.5 MB 00:01 2024-04-25T10:22:58.312 INFO:teuthology.orchestra.run.smithi019.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.3 MB/s | 158 kB 00:00 2024-04-25T10:22:58.369 INFO:teuthology.orchestra.run.smithi112.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 1.8 MB/s | 249 kB 00:00 2024-04-25T10:22:58.421 INFO:teuthology.orchestra.run.smithi019.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 1.1 MB/s | 127 kB 00:00 2024-04-25T10:22:58.461 INFO:teuthology.orchestra.run.smithi112.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 539 kB/s | 49 kB 00:00 2024-04-25T10:22:58.521 INFO:teuthology.orchestra.run.smithi019.stdout:(17/152): libradosstriper1-19.0.0-3291.g994e2f2 4.9 MB/s | 497 kB 00:00 2024-04-25T10:22:58.570 INFO:teuthology.orchestra.run.smithi112.stdout:(34/152): ceph-mgr-diskprediction-local-19.0.0- 6.4 MB/s | 7.4 MB 00:01 2024-04-25T10:22:58.595 INFO:teuthology.orchestra.run.smithi112.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3291.g9 123 kB/s | 16 kB 00:00 2024-04-25T10:22:58.678 INFO:teuthology.orchestra.run.smithi112.stdout:(36/152): ceph-volume-19.0.0-3291.g994e2f20.el9 2.5 MB/s | 273 kB 00:00 2024-04-25T10:22:58.779 INFO:teuthology.orchestra.run.smithi112.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 183 kB/s | 18 kB 00:00 2024-04-25T10:22:58.846 INFO:teuthology.orchestra.run.smithi112.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2024-04-25T10:22:58.946 INFO:teuthology.orchestra.run.smithi112.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 7.9 MB/s | 803 kB 00:00 2024-04-25T10:22:58.980 INFO:teuthology.orchestra.run.smithi112.stdout:(40/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 1.9 MB/s | 762 kB 00:00 2024-04-25T10:22:58.980 INFO:teuthology.orchestra.run.smithi019.stdout:(18/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 11 MB/s | 5.2 MB 00:00 2024-04-25T10:22:59.038 INFO:teuthology.orchestra.run.smithi112.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-25T10:22:59.039 INFO:teuthology.orchestra.run.smithi019.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 788 kB/s | 45 kB 00:00 2024-04-25T10:22:59.072 INFO:teuthology.orchestra.run.smithi112.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-25T10:22:59.097 INFO:teuthology.orchestra.run.smithi019.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 2.3 MB/s | 135 kB 00:00 2024-04-25T10:22:59.139 INFO:teuthology.orchestra.run.smithi112.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-25T10:22:59.156 INFO:teuthology.orchestra.run.smithi019.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 2.7 MB/s | 161 kB 00:00 2024-04-25T10:22:59.189 INFO:teuthology.orchestra.run.smithi112.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.2 MB 00:00 2024-04-25T10:22:59.223 INFO:teuthology.orchestra.run.smithi019.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 4.8 MB/s | 321 kB 00:00 2024-04-25T10:22:59.231 INFO:teuthology.orchestra.run.smithi112.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-04-25T10:22:59.273 INFO:teuthology.orchestra.run.smithi112.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-25T10:22:59.290 INFO:teuthology.orchestra.run.smithi019.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 4.4 MB/s | 298 kB 00:00 2024-04-25T10:22:59.323 INFO:teuthology.orchestra.run.smithi112.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-25T10:22:59.340 INFO:teuthology.orchestra.run.smithi019.stdout:(24/152): python3-rgw-19.0.0-3291.g994e2f20.el9 2.0 MB/s | 100 kB 00:00 2024-04-25T10:22:59.407 INFO:teuthology.orchestra.run.smithi019.stdout:(25/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 1.3 MB/s | 86 kB 00:00 2024-04-25T10:22:59.682 INFO:teuthology.orchestra.run.smithi019.stdout:(26/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 11 MB/s | 3.0 MB 00:00 2024-04-25T10:22:59.707 INFO:teuthology.orchestra.run.smithi112.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 1.6 MB/s | 689 kB 00:00 2024-04-25T10:22:59.741 INFO:teuthology.orchestra.run.smithi019.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 2.9 MB/s | 169 kB 00:00 2024-04-25T10:22:59.774 INFO:teuthology.orchestra.run.smithi112.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-25T10:22:59.799 INFO:teuthology.orchestra.run.smithi019.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 597 kB/s | 34 kB 00:00 2024-04-25T10:22:59.834 INFO:teuthology.orchestra.run.smithi112.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 369 kB/s | 21 kB 00:00 2024-04-25T10:22:59.866 INFO:teuthology.orchestra.run.smithi019.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 2.1 MB/s | 142 kB 00:00 2024-04-25T10:22:59.974 INFO:teuthology.orchestra.run.smithi112.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-04-25T10:23:00.041 INFO:teuthology.orchestra.run.smithi112.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 491 kB/s | 33 kB 00:00 2024-04-25T10:23:00.067 INFO:teuthology.orchestra.run.smithi112.stdout:(53/152): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-04-25T10:23:00.133 INFO:teuthology.orchestra.run.smithi112.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-04-25T10:23:00.177 INFO:teuthology.orchestra.run.smithi019.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 11 MB/s | 3.5 MB 00:00 2024-04-25T10:23:00.192 INFO:teuthology.orchestra.run.smithi112.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-04-25T10:23:00.292 INFO:teuthology.orchestra.run.smithi112.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-04-25T10:23:00.351 INFO:teuthology.orchestra.run.smithi112.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-04-25T10:23:00.693 INFO:teuthology.orchestra.run.smithi112.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 1.9 MB/s | 662 kB 00:00 2024-04-25T10:23:00.752 INFO:teuthology.orchestra.run.smithi019.stdout:(31/152): ceph-mgr-diskprediction-local-19.0.0- 13 MB/s | 7.4 MB 00:00 2024-04-25T10:23:00.810 INFO:teuthology.orchestra.run.smithi112.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.9 MB/s | 3.0 MB 00:00 2024-04-25T10:23:00.869 INFO:teuthology.orchestra.run.smithi112.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-04-25T10:23:00.911 INFO:teuthology.orchestra.run.smithi019.stdout:(32/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 2.3 MB/s | 10 MB 00:04 2024-04-25T10:23:00.928 INFO:teuthology.orchestra.run.smithi112.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 2.4 MB/s | 582 kB 00:00 2024-04-25T10:23:00.944 INFO:teuthology.orchestra.run.smithi019.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3291.g99 1.3 MB/s | 249 kB 00:00 2024-04-25T10:23:00.953 INFO:teuthology.orchestra.run.smithi112.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 568 kB/s | 47 kB 00:00 2024-04-25T10:23:00.970 INFO:teuthology.orchestra.run.smithi019.stdout:(34/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 843 kB/s | 49 kB 00:00 2024-04-25T10:23:00.995 INFO:teuthology.orchestra.run.smithi019.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3291.g9 332 kB/s | 16 kB 00:00 2024-04-25T10:23:01.020 INFO:teuthology.orchestra.run.smithi112.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-25T10:23:01.045 INFO:teuthology.orchestra.run.smithi112.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-04-25T10:23:01.079 INFO:teuthology.orchestra.run.smithi019.stdout:(36/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 9.0 MB/s | 762 kB 00:00 2024-04-25T10:23:01.087 INFO:teuthology.orchestra.run.smithi112.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 528 kB/s | 35 kB 00:00 2024-04-25T10:23:01.121 INFO:teuthology.orchestra.run.smithi019.stdout:(37/152): ceph-volume-19.0.0-3291.g994e2f20.el9 1.8 MB/s | 273 kB 00:00 2024-04-25T10:23:01.146 INFO:teuthology.orchestra.run.smithi019.stdout:(38/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 275 kB/s | 18 kB 00:00 2024-04-25T10:23:01.321 INFO:teuthology.orchestra.run.smithi019.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 404 kB/s | 80 kB 00:00 2024-04-25T10:23:01.472 INFO:teuthology.orchestra.run.smithi019.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-04-25T10:23:01.513 INFO:teuthology.orchestra.run.smithi019.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-04-25T10:23:01.546 INFO:teuthology.orchestra.run.smithi112.stdout:(66/152): ceph-test-19.0.0-3291.g994e2f20.el9.x 6.0 MB/s | 43 MB 00:07 2024-04-25T10:23:01.597 INFO:teuthology.orchestra.run.smithi019.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-04-25T10:23:01.656 INFO:teuthology.orchestra.run.smithi019.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-25T10:23:01.739 INFO:teuthology.orchestra.run.smithi019.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-04-25T10:23:01.773 INFO:teuthology.orchestra.run.smithi019.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-04-25T10:23:01.823 INFO:teuthology.orchestra.run.smithi019.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-25T10:23:01.854 INFO:teuthology.orchestra.run.smithi112.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-04-25T10:23:01.873 INFO:teuthology.orchestra.run.smithi019.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-04-25T10:23:01.957 INFO:teuthology.orchestra.run.smithi019.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 5.1 MB/s | 689 kB 00:00 2024-04-25T10:23:01.971 INFO:teuthology.orchestra.run.smithi112.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 7.6 MB/s | 911 kB 00:00 2024-04-25T10:23:02.038 INFO:teuthology.orchestra.run.smithi112.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-25T10:23:02.041 INFO:teuthology.orchestra.run.smithi019.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 5.5 MB/s | 943 kB 00:00 2024-04-25T10:23:02.066 INFO:teuthology.orchestra.run.smithi019.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 993 kB/s | 107 kB 00:00 2024-04-25T10:23:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 326 kB/s | 21 kB 00:00 2024-04-25T10:23:02.130 INFO:teuthology.orchestra.run.smithi112.stdout:(70/152): openblas-openmp-0.3.21-2.el9.x86_64.r 4.4 MB/s | 4.7 MB 00:01 2024-04-25T10:23:02.159 INFO:teuthology.orchestra.run.smithi019.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 668 kB/s | 33 kB 00:00 2024-04-25T10:23:02.259 INFO:teuthology.orchestra.run.smithi019.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 1.6 MB/s | 313 kB 00:00 2024-04-25T10:23:02.263 INFO:teuthology.orchestra.run.smithi112.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-04-25T10:23:02.322 INFO:teuthology.orchestra.run.smithi112.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T10:23:02.481 INFO:teuthology.orchestra.run.smithi112.stdout:(73/152): postgresql-13.14-1.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2024-04-25T10:23:02.556 INFO:teuthology.orchestra.run.smithi112.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-04-25T10:23:02.623 INFO:teuthology.orchestra.run.smithi112.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-04-25T10:23:02.648 INFO:teuthology.orchestra.run.smithi112.stdout:(76/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2024-04-25T10:23:02.682 INFO:teuthology.orchestra.run.smithi112.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-04-25T10:23:02.699 INFO:teuthology.orchestra.run.smithi112.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-04-25T10:23:02.734 INFO:teuthology.orchestra.run.smithi019.stdout:(54/152): ceph-test-19.0.0-3291.g994e2f20.el9.x 7.5 MB/s | 43 MB 00:05 2024-04-25T10:23:02.740 INFO:teuthology.orchestra.run.smithi112.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-25T10:23:02.751 INFO:teuthology.orchestra.run.smithi019.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 37 kB/s | 18 kB 00:00 2024-04-25T10:23:02.757 INFO:teuthology.orchestra.run.smithi112.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-04-25T10:23:02.776 INFO:teuthology.orchestra.run.smithi019.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 275 kB/s | 11 kB 00:00 2024-04-25T10:23:02.835 INFO:teuthology.orchestra.run.smithi019.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 788 kB/s | 45 kB 00:00 2024-04-25T10:23:02.860 INFO:teuthology.orchestra.run.smithi019.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.5 MB/s | 160 kB 00:00 2024-04-25T10:23:02.866 INFO:teuthology.orchestra.run.smithi112.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-04-25T10:23:02.900 INFO:teuthology.orchestra.run.smithi112.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-04-25T10:23:02.925 INFO:teuthology.orchestra.run.smithi112.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-25T10:23:02.935 INFO:teuthology.orchestra.run.smithi019.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.9 MB/s | 3.0 MB 00:00 2024-04-25T10:23:02.959 INFO:teuthology.orchestra.run.smithi112.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-25T10:23:02.984 INFO:teuthology.orchestra.run.smithi112.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-04-25T10:23:02.986 INFO:teuthology.orchestra.run.smithi019.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 520 kB/s | 25 kB 00:00 2024-04-25T10:23:03.028 INFO:teuthology.orchestra.run.smithi019.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 3.4 MB/s | 582 kB 00:00 2024-04-25T10:23:03.042 INFO:teuthology.orchestra.run.smithi112.stdout:(86/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-04-25T10:23:03.061 INFO:teuthology.orchestra.run.smithi019.stdout:(62/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2024-04-25T10:23:03.068 INFO:teuthology.orchestra.run.smithi112.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-04-25T10:23:03.086 INFO:teuthology.orchestra.run.smithi019.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 477 kB/s | 47 kB 00:00 2024-04-25T10:23:03.135 INFO:teuthology.orchestra.run.smithi112.stdout:(88/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-04-25T10:23:03.137 INFO:teuthology.orchestra.run.smithi019.stdout:(64/152): openblas-0.3.21-2.el9.x86_64.rpm 719 kB/s | 35 kB 00:00 2024-04-25T10:23:03.161 INFO:teuthology.orchestra.run.smithi112.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-04-25T10:23:03.170 INFO:teuthology.orchestra.run.smithi019.stdout:(65/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-04-25T10:23:03.187 INFO:teuthology.orchestra.run.smithi112.stdout:(90/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-04-25T10:23:03.196 INFO:teuthology.orchestra.run.smithi019.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-04-25T10:23:03.213 INFO:teuthology.orchestra.run.smithi112.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 692 kB/s | 54 kB 00:00 2024-04-25T10:23:03.246 INFO:teuthology.orchestra.run.smithi112.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-04-25T10:23:03.280 INFO:teuthology.orchestra.run.smithi112.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 660 kB/s | 44 kB 00:00 2024-04-25T10:23:03.322 INFO:teuthology.orchestra.run.smithi112.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-25T10:23:03.347 INFO:teuthology.orchestra.run.smithi112.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 537 kB/s | 36 kB 00:00 2024-04-25T10:23:03.363 INFO:teuthology.orchestra.run.smithi019.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 9.6 MB/s | 1.6 MB 00:00 2024-04-25T10:23:03.381 INFO:teuthology.orchestra.run.smithi112.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-04-25T10:23:03.406 INFO:teuthology.orchestra.run.smithi112.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-25T10:23:03.440 INFO:teuthology.orchestra.run.smithi112.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 985 kB/s | 58 kB 00:00 2024-04-25T10:23:03.465 INFO:teuthology.orchestra.run.smithi112.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-25T10:23:03.499 INFO:teuthology.orchestra.run.smithi112.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-25T10:23:03.504 INFO:teuthology.orchestra.run.smithi019.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-04-25T10:23:03.524 INFO:teuthology.orchestra.run.smithi112.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-04-25T10:23:03.566 INFO:teuthology.orchestra.run.smithi112.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 334 kB/s | 22 kB 00:00 2024-04-25T10:23:03.596 INFO:teuthology.orchestra.run.smithi019.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-25T10:23:03.638 INFO:teuthology.orchestra.run.smithi019.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 3.2 MB/s | 911 kB 00:00 2024-04-25T10:23:03.641 INFO:teuthology.orchestra.run.smithi112.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-04-25T10:23:03.680 INFO:teuthology.orchestra.run.smithi019.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 764 kB/s | 133 kB 00:00 2024-04-25T10:23:03.747 INFO:teuthology.orchestra.run.smithi019.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-25T10:23:03.806 INFO:teuthology.orchestra.run.smithi019.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-04-25T10:23:03.889 INFO:teuthology.orchestra.run.smithi019.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-04-25T10:23:04.023 INFO:teuthology.orchestra.run.smithi019.stdout:(75/152): postgresql-server-13.14-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-04-25T10:23:04.082 INFO:teuthology.orchestra.run.smithi019.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-04-25T10:23:04.140 INFO:teuthology.orchestra.run.smithi019.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 221 kB/s | 26 kB 00:00 2024-04-25T10:23:04.182 INFO:teuthology.orchestra.run.smithi019.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 193 kB/s | 19 kB 00:00 2024-04-25T10:23:04.232 INFO:teuthology.orchestra.run.smithi019.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 172 kB 00:00 2024-04-25T10:23:04.258 INFO:teuthology.orchestra.run.smithi019.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 468 kB/s | 35 kB 00:00 2024-04-25T10:23:04.366 INFO:teuthology.orchestra.run.smithi019.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 9.7 MB/s | 6.0 MB 00:00 2024-04-25T10:23:04.441 INFO:teuthology.orchestra.run.smithi019.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-04-25T10:23:04.475 INFO:teuthology.orchestra.run.smithi019.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-04-25T10:23:04.534 INFO:teuthology.orchestra.run.smithi019.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 849 kB/s | 77 kB 00:00 2024-04-25T10:23:04.559 INFO:teuthology.orchestra.run.smithi019.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 511 kB/s | 42 kB 00:00 2024-04-25T10:23:04.634 INFO:teuthology.orchestra.run.smithi019.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 2.7 MB/s | 269 kB 00:00 2024-04-25T10:23:04.659 INFO:teuthology.orchestra.run.smithi019.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-04-25T10:23:04.666 INFO:teuthology.orchestra.run.smithi112.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 301 kB/s | 309 kB 00:01 2024-04-25T10:23:04.769 INFO:teuthology.orchestra.run.smithi019.stdout:(88/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.5 MB/s | 5.1 MB 00:00 2024-04-25T10:23:04.818 INFO:teuthology.orchestra.run.smithi019.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 323 kB/s | 51 kB 00:00 2024-04-25T10:23:04.844 INFO:teuthology.orchestra.run.smithi019.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 720 kB/s | 54 kB 00:00 2024-04-25T10:23:04.878 INFO:teuthology.orchestra.run.smithi019.stdout:(91/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.1 MB/s | 279 kB 00:00 2024-04-25T10:23:04.883 INFO:teuthology.orchestra.run.smithi112.stdout:(105/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.4 MB/s | 16 MB 00:01 2024-04-25T10:23:04.909 INFO:teuthology.orchestra.run.smithi112.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 408 kB/s | 548 kB 00:01 2024-04-25T10:23:04.928 INFO:teuthology.orchestra.run.smithi019.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 504 kB/s | 42 kB 00:00 2024-04-25T10:23:04.934 INFO:teuthology.orchestra.run.smithi112.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-04-25T10:23:04.953 INFO:teuthology.orchestra.run.smithi019.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 595 kB/s | 44 kB 00:00 2024-04-25T10:23:05.012 INFO:teuthology.orchestra.run.smithi019.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 625 kB/s | 36 kB 00:00 2024-04-25T10:23:05.051 INFO:teuthology.orchestra.run.smithi112.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 223 kB/s | 26 kB 00:00 2024-04-25T10:23:05.053 INFO:teuthology.orchestra.run.smithi019.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-04-25T10:23:05.076 INFO:teuthology.orchestra.run.smithi112.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 343 kB/s | 49 kB 00:00 2024-04-25T10:23:05.112 INFO:teuthology.orchestra.run.smithi019.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 478 kB/s | 47 kB 00:00 2024-04-25T10:23:05.159 INFO:teuthology.orchestra.run.smithi112.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 621 kB/s | 67 kB 00:00 2024-04-25T10:23:05.171 INFO:teuthology.orchestra.run.smithi019.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 2.6 MB/s | 305 kB 00:00 2024-04-25T10:23:05.196 INFO:teuthology.orchestra.run.smithi019.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 700 kB/s | 58 kB 00:00 2024-04-25T10:23:05.243 INFO:teuthology.orchestra.run.smithi112.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 905 kB/s | 151 kB 00:00 2024-04-25T10:23:05.282 INFO:teuthology.orchestra.run.smithi019.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 849 kB/s | 94 kB 00:00 2024-04-25T10:23:05.313 INFO:teuthology.orchestra.run.smithi019.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 550 kB/s | 64 kB 00:00 2024-04-25T10:23:05.373 INFO:teuthology.orchestra.run.smithi019.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 509 kB/s | 45 kB 00:00 2024-04-25T10:23:05.397 INFO:teuthology.orchestra.run.smithi019.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 270 kB/s | 22 kB 00:00 2024-04-25T10:23:05.498 INFO:teuthology.orchestra.run.smithi019.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 6.8 MB/s | 863 kB 00:00 2024-04-25T10:23:05.501 INFO:teuthology.orchestra.run.smithi112.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.4 MB/s | 838 kB 00:00 2024-04-25T10:23:05.652 INFO:teuthology.orchestra.run.smithi112.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 1.3 MB/s | 548 kB 00:00 2024-04-25T10:23:05.677 INFO:teuthology.orchestra.run.smithi112.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 248 kB/s | 43 kB 00:00 2024-04-25T10:23:05.731 INFO:teuthology.orchestra.run.smithi019.stdout:(104/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-04-25T10:23:05.811 INFO:teuthology.orchestra.run.smithi112.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 203 kB/s | 32 kB 00:00 2024-04-25T10:23:05.836 INFO:teuthology.orchestra.run.smithi112.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 94 kB/s | 15 kB 00:00 2024-04-25T10:23:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-04-25T10:23:06.003 INFO:teuthology.orchestra.run.smithi112.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 895 kB/s | 172 kB 00:00 2024-04-25T10:23:06.045 INFO:teuthology.orchestra.run.smithi112.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 1.7 MB/s | 358 kB 00:00 2024-04-25T10:23:06.157 INFO:teuthology.orchestra.run.smithi019.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 469 kB/s | 309 kB 00:00 2024-04-25T10:23:06.190 INFO:teuthology.orchestra.run.smithi019.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 692 kB/s | 548 kB 00:00 2024-04-25T10:23:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 865 kB/s | 303 kB 00:00 2024-04-25T10:23:06.379 INFO:teuthology.orchestra.run.smithi112.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 106 kB/s | 35 kB 00:00 2024-04-25T10:23:06.438 INFO:teuthology.orchestra.run.smithi112.stdout:(121/152): libarrow-9.0.0-10.el9.x86_64.rpm 2.8 MB/s | 4.4 MB 00:01 2024-04-25T10:23:06.440 INFO:teuthology.orchestra.run.smithi019.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 92 kB/s | 26 kB 00:00 2024-04-25T10:23:06.471 INFO:teuthology.orchestra.run.smithi112.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-04-25T10:23:06.541 INFO:teuthology.orchestra.run.smithi019.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 139 kB/s | 49 kB 00:00 2024-04-25T10:23:06.563 INFO:teuthology.orchestra.run.smithi112.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-25T10:23:06.597 INFO:teuthology.orchestra.run.smithi112.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-04-25T10:23:06.714 INFO:teuthology.orchestra.run.smithi112.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 118 kB/s | 18 kB 00:00 2024-04-25T10:23:06.756 INFO:teuthology.orchestra.run.smithi112.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 146 kB/s | 23 kB 00:00 2024-04-25T10:23:06.808 INFO:teuthology.orchestra.run.smithi019.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 184 kB/s | 67 kB 00:00 2024-04-25T10:23:06.848 INFO:teuthology.orchestra.run.smithi112.stdout:(127/152): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-04-25T10:23:06.890 INFO:teuthology.orchestra.run.smithi112.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 111 kB/s | 19 kB 00:00 2024-04-25T10:23:06.931 INFO:teuthology.orchestra.run.smithi112.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 112 kB/s | 20 kB 00:00 2024-04-25T10:23:07.050 INFO:teuthology.orchestra.run.smithi019.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 298 kB/s | 151 kB 00:00 2024-04-25T10:23:07.225 INFO:teuthology.orchestra.run.smithi019.stdout:(112/152): libarrow-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-04-25T10:23:07.232 INFO:teuthology.orchestra.run.smithi112.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 135 kB/s | 46 kB 00:00 2024-04-25T10:23:07.265 INFO:teuthology.orchestra.run.smithi112.stdout:(131/152): python3-kubernetes-26.1.0-2.el9.noar 2.4 MB/s | 1.0 MB 00:00 2024-04-25T10:23:07.324 INFO:teuthology.orchestra.run.smithi112.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 201 kB/s | 79 kB 00:00 2024-04-25T10:23:07.349 INFO:teuthology.orchestra.run.smithi112.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 493 kB/s | 58 kB 00:00 2024-04-25T10:23:07.383 INFO:teuthology.orchestra.run.smithi112.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-25T10:23:07.475 INFO:teuthology.orchestra.run.smithi112.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 719 kB/s | 90 kB 00:00 2024-04-25T10:23:07.492 INFO:teuthology.orchestra.run.smithi019.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-25T10:23:07.500 INFO:teuthology.orchestra.run.smithi112.stdout:(136/152): python3-portend-3.1.0-2.el9.noarch.r 93 kB/s | 16 kB 00:00 2024-04-25T10:23:07.525 INFO:teuthology.orchestra.run.smithi112.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 199 kB/s | 28 kB 00:00 2024-04-25T10:23:07.592 INFO:teuthology.orchestra.run.smithi019.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 119 kB/s | 43 kB 00:00 2024-04-25T10:23:07.651 INFO:teuthology.orchestra.run.smithi112.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-04-25T10:23:07.651 INFO:teuthology.orchestra.run.smithi019.stdout:(115/152): python3-asyncssh-2.13.2-5.el9.noarch 914 kB/s | 548 kB 00:00 2024-04-25T10:23:07.676 INFO:teuthology.orchestra.run.smithi112.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 393 kB/s | 59 kB 00:00 2024-04-25T10:23:07.710 INFO:teuthology.orchestra.run.smithi112.stdout:(140/152): python3-repoze-lru-0.7-16.el9.noarch 131 kB/s | 31 kB 00:00 2024-04-25T10:23:07.760 INFO:teuthology.orchestra.run.smithi112.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 329 kB/s | 36 kB 00:00 2024-04-25T10:23:07.784 INFO:teuthology.orchestra.run.smithi019.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 110 kB/s | 32 kB 00:00 2024-04-25T10:23:07.785 INFO:teuthology.orchestra.run.smithi112.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 469 kB/s | 51 kB 00:00 2024-04-25T10:23:07.859 INFO:teuthology.orchestra.run.smithi019.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 56 kB/s | 15 kB 00:00 2024-04-25T10:23:07.868 INFO:teuthology.orchestra.run.smithi112.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 825 kB/s | 90 kB 00:00 2024-04-25T10:23:07.919 INFO:teuthology.orchestra.run.smithi112.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-04-25T10:23:07.986 INFO:teuthology.orchestra.run.smithi112.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2024-04-25T10:23:08.053 INFO:teuthology.orchestra.run.smithi112.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-25T10:23:08.085 INFO:teuthology.orchestra.run.smithi019.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 396 kB/s | 172 kB 00:00 2024-04-25T10:23:08.237 INFO:teuthology.orchestra.run.smithi112.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-04-25T10:23:08.302 INFO:teuthology.orchestra.run.smithi019.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 694 kB/s | 358 kB 00:00 2024-04-25T10:23:08.369 INFO:teuthology.orchestra.run.smithi019.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 125 kB/s | 35 kB 00:00 2024-04-25T10:23:08.402 INFO:teuthology.orchestra.run.smithi019.stdout:(121/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 559 kB/s | 303 kB 00:00 2024-04-25T10:23:08.578 INFO:teuthology.orchestra.run.smithi112.stdout:(148/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 9.1 MB/s | 3.1 MB 00:00 2024-04-25T10:23:08.604 INFO:teuthology.orchestra.run.smithi112.stdout:(149/152): python3-webob-1.8.7-6.el9.noarch.rpm 257 kB/s | 230 kB 00:00 2024-04-25T10:23:08.704 INFO:teuthology.orchestra.run.smithi112.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 11 MB/s | 1.3 MB 00:00 2024-04-25T10:23:08.771 INFO:teuthology.orchestra.run.smithi112.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-04-25T10:23:08.828 INFO:teuthology.orchestra.run.smithi019.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 391 kB/s | 206 kB 00:00 2024-04-25T10:23:08.853 INFO:teuthology.orchestra.run.smithi019.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 321 kB/s | 144 kB 00:00 2024-04-25T10:23:09.021 INFO:teuthology.orchestra.run.smithi112.stdout:(152/152): librados2-19.0.0-3291.g994e2f20.el9. 3.4 MB/s | 3.3 MB 00:00 2024-04-25T10:23:09.024 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T10:23:09.024 INFO:teuthology.orchestra.run.smithi112.stdout:Total 11 MB/s | 214 MB 00:19 2024-04-25T10:23:09.028 INFO:teuthology.orchestra.run.smithi019.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 54 kB/s | 11 kB 00:00 2024-04-25T10:23:09.120 INFO:teuthology.orchestra.run.smithi019.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 66 kB/s | 18 kB 00:00 2024-04-25T10:23:09.245 INFO:teuthology.orchestra.run.smithi019.stdout:(126/152): python3-grpcio-1.46.7-10.el9.x86_64. 2.3 MB/s | 2.0 MB 00:00 2024-04-25T10:23:09.320 INFO:teuthology.orchestra.run.smithi019.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 79 kB/s | 23 kB 00:00 2024-04-25T10:23:09.429 INFO:teuthology.orchestra.run.smithi019.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 63 kB/s | 19 kB 00:00 2024-04-25T10:23:09.513 INFO:teuthology.orchestra.run.smithi019.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-04-25T10:23:09.779 INFO:teuthology.orchestra.run.smithi019.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 132 kB/s | 46 kB 00:00 2024-04-25T10:23:09.938 INFO:teuthology.orchestra.run.smithi019.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 186 kB/s | 79 kB 00:00 2024-04-25T10:23:10.005 INFO:teuthology.orchestra.run.smithi019.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-04-25T10:23:10.125 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T10:23:10.130 INFO:teuthology.orchestra.run.smithi019.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 165 kB/s | 58 kB 00:00 2024-04-25T10:23:10.268 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T10:23:10.268 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T10:23:10.280 INFO:teuthology.orchestra.run.smithi019.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 60 kB/s | 16 kB 00:00 2024-04-25T10:23:10.464 INFO:teuthology.orchestra.run.smithi019.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 519 kB/s | 272 kB 00:00 2024-04-25T10:23:10.489 INFO:teuthology.orchestra.run.smithi019.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 251 kB/s | 90 kB 00:00 2024-04-25T10:23:10.540 INFO:teuthology.orchestra.run.smithi019.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 109 kB/s | 28 kB 00:00 2024-04-25T10:23:10.732 INFO:teuthology.orchestra.run.smithi019.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 115 kB/s | 31 kB 00:00 2024-04-25T10:23:10.890 INFO:teuthology.orchestra.run.smithi019.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 169 kB/s | 59 kB 00:00 2024-04-25T10:23:11.024 INFO:teuthology.orchestra.run.smithi019.stdout:(140/152): python3-routes-2.5.1-5.el9.noarch.rp 353 kB/s | 188 kB 00:00 2024-04-25T10:23:11.049 INFO:teuthology.orchestra.run.smithi019.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 113 kB/s | 36 kB 00:00 2024-04-25T10:23:11.233 INFO:teuthology.orchestra.run.smithi019.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-04-25T10:23:11.475 INFO:teuthology.orchestra.run.smithi019.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 211 kB/s | 90 kB 00:00 2024-04-25T10:23:11.542 INFO:teuthology.orchestra.run.smithi019.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 445 kB/s | 230 kB 00:00 2024-04-25T10:23:11.742 INFO:teuthology.orchestra.run.smithi019.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 75 kB/s | 20 kB 00:00 2024-04-25T10:23:11.825 INFO:teuthology.orchestra.run.smithi019.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 722 kB/s | 427 kB 00:00 2024-04-25T10:23:12.042 INFO:teuthology.orchestra.run.smithi019.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 383 kB/s | 192 kB 00:00 2024-04-25T10:23:12.088 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T10:23:12.088 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T10:23:12.217 INFO:teuthology.orchestra.run.smithi019.stdout:(148/152): librados2-19.0.0-3291.g994e2f20.el9. 8.5 MB/s | 3.3 MB 00:00 2024-04-25T10:23:12.526 INFO:teuthology.orchestra.run.smithi019.stdout:(149/152): thrift-0.15.0-2.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-04-25T10:23:13.243 INFO:teuthology.orchestra.run.smithi019.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:01 2024-04-25T10:23:13.343 INFO:teuthology.orchestra.run.smithi019.stdout:(151/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 2.4 MB/s | 3.1 MB 00:01 2024-04-25T10:23:13.860 INFO:teuthology.orchestra.run.smithi019.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 1.8 MB/s | 2.4 MB 00:01 2024-04-25T10:23:13.866 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-04-25T10:23:13.867 INFO:teuthology.orchestra.run.smithi019.stdout:Total 9.7 MB/s | 214 MB 00:21 2024-04-25T10:23:16.753 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-04-25T10:23:17.013 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-04-25T10:23:17.013 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-04-25T10:23:18.022 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T10:23:18.108 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T10:23:18.147 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T10:23:18.200 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T10:23:18.342 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T10:23:18.368 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T10:23:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T10:23:18.743 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T10:23:18.860 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:23:18.986 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:23:19.020 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:23:19.111 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:23:19.141 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T10:23:19.287 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T10:23:19.338 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T10:23:19.466 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:23:19.471 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:23:19.500 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T10:23:19.563 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T10:23:19.584 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T10:23:19.606 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T10:23:19.685 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-04-25T10:23:19.686 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-04-25T10:23:19.825 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T10:23:19.859 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T10:23:19.968 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T10:23:20.071 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T10:23:20.100 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T10:23:20.135 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T10:23:20.209 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T10:23:20.242 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T10:23:20.287 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T10:23:20.319 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T10:23:20.346 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T10:23:20.416 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T10:23:20.469 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T10:23:20.500 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T10:23:20.544 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T10:23:20.620 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T10:23:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T10:23:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T10:23:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T10:23:20.804 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T10:23:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T10:23:20.923 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T10:23:21.058 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T10:23:21.118 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T10:23:21.628 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T10:23:21.705 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T10:23:21.734 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T10:23:21.777 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T10:23:22.007 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T10:23:22.049 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T10:23:22.222 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T10:23:22.292 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T10:23:22.347 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T10:23:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T10:23:22.443 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T10:23:22.480 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T10:23:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T10:23:22.563 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T10:23:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T10:23:22.647 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T10:23:22.783 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T10:23:22.828 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T10:23:22.859 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T10:23:22.900 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T10:23:22.993 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T10:23:23.025 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T10:23:23.066 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T10:23:23.091 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T10:23:23.116 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T10:23:23.198 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T10:23:23.326 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T10:23:23.365 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T10:23:23.393 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T10:23:23.427 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T10:23:23.466 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T10:23:23.498 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T10:23:23.528 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T10:23:23.563 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T10:23:23.596 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T10:23:23.637 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T10:23:23.672 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T10:23:23.758 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T10:23:23.802 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T10:23:23.834 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T10:23:23.880 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T10:23:23.978 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T10:23:24.035 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T10:23:24.754 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T10:23:24.799 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T10:23:24.834 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T10:23:24.931 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T10:23:24.982 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T10:23:25.070 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T10:23:25.102 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T10:23:25.278 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T10:23:25.308 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T10:23:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T10:23:26.023 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T10:23:26.131 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T10:23:26.203 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-04-25T10:23:26.309 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T10:23:26.405 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T10:23:26.531 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T10:23:26.607 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T10:23:26.652 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T10:23:26.772 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T10:23:27.233 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T10:23:27.335 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T10:23:27.349 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:23:27.421 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T10:23:27.449 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T10:23:27.482 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T10:23:27.545 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:23:27.576 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:23:27.716 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:23:27.767 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T10:23:27.801 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T10:23:27.845 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T10:23:27.935 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T10:23:27.975 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T10:23:28.011 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T10:23:28.176 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T10:23:28.253 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T10:23:28.279 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:23:28.449 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:23:28.482 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T10:23:28.499 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T10:23:28.531 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T10:23:28.569 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T10:23:28.598 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T10:23:28.602 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T10:23:28.624 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T10:23:28.666 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T10:23:29.000 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T10:23:29.057 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T10:23:29.267 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T10:23:29.397 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T10:23:29.475 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T10:23:29.559 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T10:23:29.661 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T10:23:29.712 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T10:23:29.777 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T10:23:29.826 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T10:23:29.864 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T10:23:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T10:23:30.073 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T10:23:30.116 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T10:23:30.174 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T10:23:30.283 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T10:23:30.319 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T10:23:30.381 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T10:23:30.418 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T10:23:30.540 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T10:23:30.629 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T10:23:30.743 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T10:23:30.804 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:23:30.838 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:23:30.918 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T10:23:30.990 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T10:23:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:23:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T10:23:31.539 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T10:23:31.539 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T10:23:31.539 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T10:23:31.539 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:23:31.559 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T10:23:31.700 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T10:23:31.841 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T10:23:31.882 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T10:23:31.927 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T10:23:31.965 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T10:23:32.028 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T10:23:32.281 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T10:23:32.368 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T10:23:32.451 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T10:23:32.554 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T10:23:32.593 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T10:23:32.633 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T10:23:32.703 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T10:23:32.748 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T10:23:32.812 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T10:23:32.870 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T10:23:33.103 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T10:23:33.153 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T10:23:33.192 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T10:23:33.247 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T10:23:33.380 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T10:23:33.437 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T10:23:33.521 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T10:23:33.558 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T10:23:33.582 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T10:23:33.763 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T10:23:33.946 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T10:23:33.987 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T10:23:34.026 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T10:23:34.095 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T10:23:34.157 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T10:23:34.219 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T10:23:34.270 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T10:23:34.325 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T10:23:34.372 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T10:23:34.449 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T10:23:34.502 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T10:23:34.658 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T10:23:34.727 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T10:23:34.768 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T10:23:34.841 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T10:23:34.997 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T10:23:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T10:23:36.058 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T10:23:36.105 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T10:23:36.138 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T10:23:36.263 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T10:23:36.324 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T10:23:36.454 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T10:23:36.497 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T10:23:36.737 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T10:23:36.768 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T10:23:36.879 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T10:23:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T10:23:37.931 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T10:23:39.584 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T10:23:39.691 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T10:23:39.740 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T10:23:39.788 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T10:23:40.235 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T10:23:40.279 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T10:23:40.385 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T10:23:40.427 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T10:23:40.491 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T10:23:41.118 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T10:23:41.164 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T10:23:41.266 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T10:23:41.291 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T10:23:42.981 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T10:23:42.981 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-04-25T10:23:42.981 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-04-25T10:23:42.981 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-04-25T10:23:42.981 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-04-25T10:23:42.981 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-04-25T10:23:42.981 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-04-25T10:23:42.981 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-04-25T10:23:42.981 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:23:43.155 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T10:23:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T10:23:43.171 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:23:43.171 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T10:23:43.171 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:23:44.101 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:23:44.137 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:23:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T10:23:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T10:23:44.767 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:23:44.767 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T10:23:44.767 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T10:23:44.767 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T10:23:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:23:44.864 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:23:44.916 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T10:23:44.992 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T10:23:45.015 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T10:23:45.016 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:23:45.016 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T10:23:45.016 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T10:23:45.016 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T10:23:45.016 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:23:45.087 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T10:23:45.087 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T10:23:45.087 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T10:23:45.087 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:23:45.133 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T10:23:45.468 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T10:23:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T10:23:45.491 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:23:45.491 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T10:23:45.491 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T10:23:45.491 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T10:23:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:23:45.598 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T10:23:45.646 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T10:23:45.710 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T10:23:45.894 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T10:23:45.944 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T10:23:46.013 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T10:23:46.101 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T10:23:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T10:23:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T10:23:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T10:23:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T10:23:46.739 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T10:23:46.769 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T10:23:46.805 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T10:23:46.870 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T10:23:46.909 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T10:23:47.937 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T10:23:47.986 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T10:23:48.949 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T10:23:48.978 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T10:23:49.080 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T10:23:49.247 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T10:23:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T10:23:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T10:23:49.294 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:23:49.295 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T10:23:49.295 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T10:23:49.295 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T10:23:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:23:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T10:23:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T10:23:49.449 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T10:23:49.496 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T10:23:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T10:23:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T10:23:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T10:23:50.481 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:23:50.481 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T10:23:50.481 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:23:50.481 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:23:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:23:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T10:23:50.547 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T10:23:50.547 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:23:50.547 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T10:23:50.547 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:23:50.593 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T10:23:50.615 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T10:23:50.615 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:23:50.615 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T10:23:50.615 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:23:50.616 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:23:50.616 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:23:50.927 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T10:23:50.949 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T10:23:50.949 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:23:50.949 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T10:23:50.949 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T10:23:50.950 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T10:23:50.950 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:23:55.206 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T10:23:55.247 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T10:23:55.288 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T10:23:55.320 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T10:23:55.348 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T10:23:55.528 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T10:23:55.577 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T10:23:55.606 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T10:23:56.227 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:23:56.271 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:23:56.290 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:23:57.119 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T10:23:57.209 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T10:23:57.250 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T10:23:57.332 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T10:23:57.363 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T10:23:57.364 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T10:23:57.448 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T10:23:57.489 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T10:23:57.489 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T10:23:57.586 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T10:23:57.653 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:23:58.819 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T10:23:58.819 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2024-04-25T10:23:58.819 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2024-04-25T10:23:58.819 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2024-04-25T10:23:58.819 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2024-04-25T10:23:58.819 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2024-04-25T10:23:58.819 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2024-04-25T10:23:58.819 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2024-04-25T10:23:58.819 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:23:59.064 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T10:23:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T10:23:59.118 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:23:59.118 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T10:23:59.118 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:00.915 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T10:24:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T10:24:01.011 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:24:01.011 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T10:24:01.011 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T10:24:01.011 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T10:24:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:01.290 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T10:24:01.364 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T10:24:01.364 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:24:01.364 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T10:24:01.364 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T10:24:01.364 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T10:24:01.364 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:01.924 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T10:24:02.009 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T10:24:02.009 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:24:02.009 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T10:24:02.009 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T10:24:02.009 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T10:24:02.009 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T10:24:02.213 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T10:24:02.295 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T10:24:02.561 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T10:24:02.630 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T10:24:02.720 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T10:24:02.827 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T10:24:03.021 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T10:24:03.070 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T10:24:03.111 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T10:24:03.143 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T10:24:03.734 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:24:03.734 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T10:24:03.734 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T10:24:03.734 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T10:24:03.734 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T10:24:03.734 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T10:24:03.734 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T10:24:03.734 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T10:24:03.735 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:24:03.735 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:24:03.735 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T10:24:03.735 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T10:24:03.735 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T10:24:03.735 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:24:03.735 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T10:24:03.735 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T10:24:03.735 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T10:24:03.735 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T10:24:03.735 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T10:24:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T10:24:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T10:24:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T10:24:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T10:24:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T10:24:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T10:24:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T10:24:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T10:24:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T10:24:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T10:24:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T10:24:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T10:24:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T10:24:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T10:24:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T10:24:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T10:24:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T10:24:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T10:24:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T10:24:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T10:24:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T10:24:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T10:24:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T10:24:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T10:24:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T10:24:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T10:24:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T10:24:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T10:24:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T10:24:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T10:24:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T10:24:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T10:24:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T10:24:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T10:24:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T10:24:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T10:24:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T10:24:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T10:24:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T10:24:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T10:24:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T10:24:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T10:24:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T10:24:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T10:24:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T10:24:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T10:24:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T10:24:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T10:24:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T10:24:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T10:24:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T10:24:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T10:24:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T10:24:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T10:24:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T10:24:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T10:24:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T10:24:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T10:24:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T10:24:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T10:24:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T10:24:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T10:24:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T10:24:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T10:24:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T10:24:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T10:24:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T10:24:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T10:24:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T10:24:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T10:24:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T10:24:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T10:24:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T10:24:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T10:24:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T10:24:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T10:24:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T10:24:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T10:24:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T10:24:03.761 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T10:24:03.788 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T10:24:03.844 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T10:24:03.956 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T10:24:03.989 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T10:24:05.350 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T10:24:05.391 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T10:24:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:24:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:05.769 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-04-25T10:24:05.769 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.770 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.771 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T10:24:05.772 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.773 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.774 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T10:24:05.774 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.774 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T10:24:05.774 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T10:24:05.774 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T10:24:05.774 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T10:24:05.774 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T10:24:05.774 INFO:teuthology.orchestra.run.smithi112.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T10:24:05.774 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T10:24:05.774 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T10:24:05.774 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T10:24:05.775 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T10:24:05.776 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T10:24:05.777 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T10:24:05.778 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T10:24:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T10:24:05.780 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T10:24:05.780 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T10:24:05.780 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T10:24:05.780 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T10:24:05.780 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T10:24:05.780 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T10:24:05.780 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T10:24:05.780 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T10:24:05.780 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T10:24:05.780 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T10:24:05.780 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T10:24:05.781 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.781 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.781 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:05.781 INFO:teuthology.orchestra.run.smithi112.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T10:24:05.781 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T10:24:05.781 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T10:24:05.781 INFO:teuthology.orchestra.run.smithi112.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T10:24:05.781 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T10:24:05.781 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T10:24:05.782 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T10:24:05.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:05.782 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T10:24:06.156 DEBUG:teuthology.parallel:result is None 2024-04-25T10:24:06.558 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T10:24:06.591 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T10:24:06.744 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T10:24:06.936 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T10:24:06.968 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T10:24:07.036 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T10:24:07.036 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:24:07.036 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T10:24:07.036 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T10:24:07.037 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T10:24:07.037 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:07.094 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T10:24:07.134 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T10:24:07.253 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T10:24:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T10:24:08.415 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T10:24:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T10:24:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T10:24:08.537 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:24:08.537 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T10:24:08.537 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:24:08.537 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:24:08.537 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:08.589 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T10:24:08.663 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T10:24:08.663 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:24:08.664 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T10:24:08.664 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:08.756 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T10:24:08.836 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T10:24:08.837 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:24:08.837 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T10:24:08.837 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:24:08.837 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:24:08.837 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:09.232 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T10:24:09.305 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T10:24:09.305 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:24:09.305 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T10:24:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T10:24:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T10:24:09.306 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:14.249 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T10:24:14.299 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T10:24:14.382 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T10:24:14.449 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T10:24:14.499 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T10:24:14.832 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T10:24:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T10:24:14.911 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T10:24:15.752 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:24:15.800 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:24:15.869 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:24:17.308 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T10:24:17.425 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T10:24:17.503 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T10:24:17.682 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T10:24:17.726 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T10:24:17.726 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T10:24:17.874 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T10:24:17.922 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T10:24:17.923 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T10:24:18.062 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T10:24:18.164 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:24:18.445 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:24:18.446 INFO:teuthology.orchestra.run.smithi019.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-25T10:24:18.446 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:23.959 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T10:24:23.959 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T10:24:23.960 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T10:24:23.961 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T10:24:23.962 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T10:24:23.962 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T10:24:23.973 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T10:24:23.973 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T10:24:23.973 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T10:24:23.973 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T10:24:23.973 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T10:24:23.973 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T10:24:23.973 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T10:24:23.973 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T10:24:23.974 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T10:24:23.975 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T10:24:23.976 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T10:24:23.977 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T10:24:23.978 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T10:24:23.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T10:24:23.980 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T10:24:23.981 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T10:24:23.982 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T10:24:23.982 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T10:24:23.982 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T10:24:23.982 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T10:24:23.982 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T10:24:23.982 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T10:24:26.484 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:24:26.484 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:26.484 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-04-25T10:24:26.484 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.484 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.484 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T10:24:26.484 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T10:24:26.484 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-04-25T10:24:26.484 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T10:24:26.484 INFO:teuthology.orchestra.run.smithi019.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:26.485 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.486 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.487 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T10:24:26.488 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T10:24:26.489 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T10:24:26.490 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T10:24:26.491 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T10:24:26.491 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T10:24:26.491 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T10:24:26.491 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T10:24:26.491 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T10:24:26.491 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T10:24:26.491 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T10:24:26.491 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T10:24:26.491 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T10:24:26.491 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T10:24:26.491 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T10:24:26.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T10:24:26.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T10:24:26.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T10:24:26.495 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T10:24:26.496 INFO:teuthology.orchestra.run.smithi019.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T10:24:26.496 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T10:24:26.496 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T10:24:26.496 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T10:24:26.496 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:26.496 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-04-25T10:24:27.064 DEBUG:teuthology.parallel:result is None 2024-04-25T10:24:27.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:24:27.220 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T10:24:27.279 INFO:teuthology.orchestra.run.smithi019.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T10:24:27.279 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T10:24:27.279 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T10:24:27.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:24:27.425 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T10:24:27.450 INFO:teuthology.orchestra.run.smithi112.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T10:24:27.451 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T10:24:27.451 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T10:24:27.453 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T10:24:27.453 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:24:27.453 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T10:24:27.529 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:24:27.529 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T10:24:27.562 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T10:24:27.563 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:24:27.563 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T10:24:27.637 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T10:24:27.747 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:24:27.747 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T10:24:27.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T10:24:27.843 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T10:24:27.844 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:24:27.844 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T10:24:27.914 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T10:24:28.037 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:24:28.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T10:24:28.061 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T10:24:28.125 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T10:24:28.125 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:24:28.125 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T10:24:28.193 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T10:24:28.307 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:24:28.308 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T10:24:28.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T10:24:28.396 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T10:24:28.485 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T10:24:28.485 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2024-04-25T10:24:28.490 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-04-25T10:24:28.557 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T10:24:28.558 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T10:24:28.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T10:24:28.628 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T10:24:28.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T10:24:28.633 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T10:24:28.701 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T10:24:28.701 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T10:24:28.701 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T10:24:28.701 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:24:28.701 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T10:24:28.743 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T10:24:28.941 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T10:24:29.004 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:24:29.004 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T10:24:29.020 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T10:24:29.124 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T10:24:29.173 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T10:24:29.173 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T10:24:29.174 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067', 'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7673067', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240425.015853-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1880, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'sleep_before_teardown': 0, 'subset': '178/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240425.015853-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKhrdBcUKRAufK275Fpz8uZqxmbtxfTsPeEw9SBMHHwumAkv6XVCXObyFYoTjmrQZK+exh8o4xtP23uK4jsyLV0=', 'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBByz/BXNq8ZDSj7ExMmCOGA67lgJA6r4W8c4vBUga7sLTj9u3X9lkn1sAPtM47kkqi86uhV4JzCLkNkqShjTexQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_10:00:23', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T10:24:29.174 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T10:24:29.180 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T10:24:29.223 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T10:24:29.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T10:24:29.329 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:24:29.330 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T10:24:29.371 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T10:24:29.371 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-04-25T10:24:29.455 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T10:24:29.455 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:24:29.455 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-04-25T10:24:29.455 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:24:29.455 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:24:29.456 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-04-25 10:24:18.893836031 +0000 2024-04-25T10:24:29.456 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-04-25 10:21:56.809306267 +0000 2024-04-25T10:24:29.456 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-04-25 10:21:56.809306267 +0000 2024-04-25T10:24:29.456 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-04-25 10:21:56.809306267 +0000 2024-04-25T10:24:29.456 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T10:24:29.559 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-04-25T10:24:29.559 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-04-25T10:24:29.559 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000359648 s, 1.4 MB/s 2024-04-25T10:24:29.562 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T10:24:29.607 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-04-25T10:24:29.690 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T10:24:29.690 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:24:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-25T10:24:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:24:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:24:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-04-25 10:24:18.895836012 +0000 2024-04-25T10:24:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-04-25 10:21:57.432300242 +0000 2024-04-25T10:24:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-04-25 10:21:57.432300242 +0000 2024-04-25T10:24:29.691 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-04-25 10:21:57.432300242 +0000 2024-04-25T10:24:29.691 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T10:24:29.803 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-04-25T10:24:29.803 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-04-25T10:24:29.803 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000330525 s, 1.5 MB/s 2024-04-25T10:24:29.806 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T10:24:29.849 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-04-25T10:24:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T10:24:29.930 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:24:29.930 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-25T10:24:29.930 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:24:29.931 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:24:29.931 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-04-25 10:24:18.895836012 +0000 2024-04-25T10:24:29.931 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-04-25 10:21:58.041294352 +0000 2024-04-25T10:24:29.931 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-04-25 10:21:58.041294352 +0000 2024-04-25T10:24:29.931 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-04-25 10:21:58.041294352 +0000 2024-04-25T10:24:29.931 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T10:24:30.038 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-04-25T10:24:30.038 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-04-25T10:24:30.038 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000313896 s, 1.6 MB/s 2024-04-25T10:24:30.042 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T10:24:30.087 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-04-25T10:24:30.165 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T10:24:30.165 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:24:30.165 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-25T10:24:30.165 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:24:30.166 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:24:30.166 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-04-25 10:24:18.897835993 +0000 2024-04-25T10:24:30.166 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-04-25 10:21:58.660288366 +0000 2024-04-25T10:24:30.166 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-04-25 10:21:58.660288366 +0000 2024-04-25T10:24:30.166 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-04-25 10:21:58.660288366 +0000 2024-04-25T10:24:30.166 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T10:24:30.265 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-04-25T10:24:30.266 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-04-25T10:24:30.266 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000265882 s, 1.9 MB/s 2024-04-25T10:24:30.269 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T10:24:30.308 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:24:30.309 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:24:30.309 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T10:24:30.328 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T10:24:30.329 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-04-25T10:24:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T10:24:30.387 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:24:30.387 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T10:24:30.387 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:24:30.387 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:24:30.387 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 10:23:58.029559317 +0000 2024-04-25T10:24:30.387 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 10:20:42.161686232 +0000 2024-04-25T10:24:30.388 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 10:20:42.161686232 +0000 2024-04-25T10:24:30.388 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 10:20:42.161686232 +0000 2024-04-25T10:24:30.388 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T10:24:30.456 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T10:24:30.456 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T10:24:30.456 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.00023654 s, 2.2 MB/s 2024-04-25T10:24:30.457 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T10:24:30.515 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-04-25T10:24:30.571 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T10:24:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:24:30.572 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T10:24:30.572 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:24:30.572 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:24:30.572 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 10:23:58.030559290 +0000 2024-04-25T10:24:30.572 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 10:20:42.500677066 +0000 2024-04-25T10:24:30.572 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 10:20:42.500677066 +0000 2024-04-25T10:24:30.572 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 10:20:42.500677066 +0000 2024-04-25T10:24:30.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T10:24:30.637 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T10:24:30.638 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T10:24:30.638 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000205424 s, 2.5 MB/s 2024-04-25T10:24:30.639 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T10:24:30.697 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-04-25T10:24:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T10:24:30.753 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:24:30.753 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T10:24:30.754 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:24:30.754 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:24:30.754 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 10:23:58.030559290 +0000 2024-04-25T10:24:30.754 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 10:20:42.866667175 +0000 2024-04-25T10:24:30.754 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 10:20:42.866667175 +0000 2024-04-25T10:24:30.754 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 10:20:42.866667175 +0000 2024-04-25T10:24:30.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T10:24:30.817 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T10:24:30.817 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T10:24:30.817 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000169361 s, 3.0 MB/s 2024-04-25T10:24:30.819 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T10:24:30.876 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-04-25T10:24:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T10:24:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:24:30.932 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T10:24:30.932 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:24:30.932 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:24:30.932 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 10:23:58.031559264 +0000 2024-04-25T10:24:30.932 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 10:20:43.197658261 +0000 2024-04-25T10:24:30.932 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 10:20:43.197658261 +0000 2024-04-25T10:24:30.932 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 10:20:43.197658261 +0000 2024-04-25T10:24:30.933 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T10:24:30.995 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T10:24:30.996 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T10:24:30.996 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000216195 s, 2.4 MB/s 2024-04-25T10:24:30.997 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T10:24:31.054 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:24:31.054 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T10:24:31.054 INFO:tasks.ceph:Generating config... 2024-04-25T10:24:31.055 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T10:24:31.055 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-25T10:24:31.056 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T10:24:31.056 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T10:24:31.056 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T10:24:31.056 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T10:24:31.056 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T10:24:31.056 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T10:24:31.056 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T10:24:31.056 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T10:24:31.056 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-25T10:24:31.056 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-25T10:24:31.056 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-25T10:24:31.056 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T10:24:31.057 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T10:24:31.058 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T10:24:31.058 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T10:24:31.058 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T10:24:31.058 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T10:24:31.058 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T10:24:31.058 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T10:24:31.058 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T10:24:31.058 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T10:24:31.058 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T10:24:31.058 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T10:24:31.058 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T10:24:31.058 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T10:24:31.058 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T10:24:31.059 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T10:24:31.059 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T10:24:31.059 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T10:24:31.059 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T10:24:31.059 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T10:24:31.059 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T10:24:31.059 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T10:24:31.059 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T10:24:31.245 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T10:24:31.260 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T10:24:31.444 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:24:31.519 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.b', '172.21.15.112'), ('mon.c', '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]')] 2024-04-25T10:24:31.519 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T10:24:31.520 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:24:31.520 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T10:24:31.561 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --add b 172.21.15.112 --addv c '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:24:31.755 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:24:31.755 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid 03c2053f-8374-429e-9fda-d77b86219935 2024-04-25T10:24:31.755 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-04-25T10:24:31.755 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2024-04-25T10:24:31.755 INFO:teuthology.orchestra.run.smithi019.stdout:fsid 03c2053f-8374-429e-9fda-d77b86219935 2024-04-25T10:24:31.756 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2024-04-25T10:24:31.754266+0000 2024-04-25T10:24:31.756 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-04-25T10:24:31.754266+0000 2024-04-25T10:24:31.756 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 17 (quincy) 2024-04-25T10:24:31.756 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2024-04-25T10:24:31.756 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-04-25T10:24:31.756 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-04-25T10:24:31.756 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] mon.c 2024-04-25T10:24:31.756 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T10:24:31.768 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T10:24:31.805 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 03c2053f-8374-429e-9fda-d77b86219935... 2024-04-25T10:24:31.806 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:24:31.850 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:24:31.897 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-04-25T10:24:31.897 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-04-25T10:24:31.897 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:24:31.897 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-04-25T10:24:31.897 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-04-25T10:24:31.898 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:24:31.899 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.19,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on skipped message = False 2024-04-25T10:24:31.900 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 03c2053f-8374-429e-9fda-d77b86219935 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-04-25T10:24:31.901 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-04-25T10:24:31.902 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: osd blocked scrub grace period = 3600 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: osd max markdown count = 1000 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-04-25T10:24:31.903 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-04-25T10:24:31.904 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:24:31.905 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-04-25T10:24:31.906 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout: client_shutdown_timeout = 120 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.e] 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-04-25T10:24:31.907 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.f] 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal fragment size max = 10000 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal merge size = 5 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal split bits = 3 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal split size = 100 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: mds oft prefetch dirfrags = True 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: mds_dir_prefetch = True 2024-04-25T10:24:31.908 INFO:teuthology.orchestra.run.smithi112.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T10:24:31.909 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-04-25T10:24:31.909 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-04-25T10:24:31.909 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-04-25T10:24:31.952 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-04-25T10:24:31.952 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:24:31.953 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2024-04-25T10:24:31.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on skipped message = False 2024-04-25T10:24:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = 03c2053f-8374-429e-9fda-d77b86219935 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2024-04-25T10:24:31.956 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug trim objects = true 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2024-04-25T10:24:31.957 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 20 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 20 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 10 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: osd blocked scrub grace period = 3600 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: osd max markdown count = 1000 2024-04-25T10:24:31.958 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2024-04-25T10:24:31.959 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2024-04-25T10:24:31.959 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.959 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2024-04-25T10:24:31.959 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-04-25T10:24:31.959 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2024-04-25T10:24:31.959 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-04-25T10:24:31.959 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-04-25T10:24:31.959 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:24:31.959 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:24:31.959 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2024-04-25T10:24:31.959 INFO:teuthology.orchestra.run.smithi019.stdout: debug client = 20 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.960 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: mon down mkfs grace = 300 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: mon op complaint time = 120 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2024-04-25T10:24:31.961 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout: client mount timeout = 600 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout: client_shutdown_timeout = 120 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout: debug client = 20 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2024-04-25T10:24:31.962 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.e] 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.f] 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout:[mds] 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds = 20 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds balancer = 20 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout: mds bal fragment size max = 10000 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout: mds bal merge size = 5 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout: mds bal split bits = 3 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout: mds bal split size = 100 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug frag = True 2024-04-25T10:24:31.963 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug scatterstat = True 2024-04-25T10:24:31.964 INFO:teuthology.orchestra.run.smithi019.stdout: mds oft prefetch dirfrags = True 2024-04-25T10:24:31.964 INFO:teuthology.orchestra.run.smithi019.stdout: mds op complaint time = 180 2024-04-25T10:24:31.964 INFO:teuthology.orchestra.run.smithi019.stdout: mds verify scatter = True 2024-04-25T10:24:31.964 INFO:teuthology.orchestra.run.smithi019.stdout: mds_dir_prefetch = True 2024-04-25T10:24:31.964 INFO:teuthology.orchestra.run.smithi019.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T10:24:31.964 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2024-04-25T10:24:31.964 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2024-04-25T10:24:31.964 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2024-04-25T10:24:31.980 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T10:24:31.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T10:24:32.181 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T10:24:32.181 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:24:32.181 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T10:24:32.219 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:24:32.219 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T10:24:32.296 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:24:32.297 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:24:32.297 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T10:24:32.297 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:24:32.433 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:24:32.433 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:24:32.518 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T10:24:32.518 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:24:32.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T10:24:32.519 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:24:32.557 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:24:32.557 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:24:32.614 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T10:24:32.614 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T10:24:32.614 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T10:24:32.801 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T10:24:32.814 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T10:24:32.884 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T10:24:32.890 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T10:24:32.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T10:24:33.089 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T10:24:33.101 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T10:24:33.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T10:24:33.361 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T10:24:33.373 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T10:24:33.437 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T10:24:33.631 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T10:24:33.643 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-25T10:24:33.705 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T10:24:33.772 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T10:24:33.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T10:24:33.799 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T10:24:33.898 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T10:24:33.901 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T10:24:33.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T10:24:34.022 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T10:24:34.025 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-25T10:24:34.047 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T10:24:34.048 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T10:24:34.221 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T10:24:34.274 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T10:24:34.274 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T10:24:34.275 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T10:24:34.361 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:24:34.361 INFO:tasks.ceph:role: osd.0 2024-04-25T10:24:34.361 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:24:34.361 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T10:24:34.451 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:24:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:24:34.451 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:24:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:24:34.452 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:24:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:24:34.452 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:24:34.452 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:24:34.452 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:24:34.452 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:24:34.863 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-04-25T10:24:34.870 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-04-25T10:24:34.870 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T10:24:35.016 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T10:24:35.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T10:24:35.187 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:24:35.188 INFO:tasks.ceph:role: osd.1 2024-04-25T10:24:35.188 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:24:35.188 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T10:24:35.269 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:24:35.269 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:24:35.269 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:24:35.269 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:24:35.269 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:24:35.269 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:24:35.269 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:24:35.269 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:24:35.269 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:24:35.269 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:24:35.624 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-04-25T10:24:35.630 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-04-25T10:24:35.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T10:24:35.757 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T10:24:35.834 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T10:24:35.909 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:24:35.909 INFO:tasks.ceph:role: osd.2 2024-04-25T10:24:35.909 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:24:35.910 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T10:24:35.996 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:24:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:24:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:24:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:24:35.996 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:24:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:24:35.996 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:24:35.996 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:24:35.996 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:24:35.996 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:24:36.381 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-04-25T10:24:36.389 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-04-25T10:24:36.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T10:24:36.521 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T10:24:36.601 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T10:24:36.671 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:24:36.671 INFO:tasks.ceph:role: osd.3 2024-04-25T10:24:36.672 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:24:36.672 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T10:24:36.802 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:24:36.803 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:24:36.803 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:24:36.803 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:24:36.803 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:24:36.803 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:24:36.803 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:24:36.803 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:24:36.803 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:24:36.803 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:24:37.213 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-04-25T10:24:37.219 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-04-25T10:24:37.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T10:24:37.399 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T10:24:37.489 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:24:37.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:37.708+0000 7f7c5761c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T10:24:37.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:37.708+0000 7f7c5761c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T10:24:37.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:37.708+0000 7f7c5761c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:24:37.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:37.708+0000 7f7c5761c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:24:37.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:37.708+0000 7f7c5761c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:24:37.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:37.712+0000 7f7c5761c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T10:24:40.727 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T10:24:40.817 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:24:41.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:41.014+0000 7f5d36c11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T10:24:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:41.014+0000 7f5d36c11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T10:24:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:41.014+0000 7f5d36c11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:24:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:41.015+0000 7f5d36c11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:24:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:41.015+0000 7f5d36c11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:24:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:41.017+0000 7f5d36c11640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T10:24:44.248 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T10:24:44.335 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:24:44.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:44.545+0000 7fcc047cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T10:24:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:44.546+0000 7fcc047cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T10:24:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:44.546+0000 7fcc047cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:24:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:44.546+0000 7fcc047cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:24:44.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:44.546+0000 7fcc047cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:24:44.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:44.548+0000 7fcc047cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T10:24:47.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T10:24:47.882 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:24:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:48.087+0000 7f528c7fc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T10:24:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:48.087+0000 7f528c7fc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T10:24:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:48.087+0000 7f528c7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:24:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:48.087+0000 7f528c7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:24:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:48.087+0000 7f528c7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:24:48.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:24:48.090+0000 7f528c7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T10:24:51.083 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T10:24:51.172 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T10:24:51.201 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:24:51.201 INFO:tasks.ceph:role: osd.4 2024-04-25T10:24:51.201 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T10:24:51.201 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T10:24:51.276 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:24:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:24:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:24:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:24:51.276 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:24:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:24:51.276 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:24:51.276 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:24:51.276 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:24:51.276 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:24:51.784 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-25T10:24:51.786 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-25T10:24:51.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T10:24:51.922 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T10:24:51.954 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T10:24:52.020 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:24:52.020 INFO:tasks.ceph:role: osd.5 2024-04-25T10:24:52.020 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T10:24:52.020 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T10:24:52.093 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:24:52.093 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:24:52.093 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:24:52.093 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:24:52.093 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:24:52.093 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:24:52.093 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:24:52.093 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:24:52.093 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:24:52.093 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:24:52.547 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-25T10:24:52.549 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-25T10:24:52.549 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T10:24:52.646 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T10:24:52.673 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T10:24:52.737 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:24:52.737 INFO:tasks.ceph:role: osd.6 2024-04-25T10:24:52.737 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T10:24:52.737 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T10:24:52.807 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:24:52.808 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:24:52.808 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:24:52.808 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:24:52.808 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:24:52.808 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:24:52.808 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:24:52.808 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:24:52.808 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:24:52.808 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:24:53.291 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-25T10:24:53.293 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-25T10:24:53.293 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T10:24:53.436 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T10:24:53.465 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T10:24:53.529 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:24:53.529 INFO:tasks.ceph:role: osd.7 2024-04-25T10:24:53.529 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T10:24:53.529 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T10:24:53.599 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:24:53.599 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:24:53.600 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:24:53.600 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:24:53.600 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:24:53.600 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:24:53.600 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:24:53.600 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:24:53.600 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:24:53.600 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:24:54.134 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-25T10:24:54.135 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-25T10:24:54.136 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T10:24:54.274 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T10:24:54.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:24:54.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:54.412+0000 7fc32429d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T10:24:54.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:54.412+0000 7fc32429d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T10:24:54.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:54.412+0000 7fc32429d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:24:54.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:54.412+0000 7fc32429d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:24:54.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:54.412+0000 7fc32429d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:24:54.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:54.413+0000 7fc32429d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T10:24:57.256 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T10:24:57.280 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:24:57.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:57.372+0000 7fe432a0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T10:24:57.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:57.373+0000 7fe432a0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T10:24:57.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:57.373+0000 7fe432a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:24:57.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:57.373+0000 7fe432a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:24:57.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:57.373+0000 7fe432a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:24:57.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:24:57.373+0000 7fe432a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T10:24:59.176 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:24:59.184 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:25:00.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T10:25:00.262 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:25:00.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:00.359+0000 7f2df4810640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T10:25:00.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:00.360+0000 7f2df4810640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T10:25:00.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:00.360+0000 7f2df4810640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:25:00.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:00.360+0000 7f2df4810640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:25:00.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:00.360+0000 7f2df4810640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:25:00.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:00.360+0000 7f2df4810640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T10:25:03.226 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T10:25:03.254 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:25:03.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:03.354+0000 7f1ab3714640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T10:25:03.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:03.355+0000 7f1ab3714640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T10:25:03.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:03.355+0000 7f1ab3714640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:25:03.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:03.355+0000 7f1ab3714640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:25:03.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:03.355+0000 7f1ab3714640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:25:03.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:03.355+0000 7f1ab3714640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T10:25:06.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T10:25:06.242 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T10:25:06.242 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:06.242 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T10:25:06.342 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:06.342 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T10:25:06.433 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:06.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T10:25:06.523 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:06.523 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-25T10:25:06.617 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:06.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T10:25:06.694 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:06.695 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T10:25:06.781 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:06.781 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T10:25:06.915 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:06.915 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T10:25:07.004 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:07.004 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T10:25:07.032 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:07.032 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T10:25:07.100 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:07.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T10:25:07.168 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:07.168 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-25T10:25:07.234 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:07.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T10:25:07.301 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:07.301 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T10:25:07.367 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:07.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T10:25:07.432 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:07.432 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T10:25:07.496 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:07.496 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T10:25:07.556 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T10:25:07.556 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T10:25:07.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T10:25:07.583 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBgLypmPD64LxAAwem5Q/kAasaYHkWaShqTyQ== 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBhLypmtINIBRAAHFjq5rshRg9F6EZQCFT4Tw== 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBhLypmtqx/FRAA/pV3MfzPHyYIusSSyoqjAw== 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.e] 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBhLypmttSTJRAAstQPNX2xk4DDOku29n6OkQ== 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBlLypmOmhMKhAAApphI6IGdvRIgZBXPIyVFA== 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBpLypmg7btABAAHm/EcRZmv6StdlpQ2SpxqA== 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2024-04-25T10:25:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBsLypmlbWcIBAAVPXdTutH+SuYqIAd8AWEXg== 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBwLypmh8ZJBRAAYF1OyWqkDsRhWImkBGRAfA== 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBgLypm4UmmNBAAEPO1QRgdLy26pA1UFLhuUQ== 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBhLypm/dz4LRAAnFw+kVfnaOMk+UIICiCOpQ== 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBhLypmzxx1NRAAHH2Vpi7ArBcp2AMeYYm5oA== 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.f] 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBiLypmEwRAARAAWzic1CyDE+Nj+HnP85/kRg== 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB2LypmPaiaGBAAFVtcvz+gPGGN8pyrWfVUJQ== 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB5LypmGCtNFhAAUROim5+f+G4tJFFSzt2LRw== 2024-04-25T10:25:07.585 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2024-04-25T10:25:07.586 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB8LypmxzmFFRAAQmfwfHZ1r2ymaLLxK4IRuw== 2024-04-25T10:25:07.586 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2024-04-25T10:25:07.586 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB/LypmOaw4FRAAOteiCPc8z10O3K4r7BnEbg== 2024-04-25T10:25:07.586 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-04-25T10:25:07.586 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBiLypmagkkDRAAytfd+MbM+CqeO3bTY7BtbA== 2024-04-25T10:25:07.636 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2024-04-25T10:25:07.636 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBgLypmPD64LxAAwem5Q/kAasaYHkWaShqTyQ== 2024-04-25T10:25:07.636 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-04-25T10:25:07.636 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBhLypmtINIBRAAHFjq5rshRg9F6EZQCFT4Tw== 2024-04-25T10:25:07.636 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2024-04-25T10:25:07.636 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBhLypmtqx/FRAA/pV3MfzPHyYIusSSyoqjAw== 2024-04-25T10:25:07.636 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.e] 2024-04-25T10:25:07.636 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBhLypmttSTJRAAstQPNX2xk4DDOku29n6OkQ== 2024-04-25T10:25:07.636 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2024-04-25T10:25:07.636 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBlLypmOmhMKhAAApphI6IGdvRIgZBXPIyVFA== 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBpLypmg7btABAAHm/EcRZmv6StdlpQ2SpxqA== 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBsLypmlbWcIBAAVPXdTutH+SuYqIAd8AWEXg== 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBwLypmh8ZJBRAAYF1OyWqkDsRhWImkBGRAfA== 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBgLypm4UmmNBAAEPO1QRgdLy26pA1UFLhuUQ== 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBhLypm/dz4LRAAnFw+kVfnaOMk+UIICiCOpQ== 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBhLypmzxx1NRAAHH2Vpi7ArBcp2AMeYYm5oA== 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.f] 2024-04-25T10:25:07.637 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBiLypmEwRAARAAWzic1CyDE+Nj+HnP85/kRg== 2024-04-25T10:25:07.638 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.4] 2024-04-25T10:25:07.638 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQB2LypmPaiaGBAAFVtcvz+gPGGN8pyrWfVUJQ== 2024-04-25T10:25:07.638 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.5] 2024-04-25T10:25:07.638 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQB5LypmGCtNFhAAUROim5+f+G4tJFFSzt2LRw== 2024-04-25T10:25:07.638 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.6] 2024-04-25T10:25:07.638 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQB8LypmxzmFFRAAQmfwfHZ1r2ymaLLxK4IRuw== 2024-04-25T10:25:07.638 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.7] 2024-04-25T10:25:07.638 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQB/LypmOaw4FRAAOteiCPc8z10O3K4r7BnEbg== 2024-04-25T10:25:07.638 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-04-25T10:25:07.638 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBiLypmagkkDRAAytfd+MbM+CqeO3bTY7BtbA== 2024-04-25T10:25:07.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:25:07.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:25:07.906 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:07.913 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:08.125 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:08.132 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:08.345 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:08.353 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:08.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:08.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:08.775 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:08.782 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:08.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:09.001 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:09.215 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:09.223 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:09.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:25:09.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:25:09.651 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:09.658 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:09.867 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:09.872 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:10.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:10.093 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:25:10.309 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:10.314 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:10.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:10.530 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:10.714 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:10.720 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:10.914 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:10.919 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:25:11.100 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:25:11.107 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:25:11.306 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T10:25:11.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T10:25:11.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:25:11.628 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T10:25:11.707 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T10:25:11.731 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:25:11.837 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T10:25:11.860 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T10:25:11.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:25:12.031 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T10:25:12.054 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:25:12.062 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:25:12.114 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T10:25:12.114 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T10:25:12.114 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T10:25:12.121 INFO:tasks.ceph.mon.a:Started 2024-04-25T10:25:12.121 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T10:25:12.122 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T10:25:12.150 INFO:tasks.ceph.mon.b:Started 2024-04-25T10:25:12.150 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T10:25:12.151 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T10:25:12.152 INFO:tasks.ceph.mon.c:Started 2024-04-25T10:25:12.152 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T10:25:12.153 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T10:25:12.153 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T10:25:12.158 INFO:tasks.ceph.mgr.y:Started 2024-04-25T10:25:12.158 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T10:25:12.158 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T10:25:12.160 INFO:tasks.ceph.mgr.x:Started 2024-04-25T10:25:12.160 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T10:25:12.160 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T10:25:12.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.406+0000 7f6ad6800640 1 Processor -- start 2024-04-25T10:25:12.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.406+0000 7f6ad6800640 1 -- start start 2024-04-25T10:25:12.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad6800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 0x7f6ad00b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:12.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad6800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad015f6d0 con 0x7f6ad015ff40 2024-04-25T10:25:12.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad6800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad015d2f0 con 0x7f6ad0156770 2024-04-25T10:25:12.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad6800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad00b76d0 con 0x7f6ad00ccfb0 2024-04-25T10:25:12.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad5400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 0x7f6ad00b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:12.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad5400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 0x7f6ad00b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:39272/0 (socket says 172.21.15.19:39272) 2024-04-25T10:25:12.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad5400640 1 -- 172.21.15.19:0/2877184520 learned_addr learned my addr 172.21.15.19:0/2877184520 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:12.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad4a00640 1 --1- 172.21.15.19:0/2877184520 >> v1:172.21.15.112:6789/0 conn(0x7f6ad0156770 0x7f6ad00cd5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:35704/0 (socket says 172.21.15.19:35704) 2024-04-25T10:25:12.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad5400640 1 -- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 msgr2=0x7f6ad00b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:25:12.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad5400640 1 -- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 msgr2=0x7f6ad00b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:25:12.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad5400640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 0x7f6ad00b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:25:12.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.409+0000 7f6ad5400640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 0x7f6ad00b7190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:25:12.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.411+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499130425 0 0) 0x7f6ad015f6d0 con 0x7f6ad015ff40 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.411+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab8003520 con 0x7f6ad015ff40 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.411+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566217845 0 0) 0x7f6ad015d2f0 con 0x7f6ad0156770 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.411+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad015f6d0 con 0x7f6ad0156770 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.411+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 <== mon.1 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1479563304 0 0) 0x7f6ad015f6d0 con 0x7f6ad0156770 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.411+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 msgr2=0x7f6ad00b7190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.411+0000 7f6acfe00640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 0x7f6ad00b7190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.411+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 >> v1:172.21.15.19:6789/0 conn(0x7f6ad015ff40 legacy=0x7f6ad0160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.411+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad015c7b0 con 0x7f6ad0156770 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.411+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 <== mon.1 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2140478945 0 0) 0x7f6abc001670 con 0x7f6ad0156770 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.411+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 >> v1:172.21.15.112:6789/0 conn(0x7f6ad0156770 legacy=0x7f6ad00cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.412+0000 7f6acfe00640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab8004ba0 0x7f6ab8004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:12.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.412+0000 7f6acfe00640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 0x7f6ab80037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:12.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.412+0000 7f6acfe00640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ab8003ce0 0x7f6ab80041b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:12.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.412+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad00b76d0 con 0x7f6ab8003ce0 2024-04-25T10:25:12.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.412+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab800bbf0 con 0x7f6ab8004ba0 2024-04-25T10:25:12.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.412+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab800bdf0 con 0x7f6ad00ccfb0 2024-04-25T10:25:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.412+0000 7f6ad5400640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab8004ba0 0x7f6ab8004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.413+0000 7f6ad5400640 1 -- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 msgr2=0x7f6ab80037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.413+0000 7f6ad4a00640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 0x7f6ab80037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.413+0000 7f6ad5400640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 0x7f6ab80037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.413+0000 7f6ad5400640 1 -- 172.21.15.19:0/2877184520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ab8003ce0 msgr2=0x7f6ab80041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.413+0000 7f6ad5e00640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ab8003ce0 0x7f6ab80041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.413+0000 7f6ad5400640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ab8003ce0 0x7f6ab80041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.413+0000 7f6ad5400640 1 -- 172.21.15.19:0/2877184520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad015f6d0 con 0x7f6ab8004ba0 2024-04-25T10:25:12.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.413+0000 7f6ad5e00640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ab8003ce0 0x7f6ab80041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:25:12.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.413+0000 7f6ad4a00640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ad00ccfb0 0x7f6ab80037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:25:12.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.414+0000 7f6ad5400640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab8004ba0 0x7f6ab8004ff0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009890 tx=0x7f6ab8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f040b1ac8dacabe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:12.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.414+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4037070 con 0x7f6ab8004ba0 2024-04-25T10:25:12.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.414+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac402ace0 con 0x7f6ab8004ba0 2024-04-25T10:25:12.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.414+0000 7f6acfe00640 1 -- 172.21.15.19:0/2877184520 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400f040 con 0x7f6ab8004ba0 2024-04-25T10:25:12.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.415+0000 7f6ad6800640 1 -- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab8004ba0 msgr2=0x7f6ab8004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:12.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.415+0000 7f6ad6800640 1 --2- 172.21.15.19:0/2877184520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ab8004ba0 0x7f6ab8004ff0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009890 tx=0x7f6ab8005830 comp rx=0 tx=0).stop 2024-04-25T10:25:12.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.415+0000 7f6ad5e00640 1 -- 172.21.15.19:0/2877184520 reap_dead start 2024-04-25T10:25:12.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.415+0000 7f6ad6800640 1 -- 172.21.15.19:0/2877184520 shutdown_connections 2024-04-25T10:25:12.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.415+0000 7f6ad6800640 1 -- 172.21.15.19:0/2877184520 >> 172.21.15.19:0/2877184520 conn(0x7f6ad0068880 msgr2=0x7f6ad0068c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:12.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.416+0000 7f6ad6800640 1 -- 172.21.15.19:0/2877184520 shutdown_connections 2024-04-25T10:25:12.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.416+0000 7f6ad6800640 1 -- 172.21.15.19:0/2877184520 wait complete. 2024-04-25T10:25:12.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.419+0000 7f6ad6800640 1 Processor -- start 2024-04-25T10:25:12.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.419+0000 7f6ad6800640 1 -- start start 2024-04-25T10:25:12.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.421+0000 7f6ad6800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab8004ba0 0x7f6ad01f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ad01e5270 0x7f6ad00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad6800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ad015e090 0x7f6ad0157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad6800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad015d010 con 0x7f6ad015e090 2024-04-25T10:25:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad6800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad015cd30 con 0x7f6ad01e5270 2024-04-25T10:25:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad6800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad015fa20 con 0x7f6ab8004ba0 2024-04-25T10:25:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad5400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab8004ba0 0x7f6ad01f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ad01e5270 0x7f6ad00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad5400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab8004ba0 0x7f6ad01f63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:39302/0 (socket says 172.21.15.19:39302) 2024-04-25T10:25:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad5400640 1 -- 172.21.15.19:0/1536589179 learned_addr learned my addr 172.21.15.19:0/1536589179 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:12.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad5e00640 1 --2- 172.21.15.19:0/1536589179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ad015e090 0x7f6ad0157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:12.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad5400640 1 -- 172.21.15.19:0/1536589179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ad01e5270 msgr2=0x7f6ad00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:12.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad5400640 1 --2- 172.21.15.19:0/1536589179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ad01e5270 0x7f6ad00d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad5400640 1 -- 172.21.15.19:0/1536589179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ad015e090 msgr2=0x7f6ad0157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.422+0000 7f6ad5400640 1 --2- 172.21.15.19:0/1536589179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ad015e090 0x7f6ad0157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.423+0000 7f6ad5400640 1 -- 172.21.15.19:0/1536589179 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad00d1a10 con 0x7f6ab8004ba0 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.423+0000 7f6ad4a00640 1 --2- 172.21.15.19:0/1536589179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ad01e5270 0x7f6ad00d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.423+0000 7f6ad5400640 1 --2- 172.21.15.19:0/1536589179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab8004ba0 0x7f6ad01f63a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6ac402a7d0 tx=0x7f6ac4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.423+0000 7f6acd600640 1 -- 172.21.15.19:0/1536589179 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4042020 con 0x7f6ab8004ba0 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.423+0000 7f6acd600640 1 -- 172.21.15.19:0/1536589179 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac400f000 con 0x7f6ab8004ba0 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.423+0000 7f6acd600640 1 -- 172.21.15.19:0/1536589179 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4037040 con 0x7f6ab8004ba0 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.423+0000 7f6ad6800640 1 -- 172.21.15.19:0/1536589179 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad0159910 con 0x7f6ab8004ba0 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.423+0000 7f6ad6800640 1 -- 172.21.15.19:0/1536589179 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad00d0cd0 con 0x7f6ab8004ba0 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.424+0000 7f6acd600640 1 -- 172.21.15.19:0/1536589179 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ac4045020 con 0x7f6ab8004ba0 2024-04-25T10:25:12.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.424+0000 7f6acd600640 1 -- 172.21.15.19:0/1536589179 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6ac403eb20 con 0x7f6ab8004ba0 2024-04-25T10:25:12.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.425+0000 7f6ad6800640 1 -- 172.21.15.19:0/1536589179 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad0076520 con 0x7f6ab8004ba0 2024-04-25T10:25:12.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.427+0000 7f6acd600640 1 -- 172.21.15.19:0/1536589179 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6ac404c030 con 0x7f6ab8004ba0 2024-04-25T10:25:12.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.501+0000 7f6ad6800640 1 -- 172.21.15.19:0/1536589179 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f6ad00ccd90 con 0x7f6ab8004ba0 2024-04-25T10:25:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.506+0000 7f6acd600640 1 -- 172.21.15.19:0/1536589179 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f6ac403ed20 con 0x7f6ab8004ba0 2024-04-25T10:25:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-04-25T10:25:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.507+0000 7f6ad6800640 1 -- 172.21.15.19:0/1536589179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab8004ba0 msgr2=0x7f6ad01f63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.507+0000 7f6ad6800640 1 --2- 172.21.15.19:0/1536589179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab8004ba0 0x7f6ad01f63a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6ac402a7d0 tx=0x7f6ac4004730 comp rx=0 tx=0).stop 2024-04-25T10:25:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.507+0000 7f6ad6800640 1 -- 172.21.15.19:0/1536589179 shutdown_connections 2024-04-25T10:25:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.507+0000 7f6ad6800640 1 --2- 172.21.15.19:0/1536589179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ad015e090 0x7f6ad0157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.507+0000 7f6ad6800640 1 --2- 172.21.15.19:0/1536589179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ad01e5270 0x7f6ad00d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.507+0000 7f6ad6800640 1 --2- 172.21.15.19:0/1536589179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ab8004ba0 0x7f6ad01f63a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.507+0000 7f6ad6800640 1 -- 172.21.15.19:0/1536589179 >> 172.21.15.19:0/1536589179 conn(0x7f6ad0068880 msgr2=0x7f6ad00c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.507+0000 7f6ad6800640 1 -- 172.21.15.19:0/1536589179 shutdown_connections 2024-04-25T10:25:12.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:12.507+0000 7f6ad6800640 1 -- 172.21.15.19:0/1536589179 wait complete. 2024-04-25T10:25:12.535 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T10:25:12.535 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T10:25:12.536 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:12.536 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T10:25:12.549 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:12.547+0000 7fcca35ee040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T10:25:12.561 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:12.559+0000 7f790ee19040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T10:25:12.607 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:12.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T10:25:12.693 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:12.691+0000 7fcca35ee040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:25:12.725 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:12.725 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T10:25:12.745 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:12.743+0000 7fcca35ee040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T10:25:12.752 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:12.751+0000 7f790ee19040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:25:12.802 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:12.802 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T10:25:12.818 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:12.816+0000 7f790ee19040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T10:25:12.892 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:12.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T10:25:12.916 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:12.916 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T10:25:12.981 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:12.981 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T10:25:12.991 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:12.989+0000 7fcca35ee040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T10:25:13.014 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T10:25:13.014 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T10:25:13.039 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:13.037+0000 7fcca35ee040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T10:25:13.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new c6023414-347e-4b8d-b8d1-262e4ab0c784 0 2024-04-25T10:25:13.117 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:13.115+0000 7f790ee19040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T10:25:13.173 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:13.172+0000 7f790ee19040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T10:25:13.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.207+0000 7f50ff5a8640 1 Processor -- start 2024-04-25T10:25:13.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.208+0000 7f50ff5a8640 1 -- start start 2024-04-25T10:25:13.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.209+0000 7f50ff5a8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50f80c9df0 0x7f50f8156900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.209+0000 7f50ff5a8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f80c53d0 con 0x7f50f80ca2d0 2024-04-25T10:25:13.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.209+0000 7f50ff5a8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f8074b60 con 0x7f50f8160510 2024-04-25T10:25:13.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.209+0000 7f50ff5a8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f50f80c90c0 con 0x7f50f80c9df0 2024-04-25T10:25:13.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.209+0000 7f50fd344640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50f80c9df0 0x7f50f8156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.209+0000 7f50fd344640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50f80c9df0 0x7f50f8156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55982/0 (socket says 172.21.15.112:55982) 2024-04-25T10:25:13.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.209+0000 7f50fd344640 1 -- 172.21.15.112:0/3627844096 learned_addr learned my addr 172.21.15.112:0/3627844096 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:13.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.209+0000 7f50fd344640 1 -- 172.21.15.112:0/3627844096 >> v1:172.21.15.112:6789/0 conn(0x7f50f8160510 legacy=0x7f50f80739f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.209+0000 7f50fd344640 1 -- 172.21.15.112:0/3627844096 >> v1:172.21.15.19:6789/0 conn(0x7f50f80ca2d0 legacy=0x7f50f80c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:13.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.209+0000 7f50fd344640 1 -- 172.21.15.112:0/3627844096 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f80c5690 con 0x7f50f80c9df0 2024-04-25T10:25:13.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.210+0000 7f50fd344640 1 --2- 172.21.15.112:0/3627844096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f80c9df0 0x7f50f8156900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009870 tx=0x7f50e802a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd39cba8e5efbcda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:13.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.210+0000 7f50effff640 1 -- 172.21.15.112:0/3627844096 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8037070 con 0x7f50f80c9df0 2024-04-25T10:25:13.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.210+0000 7f50effff640 1 -- 172.21.15.112:0/3627844096 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e8032640 con 0x7f50f80c9df0 2024-04-25T10:25:13.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.210+0000 7f50effff640 1 -- 172.21.15.112:0/3627844096 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8032a10 con 0x7f50f80c9df0 2024-04-25T10:25:13.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.211+0000 7f50ff5a8640 1 -- 172.21.15.112:0/3627844096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f80c9df0 msgr2=0x7f50f8156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.211+0000 7f50ff5a8640 1 --2- 172.21.15.112:0/3627844096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f80c9df0 0x7f50f8156900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009870 tx=0x7f50e802a330 comp rx=0 tx=0).stop 2024-04-25T10:25:13.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.211+0000 7f50ff5a8640 1 -- 172.21.15.112:0/3627844096 shutdown_connections 2024-04-25T10:25:13.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.211+0000 7f50ff5a8640 1 --2- 172.21.15.112:0/3627844096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f80c9df0 0x7f50f8156900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.211+0000 7f50ff5a8640 1 -- 172.21.15.112:0/3627844096 >> 172.21.15.112:0/3627844096 conn(0x7f50f80cded0 msgr2=0x7f50f80ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:13.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.211+0000 7f50ff5a8640 1 -- 172.21.15.112:0/3627844096 shutdown_connections 2024-04-25T10:25:13.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.211+0000 7f50ff5a8640 1 -- 172.21.15.112:0/3627844096 wait complete. 2024-04-25T10:25:13.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.213+0000 7f50ff5a8640 1 Processor -- start 2024-04-25T10:25:13.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.213+0000 7f50ff5a8640 1 -- start start 2024-04-25T10:25:13.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50ff5a8640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50f80c9df0 0x7f50f81e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50ff5a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50f80ca2d0 0x7f50f81486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50ff5a8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f8160510 0x7f50f8148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50ff5a8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f50f80c95f0 con 0x7f50f80ca2d0 2024-04-25T10:25:13.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50ff5a8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f50f80c9310 con 0x7f50f8160510 2024-04-25T10:25:13.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50ff5a8640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f50f80c98d0 con 0x7f50f80c9df0 2024-04-25T10:25:13.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50fdb45640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f8160510 0x7f50f8148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50fdb45640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f8160510 0x7f50f8148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55992/0 (socket says 172.21.15.112:55992) 2024-04-25T10:25:13.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50fd344640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50f80c9df0 0x7f50f81e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50fdb45640 1 -- 172.21.15.112:0/1410680896 learned_addr learned my addr 172.21.15.112:0/1410680896 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50fdb45640 1 -- 172.21.15.112:0/1410680896 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50f80c9df0 msgr2=0x7f50f81e76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50fdb45640 1 --2- 172.21.15.112:0/1410680896 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50f80c9df0 0x7f50f81e76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50fdb45640 1 -- 172.21.15.112:0/1410680896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50f80ca2d0 msgr2=0x7f50f81486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50fdb45640 1 --2- 172.21.15.112:0/1410680896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50f80ca2d0 0x7f50f81486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.214+0000 7f50fdb45640 1 -- 172.21.15.112:0/1410680896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f81e7c10 con 0x7f50f8160510 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.215+0000 7f50fdb45640 1 --2- 172.21.15.112:0/1410680896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f8160510 0x7f50f8148bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50f000c6e0 tx=0x7f50f000cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.215+0000 7f50edffb640 1 -- 172.21.15.112:0/1410680896 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0003b70 con 0x7f50f8160510 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.215+0000 7f50edffb640 1 -- 172.21.15.112:0/1410680896 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f0003d10 con 0x7f50f8160510 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.215+0000 7f50ff5a8640 1 -- 172.21.15.112:0/1410680896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f81e6c30 con 0x7f50f8160510 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.215+0000 7f50edffb640 1 -- 172.21.15.112:0/1410680896 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0005310 con 0x7f50f8160510 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.215+0000 7f50ff5a8640 1 -- 172.21.15.112:0/1410680896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f8151d80 con 0x7f50f8160510 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.215+0000 7f50edffb640 1 -- 172.21.15.112:0/1410680896 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f50f00054b0 con 0x7f50f8160510 2024-04-25T10:25:13.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.215+0000 7f50edffb640 1 -- 172.21.15.112:0/1410680896 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f50f0012830 con 0x7f50f8160510 2024-04-25T10:25:13.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.216+0000 7f50ff5a8640 1 -- 172.21.15.112:0/1410680896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f8076520 con 0x7f50f8160510 2024-04-25T10:25:13.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.218+0000 7f50edffb640 1 -- 172.21.15.112:0/1410680896 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f50f0012a80 con 0x7f50f8160510 2024-04-25T10:25:13.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.288+0000 7f50ff5a8640 1 -- 172.21.15.112:0/1410680896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c6023414-347e-4b8d-b8d1-262e4ab0c784", "id": 0} v 0) -- 0x7f50f80c8c90 con 0x7f50f8160510 2024-04-25T10:25:13.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.294+0000 7f50edffb640 1 -- 172.21.15.112:0/1410680896 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6023414-347e-4b8d-b8d1-262e4ab0c784", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f50f0012c60 con 0x7f50f8160510 2024-04-25T10:25:13.297 INFO:teuthology.orchestra.run.smithi112.stdout:0 2024-04-25T10:25:13.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.295+0000 7f50ff5a8640 1 -- 172.21.15.112:0/1410680896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f8160510 msgr2=0x7f50f8148bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.295+0000 7f50ff5a8640 1 --2- 172.21.15.112:0/1410680896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f8160510 0x7f50f8148bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50f000c6e0 tx=0x7f50f000cba0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.295+0000 7f50ff5a8640 1 -- 172.21.15.112:0/1410680896 shutdown_connections 2024-04-25T10:25:13.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.295+0000 7f50ff5a8640 1 --2- 172.21.15.112:0/1410680896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50f8160510 0x7f50f8148bf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.295+0000 7f50ff5a8640 1 --2- 172.21.15.112:0/1410680896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50f80ca2d0 0x7f50f81486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.295+0000 7f50ff5a8640 1 --2- 172.21.15.112:0/1410680896 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f50f80c9df0 0x7f50f81e76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.295+0000 7f50ff5a8640 1 -- 172.21.15.112:0/1410680896 >> 172.21.15.112:0/1410680896 conn(0x7f50f80cded0 msgr2=0x7f50f80ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:13.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.295+0000 7f50ff5a8640 1 -- 172.21.15.112:0/1410680896 shutdown_connections 2024-04-25T10:25:13.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.295+0000 7f50ff5a8640 1 -- 172.21.15.112:0/1410680896 wait complete. 2024-04-25T10:25:13.308 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 2c84598b-be53-4b76-8dea-b8f0221b1005 1 2024-04-25T10:25:13.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.413+0000 7f34723ce640 1 Processor -- start 2024-04-25T10:25:13.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.414+0000 7f34723ce640 1 -- start start 2024-04-25T10:25:13.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f34723ce640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f346c0b19f0 0x7f346c0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f34723ce640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f346c0cb930 0x7f346c15a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f34723ce640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f346c0725d0 con 0x7f346c15ade0 2024-04-25T10:25:13.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f34723ce640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f346c0b1e00 con 0x7f346c0cb930 2024-04-25T10:25:13.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f34723ce640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f346c06c5c0 con 0x7f346c0b19f0 2024-04-25T10:25:13.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f346bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f346c0b19f0 0x7f346c0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f346bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f346c0b19f0 0x7f346c0cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55998/0 (socket says 172.21.15.112:55998) 2024-04-25T10:25:13.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f346bfff640 1 -- 172.21.15.112:0/1894500924 learned_addr learned my addr 172.21.15.112:0/1894500924 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:13.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f346bfff640 1 -- 172.21.15.112:0/1894500924 >> v2:172.21.15.19:3300/0 conn(0x7f346c0cb930 msgr2=0x7f346c15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:13.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f346bfff640 1 --2- 172.21.15.112:0/1894500924 >> v2:172.21.15.19:3300/0 conn(0x7f346c0cb930 0x7f346c15a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f346bfff640 1 -- 172.21.15.112:0/1894500924 >> v1:172.21.15.19:6789/0 conn(0x7f346c15ade0 legacy=0x7f346c15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:13.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.415+0000 7f346bfff640 1 -- 172.21.15.112:0/1894500924 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c06c810 con 0x7f346c0b19f0 2024-04-25T10:25:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.416+0000 7f346bfff640 1 --2- 172.21.15.112:0/1894500924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f346c0b19f0 0x7f346c0cb3f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f346c073480 tx=0x7f345c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f796ffadd67fc266 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.416+0000 7f346affd640 1 -- 172.21.15.112:0/1894500924 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c037070 con 0x7f346c0b19f0 2024-04-25T10:25:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.416+0000 7f346affd640 1 -- 172.21.15.112:0/1894500924 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345c02ae40 con 0x7f346c0b19f0 2024-04-25T10:25:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.416+0000 7f346affd640 1 -- 172.21.15.112:0/1894500924 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c032660 con 0x7f346c0b19f0 2024-04-25T10:25:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.417+0000 7f34723ce640 1 -- 172.21.15.112:0/1894500924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f346c0b19f0 msgr2=0x7f346c0cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.417+0000 7f34723ce640 1 --2- 172.21.15.112:0/1894500924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f346c0b19f0 0x7f346c0cb3f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f346c073480 tx=0x7f345c02a130 comp rx=0 tx=0).stop 2024-04-25T10:25:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.417+0000 7f34723ce640 1 -- 172.21.15.112:0/1894500924 shutdown_connections 2024-04-25T10:25:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.417+0000 7f34723ce640 1 --2- 172.21.15.112:0/1894500924 >> v2:172.21.15.19:3300/0 conn(0x7f346c0cb930 0x7f346c15a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.417+0000 7f34723ce640 1 --2- 172.21.15.112:0/1894500924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f346c0b19f0 0x7f346c0cb3f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.417+0000 7f34723ce640 1 -- 172.21.15.112:0/1894500924 >> 172.21.15.112:0/1894500924 conn(0x7f346c0706f0 msgr2=0x7f346c071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:13.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.417+0000 7f34723ce640 1 -- 172.21.15.112:0/1894500924 shutdown_connections 2024-04-25T10:25:13.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.417+0000 7f34723ce640 1 -- 172.21.15.112:0/1894500924 wait complete. 2024-04-25T10:25:13.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.419+0000 7f34723ce640 1 Processor -- start 2024-04-25T10:25:13.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.419+0000 7f34723ce640 1 -- start start 2024-04-25T10:25:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.420+0000 7f34723ce640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f346c0b19f0 0x7f346c157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.420+0000 7f34723ce640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f346c0cb930 0x7f346c14d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.420+0000 7f34723ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f346c15ade0 0x7f346c14d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.420+0000 7f34723ce640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f346c06d0b0 con 0x7f346c15ade0 2024-04-25T10:25:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.420+0000 7f34723ce640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f346c06cdd0 con 0x7f346c0cb930 2024-04-25T10:25:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.420+0000 7f34723ce640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f346c15b1f0 con 0x7f346c0b19f0 2024-04-25T10:25:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.420+0000 7f346bfff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f346c0b19f0 0x7f346c157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.420+0000 7f346b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f346c0cb930 0x7f346c14d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.420+0000 7f346bfff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f346c0b19f0 0x7f346c157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37000/0 (socket says 172.21.15.112:37000) 2024-04-25T10:25:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.420+0000 7f346bfff640 1 -- 172.21.15.112:0/3267943853 learned_addr learned my addr 172.21.15.112:0/3267943853 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.420+0000 7f346b7fe640 1 --2- 172.21.15.112:0/3267943853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f346c0cb930 0x7f346c14d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56008/0 (socket says 172.21.15.112:56008) 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f346bfff640 1 -- 172.21.15.112:0/3267943853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f346c0cb930 msgr2=0x7f346c14d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f346bfff640 1 --2- 172.21.15.112:0/3267943853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f346c0cb930 0x7f346c14d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f346bfff640 1 -- 172.21.15.112:0/3267943853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f346c15ade0 msgr2=0x7f346c14d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f347096b640 1 --2- 172.21.15.112:0/3267943853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f346c15ade0 0x7f346c14d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f346bfff640 1 --2- 172.21.15.112:0/3267943853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f346c15ade0 0x7f346c14d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f346bfff640 1 -- 172.21.15.112:0/3267943853 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c14dd00 con 0x7f346c0b19f0 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f346b7fe640 1 --2- 172.21.15.112:0/3267943853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f346c0cb930 0x7f346c14d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f346bfff640 1 --2- 172.21.15.112:0/3267943853 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f346c0b19f0 0x7f346c157130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f345c000c00 tx=0x7f345c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f3468ff9640 1 -- 172.21.15.112:0/3267943853 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c042070 con 0x7f346c0b19f0 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f3468ff9640 1 -- 172.21.15.112:0/3267943853 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345c03e670 con 0x7f346c0b19f0 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f34723ce640 1 -- 172.21.15.112:0/3267943853 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346c14f700 con 0x7f346c0b19f0 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f3468ff9640 1 -- 172.21.15.112:0/3267943853 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c037040 con 0x7f346c0b19f0 2024-04-25T10:25:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f34723ce640 1 -- 172.21.15.112:0/3267943853 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f346c0afd30 con 0x7f346c0b19f0 2024-04-25T10:25:13.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f3468ff9640 1 -- 172.21.15.112:0/3267943853 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f345c045070 con 0x7f346c0b19f0 2024-04-25T10:25:13.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.421+0000 7f3468ff9640 1 -- 172.21.15.112:0/3267943853 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f345c047d30 con 0x7f346c0b19f0 2024-04-25T10:25:13.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.422+0000 7f34723ce640 1 -- 172.21.15.112:0/3267943853 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346c076520 con 0x7f346c0b19f0 2024-04-25T10:25:13.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.424+0000 7f3468ff9640 1 -- 172.21.15.112:0/3267943853 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f345c047450 con 0x7f346c0b19f0 2024-04-25T10:25:13.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.497+0000 7f34723ce640 1 -- 172.21.15.112:0/3267943853 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2c84598b-be53-4b76-8dea-b8f0221b1005", "id": 1} v 0) -- 0x7f346c0cae60 con 0x7f346c0b19f0 2024-04-25T10:25:13.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.502+0000 7f3468ff9640 1 -- 172.21.15.112:0/3267943853 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c84598b-be53-4b76-8dea-b8f0221b1005", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f345c03e910 con 0x7f346c0b19f0 2024-04-25T10:25:13.504 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-04-25T10:25:13.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.502+0000 7f34723ce640 1 -- 172.21.15.112:0/3267943853 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f346c0b19f0 msgr2=0x7f346c157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.502+0000 7f34723ce640 1 --2- 172.21.15.112:0/3267943853 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f346c0b19f0 0x7f346c157130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f345c000c00 tx=0x7f345c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.502+0000 7f34723ce640 1 -- 172.21.15.112:0/3267943853 shutdown_connections 2024-04-25T10:25:13.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.503+0000 7f34723ce640 1 --2- 172.21.15.112:0/3267943853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f346c15ade0 0x7f346c14d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.503+0000 7f34723ce640 1 --2- 172.21.15.112:0/3267943853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f346c0cb930 0x7f346c14d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.503+0000 7f34723ce640 1 --2- 172.21.15.112:0/3267943853 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f346c0b19f0 0x7f346c157130 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.503+0000 7f34723ce640 1 -- 172.21.15.112:0/3267943853 >> 172.21.15.112:0/3267943853 conn(0x7f346c0706f0 msgr2=0x7f346c0c9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:13.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.503+0000 7f34723ce640 1 -- 172.21.15.112:0/3267943853 shutdown_connections 2024-04-25T10:25:13.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.503+0000 7f34723ce640 1 -- 172.21.15.112:0/3267943853 wait complete. 2024-04-25T10:25:13.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new d9b4e5c7-a6bd-4d44-a557-e236e9c3b424 2 2024-04-25T10:25:13.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.621+0000 7f2450434640 1 Processor -- start 2024-04-25T10:25:13.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.621+0000 7f2450434640 1 -- start start 2024-04-25T10:25:13.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f2450434640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f24480c9cf0 0x7f24481545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f2450434640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f24480c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f2450434640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f244806c990 con 0x7f24480c7b20 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f2450434640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f244806cc70 con 0x7f24480c9cf0 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f2450434640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f24480c8fc0 con 0x7f244806d880 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f244d9cf640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f24480c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f244d9cf640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f24480c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37008/0 (socket says 172.21.15.112:37008) 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f244d9cf640 1 -- 172.21.15.112:0/4149048809 learned_addr learned my addr 172.21.15.112:0/4149048809 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f244d9cf640 1 -- 172.21.15.112:0/4149048809 >> v2:172.21.15.19:3300/0 conn(0x7f24480c9cf0 msgr2=0x7f24481545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f244d9cf640 1 --2- 172.21.15.112:0/4149048809 >> v2:172.21.15.19:3300/0 conn(0x7f24480c9cf0 0x7f24481545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f244d9cf640 1 -- 172.21.15.112:0/4149048809 >> v1:172.21.15.19:6789/0 conn(0x7f24480c7b20 legacy=0x7f244815dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.623+0000 7f244d9cf640 1 -- 172.21.15.112:0/4149048809 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24480c8a00 con 0x7f244806d880 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.624+0000 7f244d9cf640 1 --2- 172.21.15.112:0/4149048809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f24480c75e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f243c009870 tx=0x7f243c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce1c6f972155ea8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.624+0000 7f244d1ce640 1 -- 172.21.15.112:0/4149048809 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c037070 con 0x7f244806d880 2024-04-25T10:25:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.624+0000 7f244d1ce640 1 -- 172.21.15.112:0/4149048809 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c02ae10 con 0x7f244806d880 2024-04-25T10:25:13.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.624+0000 7f244d1ce640 1 -- 172.21.15.112:0/4149048809 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c032660 con 0x7f244806d880 2024-04-25T10:25:13.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.625+0000 7f2450434640 1 -- 172.21.15.112:0/4149048809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 msgr2=0x7f24480c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.625+0000 7f2450434640 1 --2- 172.21.15.112:0/4149048809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f24480c75e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f243c009870 tx=0x7f243c02a100 comp rx=0 tx=0).stop 2024-04-25T10:25:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.625+0000 7f2450434640 1 -- 172.21.15.112:0/4149048809 shutdown_connections 2024-04-25T10:25:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.625+0000 7f2450434640 1 --2- 172.21.15.112:0/4149048809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f24480c75e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.625+0000 7f2450434640 1 --2- 172.21.15.112:0/4149048809 >> v2:172.21.15.19:3300/0 conn(0x7f24480c9cf0 0x7f24481545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.625+0000 7f2450434640 1 -- 172.21.15.112:0/4149048809 >> 172.21.15.112:0/4149048809 conn(0x7f24480cded0 msgr2=0x7f24480ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.625+0000 7f2450434640 1 -- 172.21.15.112:0/4149048809 shutdown_connections 2024-04-25T10:25:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.625+0000 7f2450434640 1 -- 172.21.15.112:0/4149048809 wait complete. 2024-04-25T10:25:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.626+0000 7f2450434640 1 Processor -- start 2024-04-25T10:25:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.626+0000 7f2450434640 1 -- start start 2024-04-25T10:25:13.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f2450434640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f244814c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f2450434640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24480c7b20 0x7f244814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f2450434640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24480c9cf0 0x7f244814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f2450434640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f244806dc90 con 0x7f24480c9cf0 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f2450434640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f244815db10 con 0x7f24480c7b20 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f2450434640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f244806c5c0 con 0x7f244806d880 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244e1d0640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f244814c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244d9cf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24480c7b20 0x7f244814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244d9cf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24480c7b20 0x7f244814a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56016/0 (socket says 172.21.15.112:56016) 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244d9cf640 1 -- 172.21.15.112:0/225362502 learned_addr learned my addr 172.21.15.112:0/225362502 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244e1d0640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f244814c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37024/0 (socket says 172.21.15.112:37024) 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244d9cf640 1 -- 172.21.15.112:0/225362502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 msgr2=0x7f244814c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244d9cf640 1 --2- 172.21.15.112:0/225362502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f244814c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244d9cf640 1 -- 172.21.15.112:0/225362502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24480c9cf0 msgr2=0x7f244814ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244d9cf640 1 --2- 172.21.15.112:0/225362502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24480c9cf0 0x7f244814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244d9cf640 1 -- 172.21.15.112:0/225362502 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24480c6040 con 0x7f24480c7b20 2024-04-25T10:25:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244e1d0640 1 --2- 172.21.15.112:0/225362502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f244814c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f244d9cf640 1 --2- 172.21.15.112:0/225362502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24480c7b20 0x7f244814a7d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f243c000c00 tx=0x7f243c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f243affd640 1 -- 172.21.15.112:0/225362502 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c042070 con 0x7f24480c7b20 2024-04-25T10:25:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.628+0000 7f243affd640 1 -- 172.21.15.112:0/225362502 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c03e670 con 0x7f24480c7b20 2024-04-25T10:25:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.629+0000 7f2450434640 1 -- 172.21.15.112:0/225362502 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24480c4690 con 0x7f24480c7b20 2024-04-25T10:25:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.629+0000 7f243affd640 1 -- 172.21.15.112:0/225362502 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c037040 con 0x7f24480c7b20 2024-04-25T10:25:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.629+0000 7f2450434640 1 -- 172.21.15.112:0/225362502 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2448158cf0 con 0x7f24480c7b20 2024-04-25T10:25:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.629+0000 7f243affd640 1 -- 172.21.15.112:0/225362502 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f243c045070 con 0x7f24480c7b20 2024-04-25T10:25:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.629+0000 7f243affd640 1 -- 172.21.15.112:0/225362502 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f243c047cd0 con 0x7f24480c7b20 2024-04-25T10:25:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.630+0000 7f2450434640 1 -- 172.21.15.112:0/225362502 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f244806dfe0 con 0x7f24480c7b20 2024-04-25T10:25:13.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.632+0000 7f243affd640 1 -- 172.21.15.112:0/225362502 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f243c047450 con 0x7f24480c7b20 2024-04-25T10:25:13.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.703+0000 7f2450434640 1 -- 172.21.15.112:0/225362502 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d9b4e5c7-a6bd-4d44-a557-e236e9c3b424", "id": 2} v 0) -- 0x7f2448076520 con 0x7f24480c7b20 2024-04-25T10:25:13.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.710+0000 7f243affd640 1 -- 172.21.15.112:0/225362502 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9b4e5c7-a6bd-4d44-a557-e236e9c3b424", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f243c047980 con 0x7f24480c7b20 2024-04-25T10:25:13.712 INFO:teuthology.orchestra.run.smithi112.stdout:2 2024-04-25T10:25:13.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.711+0000 7f2450434640 1 -- 172.21.15.112:0/225362502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24480c7b20 msgr2=0x7f244814a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.711+0000 7f2450434640 1 --2- 172.21.15.112:0/225362502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24480c7b20 0x7f244814a7d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f243c000c00 tx=0x7f243c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.711+0000 7f2450434640 1 -- 172.21.15.112:0/225362502 shutdown_connections 2024-04-25T10:25:13.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.711+0000 7f2450434640 1 --2- 172.21.15.112:0/225362502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24480c9cf0 0x7f244814ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.711+0000 7f2450434640 1 --2- 172.21.15.112:0/225362502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24480c7b20 0x7f244814a7d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.711+0000 7f2450434640 1 --2- 172.21.15.112:0/225362502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f244806d880 0x7f244814c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.711+0000 7f2450434640 1 -- 172.21.15.112:0/225362502 >> 172.21.15.112:0/225362502 conn(0x7f24480cded0 msgr2=0x7f24480c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:13.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.711+0000 7f2450434640 1 -- 172.21.15.112:0/225362502 shutdown_connections 2024-04-25T10:25:13.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.711+0000 7f2450434640 1 -- 172.21.15.112:0/225362502 wait complete. 2024-04-25T10:25:13.724 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 60a7a433-9130-4eec-af44-a7967414087b 3 2024-04-25T10:25:13.779 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:13.777+0000 7fcca35ee040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T10:25:13.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.828+0000 7f7a793f3640 1 Processor -- start 2024-04-25T10:25:13.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.828+0000 7f7a793f3640 1 -- start start 2024-04-25T10:25:13.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a793f3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a7406d8d0 0x7f7a741568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a793f3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 0x7f7a7415c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a793f3640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7406dec0 con 0x7f7a7415ca60 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a793f3640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7406e680 con 0x7f7a7406d8d0 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a793f3640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7a740ca500 con 0x7f7a740c3980 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a727fc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 0x7f7a7415c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a727fc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 0x7f7a7415c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37036/0 (socket says 172.21.15.112:37036) 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a727fc640 1 -- 172.21.15.112:0/3158159635 learned_addr learned my addr 172.21.15.112:0/3158159635 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a727fc640 1 -- 172.21.15.112:0/3158159635 >> v2:172.21.15.19:3300/0 conn(0x7f7a7406d8d0 msgr2=0x7f7a741568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a727fc640 1 --2- 172.21.15.112:0/3158159635 >> v2:172.21.15.19:3300/0 conn(0x7f7a7406d8d0 0x7f7a741568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a727fc640 1 -- 172.21.15.112:0/3158159635 >> v1:172.21.15.19:6789/0 conn(0x7f7a7415ca60 legacy=0x7f7a740cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.829+0000 7f7a727fc640 1 -- 172.21.15.112:0/3158159635 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7406d550 con 0x7f7a740c3980 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.830+0000 7f7a727fc640 1 --2- 172.21.15.112:0/3158159635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 0x7f7a7415c520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009870 tx=0x7f7a6402a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e9619d2e69c3a15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:13.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.830+0000 7f7a71ffb640 1 -- 172.21.15.112:0/3158159635 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64037070 con 0x7f7a740c3980 2024-04-25T10:25:13.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.830+0000 7f7a71ffb640 1 -- 172.21.15.112:0/3158159635 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a64032440 con 0x7f7a740c3980 2024-04-25T10:25:13.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.830+0000 7f7a71ffb640 1 -- 172.21.15.112:0/3158159635 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64032810 con 0x7f7a740c3980 2024-04-25T10:25:13.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.831+0000 7f7a793f3640 1 -- 172.21.15.112:0/3158159635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 msgr2=0x7f7a7415c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.831+0000 7f7a793f3640 1 --2- 172.21.15.112:0/3158159635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 0x7f7a7415c520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009870 tx=0x7f7a6402a2a0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.831+0000 7f7a793f3640 1 -- 172.21.15.112:0/3158159635 shutdown_connections 2024-04-25T10:25:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.831+0000 7f7a793f3640 1 --2- 172.21.15.112:0/3158159635 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 0x7f7a7415c520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.831+0000 7f7a793f3640 1 --2- 172.21.15.112:0/3158159635 >> v2:172.21.15.19:3300/0 conn(0x7f7a7406d8d0 0x7f7a741568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.831+0000 7f7a793f3640 1 -- 172.21.15.112:0/3158159635 >> 172.21.15.112:0/3158159635 conn(0x7f7a740706f0 msgr2=0x7f7a74071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.831+0000 7f7a793f3640 1 -- 172.21.15.112:0/3158159635 shutdown_connections 2024-04-25T10:25:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.831+0000 7f7a793f3640 1 -- 172.21.15.112:0/3158159635 wait complete. 2024-04-25T10:25:13.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.833+0000 7f7a793f3640 1 Processor -- start 2024-04-25T10:25:13.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.833+0000 7f7a793f3640 1 -- start start 2024-04-25T10:25:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.834+0000 7f7a793f3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a7406d8d0 0x7f7a741f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.834+0000 7f7a793f3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 0x7f7a74150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.834+0000 7f7a793f3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a7415ca60 0x7f7a74154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.834+0000 7f7a793f3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7a740caa30 con 0x7f7a7415ca60 2024-04-25T10:25:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.834+0000 7f7a793f3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7406e160 con 0x7f7a7406d8d0 2024-04-25T10:25:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.834+0000 7f7a793f3640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7406d1f0 con 0x7f7a740c3980 2024-04-25T10:25:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.834+0000 7f7a727fc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 0x7f7a74150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.834+0000 7f7a72ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a7406d8d0 0x7f7a741f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:13.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.834+0000 7f7a72ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a7406d8d0 0x7f7a741f2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56024/0 (socket says 172.21.15.112:56024) 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.834+0000 7f7a72ffd640 1 -- 172.21.15.112:0/458366862 learned_addr learned my addr 172.21.15.112:0/458366862 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a72ffd640 1 -- 172.21.15.112:0/458366862 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 msgr2=0x7f7a74150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a72ffd640 1 --2- 172.21.15.112:0/458366862 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 0x7f7a74150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a72ffd640 1 -- 172.21.15.112:0/458366862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a7415ca60 msgr2=0x7f7a74154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a72ffd640 1 --2- 172.21.15.112:0/458366862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a7415ca60 0x7f7a74154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a72ffd640 1 -- 172.21.15.112:0/458366862 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a741f34d0 con 0x7f7a7406d8d0 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a72ffd640 1 --2- 172.21.15.112:0/458366862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a7406d8d0 0x7f7a741f2f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800b410 tx=0x7f7a6800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a5b7fe640 1 -- 172.21.15.112:0/458366862 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68015020 con 0x7f7a7406d8d0 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a5b7fe640 1 -- 172.21.15.112:0/458366862 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a68011850 con 0x7f7a7406d8d0 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a5b7fe640 1 -- 172.21.15.112:0/458366862 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68011c40 con 0x7f7a7406d8d0 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a793f3640 1 -- 172.21.15.112:0/458366862 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a741f64d0 con 0x7f7a7406d8d0 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a793f3640 1 -- 172.21.15.112:0/458366862 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a741f67b0 con 0x7f7a7406d8d0 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a5b7fe640 1 -- 172.21.15.112:0/458366862 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7a68018020 con 0x7f7a7406d8d0 2024-04-25T10:25:13.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.835+0000 7f7a5b7fe640 1 -- 172.21.15.112:0/458366862 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f7a68019bb0 con 0x7f7a7406d8d0 2024-04-25T10:25:13.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.836+0000 7f7a793f3640 1 -- 172.21.15.112:0/458366862 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a74076520 con 0x7f7a7406d8d0 2024-04-25T10:25:13.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.838+0000 7f7a5b7fe640 1 -- 172.21.15.112:0/458366862 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7a6801f020 con 0x7f7a7406d8d0 2024-04-25T10:25:13.871 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:13.869+0000 7fcca35ee040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T10:25:13.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.908+0000 7f7a793f3640 1 -- 172.21.15.112:0/458366862 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "60a7a433-9130-4eec-af44-a7967414087b", "id": 3} v 0) -- 0x7f7a740cb040 con 0x7f7a7406d8d0 2024-04-25T10:25:13.914 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:13.912+0000 7fcca35ee040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T10:25:13.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.915+0000 7f7a5b7fe640 1 -- 172.21.15.112:0/458366862 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60a7a433-9130-4eec-af44-a7967414087b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f7a68011de0 con 0x7f7a7406d8d0 2024-04-25T10:25:13.918 INFO:teuthology.orchestra.run.smithi112.stdout:3 2024-04-25T10:25:13.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.916+0000 7f7a793f3640 1 -- 172.21.15.112:0/458366862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a7406d8d0 msgr2=0x7f7a741f2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:13.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.916+0000 7f7a793f3640 1 --2- 172.21.15.112:0/458366862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a7406d8d0 0x7f7a741f2f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800b410 tx=0x7f7a6800b8d0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.916+0000 7f7a793f3640 1 -- 172.21.15.112:0/458366862 shutdown_connections 2024-04-25T10:25:13.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.916+0000 7f7a793f3640 1 --2- 172.21.15.112:0/458366862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a7415ca60 0x7f7a74154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.916+0000 7f7a793f3640 1 --2- 172.21.15.112:0/458366862 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a740c3980 0x7f7a74150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.916+0000 7f7a793f3640 1 --2- 172.21.15.112:0/458366862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a7406d8d0 0x7f7a741f2f90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:13.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.916+0000 7f7a793f3640 1 -- 172.21.15.112:0/458366862 >> 172.21.15.112:0/458366862 conn(0x7f7a740706f0 msgr2=0x7f7a740b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:13.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.916+0000 7f7a793f3640 1 -- 172.21.15.112:0/458366862 shutdown_connections 2024-04-25T10:25:13.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:13.916+0000 7f7a793f3640 1 -- 172.21.15.112:0/458366862 wait complete. 2024-04-25T10:25:13.929 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new d5abf043-a82d-4eb7-a7d5-efd167704fc7 4 2024-04-25T10:25:14.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.033+0000 7f910fc4c640 1 Processor -- start 2024-04-25T10:25:14.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.033+0000 7f910fc4c640 1 -- start start 2024-04-25T10:25:14.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.034+0000 7f910fc4c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91080b2620 0x7f91080cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.034+0000 7f910fc4c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f910815e460 con 0x7f91081545d0 2024-04-25T10:25:14.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.034+0000 7f910fc4c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f910815e740 con 0x7f91080c4e50 2024-04-25T10:25:14.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.034+0000 7f910fc4c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f91080cb3d0 con 0x7f91080b2620 2024-04-25T10:25:14.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.034+0000 7f910d1e7640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91080b2620 0x7f91080cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.034+0000 7f910d9e8640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f91080c4e50 0x7f91080cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51254/0 (socket says 172.21.15.112:51254) 2024-04-25T10:25:14.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.034+0000 7f910d9e8640 1 -- 172.21.15.112:0/1077728961 learned_addr learned my addr 172.21.15.112:0/1077728961 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-25T10:25:14.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.035+0000 7f910c9e6640 1 -- 172.21.15.112:0/1077728961 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824911468 0 0) 0x7f910815e740 con 0x7f91080c4e50 2024-04-25T10:25:14.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.035+0000 7f910c9e6640 1 -- 172.21.15.112:0/1077728961 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90f4003520 con 0x7f91080c4e50 2024-04-25T10:25:14.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.035+0000 7f910d1e7640 1 -- 172.21.15.112:0/1077728961 >> v1:172.21.15.112:6789/0 conn(0x7f91080c4e50 legacy=0x7f91080cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.035+0000 7f910d1e7640 1 -- 172.21.15.112:0/1077728961 >> v1:172.21.15.19:6789/0 conn(0x7f91081545d0 legacy=0x7f910815a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:14.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.035+0000 7f910d1e7640 1 -- 172.21.15.112:0/1077728961 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91080cad80 con 0x7f91080b2620 2024-04-25T10:25:14.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.035+0000 7f910d1e7640 1 --2- 172.21.15.112:0/1077728961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91080b2620 0x7f91080cbb00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f90f80097d0 tx=0x7f90f802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4dda2c692605dc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:14.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.036+0000 7f910c9e6640 1 -- 172.21.15.112:0/1077728961 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f8037070 con 0x7f91080b2620 2024-04-25T10:25:14.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.036+0000 7f910c9e6640 1 -- 172.21.15.112:0/1077728961 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f8032440 con 0x7f91080b2620 2024-04-25T10:25:14.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.036+0000 7f910c9e6640 1 -- 172.21.15.112:0/1077728961 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f80327f0 con 0x7f91080b2620 2024-04-25T10:25:14.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.037+0000 7f910fc4c640 1 -- 172.21.15.112:0/1077728961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91080b2620 msgr2=0x7f91080cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.037+0000 7f910fc4c640 1 --2- 172.21.15.112:0/1077728961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91080b2620 0x7f91080cbb00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f90f80097d0 tx=0x7f90f802a250 comp rx=0 tx=0).stop 2024-04-25T10:25:14.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.037+0000 7f910fc4c640 1 -- 172.21.15.112:0/1077728961 shutdown_connections 2024-04-25T10:25:14.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.037+0000 7f910fc4c640 1 --2- 172.21.15.112:0/1077728961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91080b2620 0x7f91080cbb00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.037+0000 7f910fc4c640 1 -- 172.21.15.112:0/1077728961 >> 172.21.15.112:0/1077728961 conn(0x7f910806c7a0 msgr2=0x7f910806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:14.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.037+0000 7f910fc4c640 1 -- 172.21.15.112:0/1077728961 shutdown_connections 2024-04-25T10:25:14.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.037+0000 7f910fc4c640 1 -- 172.21.15.112:0/1077728961 wait complete. 2024-04-25T10:25:14.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.039+0000 7f910fc4c640 1 Processor -- start 2024-04-25T10:25:14.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.039+0000 7f910fc4c640 1 -- start start 2024-04-25T10:25:14.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910fc4c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91080b2620 0x7f910814ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910fc4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91080c4e50 0x7f91081f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910fc4c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91081545d0 0x7f91081f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910fc4c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f91081549e0 con 0x7f91080b2620 2024-04-25T10:25:14.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910fc4c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f91080c5350 con 0x7f91080c4e50 2024-04-25T10:25:14.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910fc4c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f91080ccd10 con 0x7f91081545d0 2024-04-25T10:25:14.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910d1e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91080c4e50 0x7f91081f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910e1e9640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91081545d0 0x7f91081f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910d1e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91080c4e50 0x7f91081f2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56036/0 (socket says 172.21.15.112:56036) 2024-04-25T10:25:14.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910d1e7640 1 -- 172.21.15.112:0/1499566853 learned_addr learned my addr 172.21.15.112:0/1499566853 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910e1e9640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91081545d0 0x7f91081f2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37070/0 (socket says 172.21.15.112:37070) 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910d1e7640 1 -- 172.21.15.112:0/1499566853 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91081545d0 msgr2=0x7f91081f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910d9e8640 1 --2- 172.21.15.112:0/1499566853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91080b2620 0x7f910814ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910d1e7640 1 --2- 172.21.15.112:0/1499566853 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91081545d0 0x7f91081f2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910d1e7640 1 -- 172.21.15.112:0/1499566853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91080b2620 msgr2=0x7f910814ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910d1e7640 1 --2- 172.21.15.112:0/1499566853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91080b2620 0x7f910814ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910d1e7640 1 -- 172.21.15.112:0/1499566853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91081f35b0 con 0x7f91080c4e50 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.040+0000 7f910e1e9640 1 --2- 172.21.15.112:0/1499566853 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91081545d0 0x7f91081f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.041+0000 7f910d1e7640 1 --2- 172.21.15.112:0/1499566853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91080c4e50 0x7f91081f2620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f90f8000c00 tx=0x7f90f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.041+0000 7f90fe7fc640 1 -- 172.21.15.112:0/1499566853 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f8037050 con 0x7f91080c4e50 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.041+0000 7f90fe7fc640 1 -- 172.21.15.112:0/1499566853 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f8043070 con 0x7f91080c4e50 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.041+0000 7f910fc4c640 1 -- 172.21.15.112:0/1499566853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91081e4ab0 con 0x7f91080c4e50 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.041+0000 7f90fe7fc640 1 -- 172.21.15.112:0/1499566853 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f8006e10 con 0x7f91080c4e50 2024-04-25T10:25:14.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.041+0000 7f910fc4c640 1 -- 172.21.15.112:0/1499566853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91081e5070 con 0x7f91080c4e50 2024-04-25T10:25:14.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.041+0000 7f90fe7fc640 1 -- 172.21.15.112:0/1499566853 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f90f8032a30 con 0x7f91080c4e50 2024-04-25T10:25:14.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.041+0000 7f90fe7fc640 1 -- 172.21.15.112:0/1499566853 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f90f8048b40 con 0x7f91080c4e50 2024-04-25T10:25:14.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.042+0000 7f910fc4c640 1 -- 172.21.15.112:0/1499566853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91081f3300 con 0x7f91080c4e50 2024-04-25T10:25:14.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.044+0000 7f90fe7fc640 1 -- 172.21.15.112:0/1499566853 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f90f8048460 con 0x7f91080c4e50 2024-04-25T10:25:14.089 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:14.087+0000 7fcca35ee040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T10:25:14.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.115+0000 7f910fc4c640 1 -- 172.21.15.112:0/1499566853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d5abf043-a82d-4eb7-a7d5-efd167704fc7", "id": 4} v 0) -- 0x7f91081527e0 con 0x7f91080c4e50 2024-04-25T10:25:14.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.121+0000 7f90fe7fc640 1 -- 172.21.15.112:0/1499566853 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5abf043-a82d-4eb7-a7d5-efd167704fc7", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f90f8048640 con 0x7f91080c4e50 2024-04-25T10:25:14.124 INFO:teuthology.orchestra.run.smithi112.stdout:4 2024-04-25T10:25:14.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.122+0000 7f910fc4c640 1 -- 172.21.15.112:0/1499566853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91080c4e50 msgr2=0x7f91081f2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.122+0000 7f910fc4c640 1 --2- 172.21.15.112:0/1499566853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91080c4e50 0x7f91081f2620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f90f8000c00 tx=0x7f90f80046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.122+0000 7f910fc4c640 1 -- 172.21.15.112:0/1499566853 shutdown_connections 2024-04-25T10:25:14.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.122+0000 7f910fc4c640 1 --2- 172.21.15.112:0/1499566853 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91081545d0 0x7f91081f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.122+0000 7f910fc4c640 1 --2- 172.21.15.112:0/1499566853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91080c4e50 0x7f91081f2620 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.122+0000 7f910fc4c640 1 --2- 172.21.15.112:0/1499566853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91080b2620 0x7f910814ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.122+0000 7f910fc4c640 1 -- 172.21.15.112:0/1499566853 >> 172.21.15.112:0/1499566853 conn(0x7f910806c7a0 msgr2=0x7f91080c5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:14.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.122+0000 7f910fc4c640 1 -- 172.21.15.112:0/1499566853 shutdown_connections 2024-04-25T10:25:14.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.122+0000 7f910fc4c640 1 -- 172.21.15.112:0/1499566853 wait complete. 2024-04-25T10:25:14.135 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 955a9181-d839-4d55-baa6-5cf01cc4ae36 5 2024-04-25T10:25:14.143 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:14.141+0000 7fcca35ee040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T10:25:14.198 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:14.196+0000 7fcca35ee040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T10:25:14.231 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:14.229+0000 7f790ee19040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T10:25:14.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.239+0000 7eff37934640 1 Processor -- start 2024-04-25T10:25:14.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.239+0000 7eff37934640 1 -- start start 2024-04-25T10:25:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.241+0000 7eff37934640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7eff30154670 0x7eff300c9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.241+0000 7eff37934640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3006c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.241+0000 7eff37934640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff300ca110 con 0x7eff3006cb00 2024-04-25T10:25:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.241+0000 7eff37934640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7eff3015e880 con 0x7eff30154670 2024-04-25T10:25:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.241+0000 7eff37934640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7eff300c9e30 con 0x7eff3015ae40 2024-04-25T10:25:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.241+0000 7eff34ecf640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3006c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.241+0000 7eff34ecf640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3006c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37078/0 (socket says 172.21.15.112:37078) 2024-04-25T10:25:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.241+0000 7eff34ecf640 1 -- 172.21.15.112:0/3459909986 learned_addr learned my addr 172.21.15.112:0/3459909986 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.241+0000 7eff35ed1640 1 --1- 172.21.15.112:0/3459909986 >> v1:172.21.15.112:6789/0 conn(0x7eff3006cb00 0x7eff300cb880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51266/0 (socket says 172.21.15.112:51266) 2024-04-25T10:25:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.242+0000 7eff34ecf640 1 -- 172.21.15.112:0/3459909986 >> v2:172.21.15.19:3300/0 conn(0x7eff30154670 msgr2=0x7eff300c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.242+0000 7eff34ecf640 1 --2- 172.21.15.112:0/3459909986 >> v2:172.21.15.19:3300/0 conn(0x7eff30154670 0x7eff300c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.242+0000 7eff34ecf640 1 -- 172.21.15.112:0/3459909986 >> v1:172.21.15.112:6789/0 conn(0x7eff3006cb00 legacy=0x7eff300cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.242+0000 7eff27fff640 1 -- 172.21.15.112:0/3459909986 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2565446176 0 0) 0x7eff300ca110 con 0x7eff3006cb00 2024-04-25T10:25:14.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.242+0000 7eff34ecf640 1 -- 172.21.15.112:0/3459909986 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3015dac0 con 0x7eff3015ae40 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.242+0000 7eff34ecf640 1 --2- 172.21.15.112:0/3459909986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3006c5c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff20009870 tx=0x7eff2002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=558b78db192a5ea6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.243+0000 7eff27fff640 1 -- 172.21.15.112:0/3459909986 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20037070 con 0x7eff3015ae40 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.243+0000 7eff27fff640 1 -- 172.21.15.112:0/3459909986 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2002ae50 con 0x7eff3015ae40 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.243+0000 7eff27fff640 1 -- 172.21.15.112:0/3459909986 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20032860 con 0x7eff3015ae40 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.244+0000 7eff37934640 1 -- 172.21.15.112:0/3459909986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 msgr2=0x7eff3006c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.244+0000 7eff37934640 1 --2- 172.21.15.112:0/3459909986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3006c5c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff20009870 tx=0x7eff2002a300 comp rx=0 tx=0).stop 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.244+0000 7eff37934640 1 -- 172.21.15.112:0/3459909986 shutdown_connections 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.244+0000 7eff37934640 1 --2- 172.21.15.112:0/3459909986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3006c5c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.244+0000 7eff37934640 1 --2- 172.21.15.112:0/3459909986 >> v2:172.21.15.19:3300/0 conn(0x7eff30154670 0x7eff300c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.244+0000 7eff37934640 1 -- 172.21.15.112:0/3459909986 >> 172.21.15.112:0/3459909986 conn(0x7eff30072200 msgr2=0x7eff30072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.244+0000 7eff37934640 1 -- 172.21.15.112:0/3459909986 shutdown_connections 2024-04-25T10:25:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.244+0000 7eff37934640 1 -- 172.21.15.112:0/3459909986 wait complete. 2024-04-25T10:25:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.245+0000 7eff37934640 1 Processor -- start 2024-04-25T10:25:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.246+0000 7eff37934640 1 -- start start 2024-04-25T10:25:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff37934640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3006cb00 0x7eff3014cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff37934640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff30154670 0x7eff300703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff37934640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3014a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff37934640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7eff300caf80 con 0x7eff3006cb00 2024-04-25T10:25:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff37934640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7eff3015e080 con 0x7eff30154670 2024-04-25T10:25:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff37934640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7eff3015b250 con 0x7eff3015ae40 2024-04-25T10:25:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff35ed1640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3014a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff34ecf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff30154670 0x7eff300703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff35ed1640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3014a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37094/0 (socket says 172.21.15.112:37094) 2024-04-25T10:25:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff35ed1640 1 -- 172.21.15.112:0/962299550 learned_addr learned my addr 172.21.15.112:0/962299550 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff34ecf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff30154670 0x7eff300703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56040/0 (socket says 172.21.15.112:56040) 2024-04-25T10:25:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff35ed1640 1 -- 172.21.15.112:0/962299550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff30154670 msgr2=0x7eff300703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff35ed1640 1 --2- 172.21.15.112:0/962299550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff30154670 0x7eff300703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff35ed1640 1 -- 172.21.15.112:0/962299550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3006cb00 msgr2=0x7eff3014cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff356d0640 1 --2- 172.21.15.112:0/962299550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3006cb00 0x7eff3014cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff35ed1640 1 --2- 172.21.15.112:0/962299550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3006cb00 0x7eff3014cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff35ed1640 1 -- 172.21.15.112:0/962299550 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3014d0a0 con 0x7eff3015ae40 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.247+0000 7eff35ed1640 1 --2- 172.21.15.112:0/962299550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3014a150 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff2800c700 tx=0x7eff2800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.248+0000 7eff25ffb640 1 -- 172.21.15.112:0/962299550 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff28018070 con 0x7eff3015ae40 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.248+0000 7eff25ffb640 1 -- 172.21.15.112:0/962299550 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2800ce10 con 0x7eff3015ae40 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.248+0000 7eff37934640 1 -- 172.21.15.112:0/962299550 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff300cc760 con 0x7eff3015ae40 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.248+0000 7eff25ffb640 1 -- 172.21.15.112:0/962299550 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2800a880 con 0x7eff3015ae40 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.248+0000 7eff25ffb640 1 -- 172.21.15.112:0/962299550 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7eff2801b070 con 0x7eff3015ae40 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.248+0000 7eff37934640 1 -- 172.21.15.112:0/962299550 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff300ccfc0 con 0x7eff3015ae40 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.248+0000 7eff25ffb640 1 -- 172.21.15.112:0/962299550 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7eff280078a0 con 0x7eff3015ae40 2024-04-25T10:25:14.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.249+0000 7eff37934640 1 -- 172.21.15.112:0/962299550 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff3014d270 con 0x7eff3015ae40 2024-04-25T10:25:14.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.251+0000 7eff25ffb640 1 -- 172.21.15.112:0/962299550 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7eff280070d0 con 0x7eff3015ae40 2024-04-25T10:25:14.317 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:14.315+0000 7fcca35ee040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:25:14.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.321+0000 7eff37934640 1 -- 172.21.15.112:0/962299550 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "955a9181-d839-4d55-baa6-5cf01cc4ae36", "id": 5} v 0) -- 0x7eff30069210 con 0x7eff3015ae40 2024-04-25T10:25:14.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.328+0000 7eff25ffb640 1 -- 172.21.15.112:0/962299550 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "955a9181-d839-4d55-baa6-5cf01cc4ae36", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7eff280072b0 con 0x7eff3015ae40 2024-04-25T10:25:14.330 INFO:teuthology.orchestra.run.smithi112.stdout:5 2024-04-25T10:25:14.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.329+0000 7eff37934640 1 -- 172.21.15.112:0/962299550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 msgr2=0x7eff3014a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.329+0000 7eff37934640 1 --2- 172.21.15.112:0/962299550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3014a150 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff2800c700 tx=0x7eff2800cbc0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.329+0000 7eff37934640 1 -- 172.21.15.112:0/962299550 shutdown_connections 2024-04-25T10:25:14.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.329+0000 7eff37934640 1 --2- 172.21.15.112:0/962299550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3015ae40 0x7eff3014a150 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.329+0000 7eff37934640 1 --2- 172.21.15.112:0/962299550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff30154670 0x7eff300703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.329+0000 7eff37934640 1 --2- 172.21.15.112:0/962299550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3006cb00 0x7eff3014cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.329+0000 7eff37934640 1 -- 172.21.15.112:0/962299550 >> 172.21.15.112:0/962299550 conn(0x7eff30072200 msgr2=0x7eff30158010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:14.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.329+0000 7eff37934640 1 -- 172.21.15.112:0/962299550 shutdown_connections 2024-04-25T10:25:14.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.329+0000 7eff37934640 1 -- 172.21.15.112:0/962299550 wait complete. 2024-04-25T10:25:14.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new d8d79c2f-4134-4bb6-915c-c500aacfe833 6 2024-04-25T10:25:14.342 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:14.340+0000 7f790ee19040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T10:25:14.396 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:14.394+0000 7f790ee19040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T10:25:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.488+0000 7fbc31172640 1 Processor -- start 2024-04-25T10:25:14.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.488+0000 7fbc31172640 1 -- start start 2024-04-25T10:25:14.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.489+0000 7fbc31172640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbc2c15a830 0x7fbc2c15ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.489+0000 7fbc31172640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2c06e360 con 0x7fbc2c0ce7b0 2024-04-25T10:25:14.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.489+0000 7fbc31172640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2c15a2a0 con 0x7fbc2c06ddb0 2024-04-25T10:25:14.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.489+0000 7fbc31172640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fbc2c06e600 con 0x7fbc2c15a830 2024-04-25T10:25:14.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.489+0000 7fbc2ad9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbc2c06ddb0 0x7fbc2c142470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51268/0 (socket says 172.21.15.112:51268) 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.489+0000 7fbc2ad9d640 1 -- 172.21.15.112:0/208735135 learned_addr learned my addr 172.21.15.112:0/208735135 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4000455267 0 0) 0x7fbc2c15a2a0 con 0x7fbc2c06ddb0 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc14003520 con 0x7fbc2c06ddb0 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc2a59c640 1 --2- 172.21.15.112:0/208735135 >> v2:172.21.15.19:3300/0 conn(0x7fbc2c15a830 0x7fbc2c15ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 <== mon.1 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3065764460 0 0) 0x7fbc14003520 con 0x7fbc2c06ddb0 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 >> v2:172.21.15.19:3300/0 conn(0x7fbc2c15a830 msgr2=0x7fbc2c15ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 --2- 172.21.15.112:0/208735135 >> v2:172.21.15.19:3300/0 conn(0x7fbc2c15a830 0x7fbc2c15ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 >> v1:172.21.15.19:6789/0 conn(0x7fbc2c0ce7b0 legacy=0x7fbc2c163cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2c1594e0 con 0x7fbc2c06ddb0 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 <== mon.1 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2140478945 0 0) 0x7fbc20001670 con 0x7fbc2c06ddb0 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 >> v1:172.21.15.112:6789/0 conn(0x7fbc2c06ddb0 legacy=0x7fbc2c142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 0x7fbc14003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc14004800 0x7fbc14004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc14005350 0x7fbc1400ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c06e600 con 0x7fbc14005350 2024-04-25T10:25:14.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1400c2e0 con 0x7fbc140039b0 2024-04-25T10:25:14.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbc1400c4e0 con 0x7fbc14004800 2024-04-25T10:25:14.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc2ad9d640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 0x7fbc14003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.490+0000 7fbc2a59c640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc14004800 0x7fbc14004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.491+0000 7fbc2ad9d640 1 -- 172.21.15.112:0/208735135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc14004800 msgr2=0x7fbc14004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:14.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.491+0000 7fbc2ad9d640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc14004800 0x7fbc14004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.491+0000 7fbc2ad9d640 1 -- 172.21.15.112:0/208735135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc14005350 msgr2=0x7fbc1400ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:14.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.491+0000 7fbc2b59e640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc14005350 0x7fbc1400ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.491+0000 7fbc2ad9d640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc14005350 0x7fbc1400ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.491+0000 7fbc2b59e640 1 -- 172.21.15.112:0/208735135 reap_dead start 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.491+0000 7fbc2ad9d640 1 -- 172.21.15.112:0/208735135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc14003520 con 0x7fbc140039b0 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.491+0000 7fbc2a59c640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc14004800 0x7fbc14004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.492+0000 7fbc2ad9d640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 0x7fbc14003e20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000c240 tx=0x7fbc14005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ec33f1c4dbc34f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.492+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20007d10 con 0x7fbc140039b0 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.492+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc200058d0 con 0x7fbc140039b0 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.492+0000 7fbc29d9b640 1 -- 172.21.15.112:0/208735135 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20005d20 con 0x7fbc140039b0 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.493+0000 7fbc31172640 1 -- 172.21.15.112:0/208735135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 msgr2=0x7fbc14003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.493+0000 7fbc31172640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 0x7fbc14003e20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000c240 tx=0x7fbc14005830 comp rx=0 tx=0).stop 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.493+0000 7fbc31172640 1 -- 172.21.15.112:0/208735135 shutdown_connections 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.493+0000 7fbc31172640 1 --2- 172.21.15.112:0/208735135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 0x7fbc14003e20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.493+0000 7fbc31172640 1 -- 172.21.15.112:0/208735135 >> 172.21.15.112:0/208735135 conn(0x7fbc2c074880 msgr2=0x7fbc2c0700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:14.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.493+0000 7fbc31172640 1 -- 172.21.15.112:0/208735135 shutdown_connections 2024-04-25T10:25:14.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.493+0000 7fbc31172640 1 -- 172.21.15.112:0/208735135 wait complete. 2024-04-25T10:25:14.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.495+0000 7fbc31172640 1 Processor -- start 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.495+0000 7fbc31172640 1 -- start start 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc31172640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 0x7fbc2c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc31172640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc2c0c5e80 0x7fbc2c06c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc31172640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc2c0c7c10 0x7fbc2c13eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc31172640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c159aa0 con 0x7fbc2c0c7c10 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc31172640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c159e10 con 0x7fbc140039b0 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc31172640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2c0c4290 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 0x7fbc2c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2a59c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc2c0c5e80 0x7fbc2c06c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 0x7fbc2c0cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56046/0 (socket says 172.21.15.112:56046) 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2a59c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc2c0c5e80 0x7fbc2c06c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37110/0 (socket says 172.21.15.112:37110) 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2ad9d640 1 -- 172.21.15.112:0/3057776448 learned_addr learned my addr 172.21.15.112:0/3057776448 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:14.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2b59e640 1 --2- 172.21.15.112:0/3057776448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc2c0c7c10 0x7fbc2c13eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2a59c640 1 -- 172.21.15.112:0/3057776448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 msgr2=0x7fbc2c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2a59c640 1 --2- 172.21.15.112:0/3057776448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 0x7fbc2c0cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2a59c640 1 -- 172.21.15.112:0/3057776448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc2c0c7c10 msgr2=0x7fbc2c13eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2a59c640 1 --2- 172.21.15.112:0/3057776448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc2c0c7c10 0x7fbc2c13eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2a59c640 1 -- 172.21.15.112:0/3057776448 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2c155fd0 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.496+0000 7fbc2ad9d640 1 --2- 172.21.15.112:0/3057776448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 0x7fbc2c0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.497+0000 7fbc2a59c640 1 --2- 172.21.15.112:0/3057776448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc2c0c5e80 0x7fbc2c06c7a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00f920 tx=0x7fbc1c00fde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.497+0000 7fbc137fe640 1 -- 172.21.15.112:0/3057776448 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c017070 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.497+0000 7fbc137fe640 1 -- 172.21.15.112:0/3057776448 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1c004440 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.497+0000 7fbc31172640 1 -- 172.21.15.112:0/3057776448 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2c0ce470 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.497+0000 7fbc137fe640 1 -- 172.21.15.112:0/3057776448 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c00a570 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.497+0000 7fbc31172640 1 -- 172.21.15.112:0/3057776448 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc2c155a10 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.498+0000 7fbc137fe640 1 -- 172.21.15.112:0/3057776448 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbc1c01a070 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.498+0000 7fbc137fe640 1 -- 172.21.15.112:0/3057776448 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fbc1c003cf0 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.498+0000 7fbc31172640 1 -- 172.21.15.112:0/3057776448 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2c076520 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.502+0000 7fbc137fe640 1 -- 172.21.15.112:0/3057776448 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbc1c003610 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.573+0000 7fbc31172640 1 -- 172.21.15.112:0/3057776448 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d8d79c2f-4134-4bb6-915c-c500aacfe833", "id": 6} v 0) -- 0x7fbc2c0c93a0 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.580+0000 7fbc137fe640 1 -- 172.21.15.112:0/3057776448 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8d79c2f-4134-4bb6-915c-c500aacfe833", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fbc1c0037f0 con 0x7fbc2c0c5e80 2024-04-25T10:25:14.583 INFO:teuthology.orchestra.run.smithi112.stdout:6 2024-04-25T10:25:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.581+0000 7fbc31172640 1 -- 172.21.15.112:0/3057776448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc2c0c5e80 msgr2=0x7fbc2c06c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.581+0000 7fbc31172640 1 --2- 172.21.15.112:0/3057776448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc2c0c5e80 0x7fbc2c06c7a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00f920 tx=0x7fbc1c00fde0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.581+0000 7fbc31172640 1 -- 172.21.15.112:0/3057776448 shutdown_connections 2024-04-25T10:25:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.581+0000 7fbc31172640 1 --2- 172.21.15.112:0/3057776448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc2c0c7c10 0x7fbc2c13eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.581+0000 7fbc31172640 1 --2- 172.21.15.112:0/3057776448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbc2c0c5e80 0x7fbc2c06c7a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.581+0000 7fbc31172640 1 --2- 172.21.15.112:0/3057776448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc140039b0 0x7fbc2c0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.581+0000 7fbc31172640 1 -- 172.21.15.112:0/3057776448 >> 172.21.15.112:0/3057776448 conn(0x7fbc2c074880 msgr2=0x7fbc2c0c3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.581+0000 7fbc31172640 1 -- 172.21.15.112:0/3057776448 shutdown_connections 2024-04-25T10:25:14.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.581+0000 7fbc31172640 1 -- 172.21.15.112:0/3057776448 wait complete. 2024-04-25T10:25:14.594 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new d2b10694-e52d-4edc-a833-036b2a3af16e 7 2024-04-25T10:25:14.613 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:14.611+0000 7f790ee19040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T10:25:14.672 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:14.670+0000 7f790ee19040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T10:25:14.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.699+0000 7ff1d2ae9640 1 Processor -- start 2024-04-25T10:25:14.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.699+0000 7ff1d2ae9640 1 -- start start 2024-04-25T10:25:14.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1d2ae9640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15cad0 0x7ff1cc167f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1d2ae9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1cc0c9d60 con 0x7ff1cc1568d0 2024-04-25T10:25:14.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1d2ae9640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1cc0ca020 con 0x7ff1cc15c6c0 2024-04-25T10:25:14.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1d2ae9640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff1cc0b3e00 con 0x7ff1cc15cad0 2024-04-25T10:25:14.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1d1086640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15cad0 0x7ff1cc167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1cbfff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff1cc15c6c0 0x7ff1cc0cb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51278/0 (socket says 172.21.15.112:51278) 2024-04-25T10:25:14.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1cbfff640 1 -- 172.21.15.112:0/2846844533 learned_addr learned my addr 172.21.15.112:0/2846844533 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-25T10:25:14.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1cb7fe640 1 -- 172.21.15.112:0/2846844533 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600803656 0 0) 0x7ff1cc0ca020 con 0x7ff1cc15c6c0 2024-04-25T10:25:14.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1cb7fe640 1 -- 172.21.15.112:0/2846844533 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1bc003520 con 0x7ff1cc15c6c0 2024-04-25T10:25:14.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1d1086640 1 -- 172.21.15.112:0/2846844533 >> v1:172.21.15.112:6789/0 conn(0x7ff1cc15c6c0 legacy=0x7ff1cc0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1d1086640 1 -- 172.21.15.112:0/2846844533 >> v1:172.21.15.19:6789/0 conn(0x7ff1cc1568d0 legacy=0x7ff1cc0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:14.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.700+0000 7ff1d1086640 1 -- 172.21.15.112:0/2846844533 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1cc06d610 con 0x7ff1cc15cad0 2024-04-25T10:25:14.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.701+0000 7ff1d1086640 1 --2- 172.21.15.112:0/2846844533 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15cad0 0x7ff1cc167f90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc073450 tx=0x7ff1c402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae72bebfa4c9e1fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:14.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.702+0000 7ff1cb7fe640 1 -- 172.21.15.112:0/2846844533 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c402ae60 con 0x7ff1cc15cad0 2024-04-25T10:25:14.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.702+0000 7ff1cb7fe640 1 -- 172.21.15.112:0/2846844533 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c4007740 con 0x7ff1cc15cad0 2024-04-25T10:25:14.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.702+0000 7ff1cb7fe640 1 -- 172.21.15.112:0/2846844533 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4007af0 con 0x7ff1cc15cad0 2024-04-25T10:25:14.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.702+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/2846844533 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15cad0 msgr2=0x7ff1cc167f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.702+0000 7ff1d2ae9640 1 --2- 172.21.15.112:0/2846844533 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15cad0 0x7ff1cc167f90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc073450 tx=0x7ff1c402a680 comp rx=0 tx=0).stop 2024-04-25T10:25:14.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.703+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/2846844533 shutdown_connections 2024-04-25T10:25:14.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.703+0000 7ff1d2ae9640 1 --2- 172.21.15.112:0/2846844533 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15cad0 0x7ff1cc167f90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.703+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/2846844533 >> 172.21.15.112:0/2846844533 conn(0x7ff1cc072200 msgr2=0x7ff1cc072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:14.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.703+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/2846844533 shutdown_connections 2024-04-25T10:25:14.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.703+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/2846844533 wait complete. 2024-04-25T10:25:14.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.704+0000 7ff1d2ae9640 1 Processor -- start 2024-04-25T10:25:14.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.704+0000 7ff1d2ae9640 1 -- start start 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d2ae9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1cc1568d0 0x7ff1cc154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d2ae9640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15c6c0 0x7ff1cc14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d2ae9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc15cad0 0x7ff1cc15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d2ae9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc06dc60 con 0x7ff1cc1568d0 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d2ae9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc0ca300 con 0x7ff1cc15cad0 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d2ae9640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff1cc0caf70 con 0x7ff1cc15c6c0 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d1086640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc15cad0 0x7ff1cc15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1cbfff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15c6c0 0x7ff1cc14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d1086640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc15cad0 0x7ff1cc15a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56058/0 (socket says 172.21.15.112:56058) 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d1086640 1 -- 172.21.15.112:0/3380595848 learned_addr learned my addr 172.21.15.112:0/3380595848 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1cbfff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15c6c0 0x7ff1cc14bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37128/0 (socket says 172.21.15.112:37128) 2024-04-25T10:25:14.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d0885640 1 --2- 172.21.15.112:0/3380595848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1cc1568d0 0x7ff1cc154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d1086640 1 -- 172.21.15.112:0/3380595848 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15c6c0 msgr2=0x7ff1cc14bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d1086640 1 --2- 172.21.15.112:0/3380595848 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15c6c0 0x7ff1cc14bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d1086640 1 -- 172.21.15.112:0/3380595848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1cc1568d0 msgr2=0x7ff1cc154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d1086640 1 --2- 172.21.15.112:0/3380595848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1cc1568d0 0x7ff1cc154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d1086640 1 -- 172.21.15.112:0/3380595848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1cc154aa0 con 0x7ff1cc15cad0 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1cbfff640 1 --2- 172.21.15.112:0/3380595848 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15c6c0 0x7ff1cc14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1d1086640 1 --2- 172.21.15.112:0/3380595848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc15cad0 0x7ff1cc15a530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009eb0 tx=0x7ff1c4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.706+0000 7ff1c97fa640 1 -- 172.21.15.112:0/3380595848 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4040070 con 0x7ff1cc15cad0 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.707+0000 7ff1c97fa640 1 -- 172.21.15.112:0/3380595848 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c402ae60 con 0x7ff1cc15cad0 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.707+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/3380595848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1cc0c7110 con 0x7ff1cc15cad0 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.707+0000 7ff1c97fa640 1 -- 172.21.15.112:0/3380595848 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4031c60 con 0x7ff1cc15cad0 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.707+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/3380595848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1cc155e00 con 0x7ff1cc15cad0 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.707+0000 7ff1c97fa640 1 -- 172.21.15.112:0/3380595848 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff1c4039040 con 0x7ff1cc15cad0 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.707+0000 7ff1c97fa640 1 -- 172.21.15.112:0/3380595848 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff1c4044a70 con 0x7ff1cc15cad0 2024-04-25T10:25:14.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.707+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/3380595848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1cc076520 con 0x7ff1cc15cad0 2024-04-25T10:25:14.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.710+0000 7ff1c97fa640 1 -- 172.21.15.112:0/3380595848 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff1c4044410 con 0x7ff1cc15cad0 2024-04-25T10:25:14.720 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:14.718+0000 7fcca35ee040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T10:25:14.738 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:14.736+0000 7f790ee19040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T10:25:14.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.779+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/3380595848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2b10694-e52d-4edc-a833-036b2a3af16e", "id": 7} v 0) -- 0x7ff1cc0ca510 con 0x7ff1cc15cad0 2024-04-25T10:25:14.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.788+0000 7ff1c97fa640 1 -- 172.21.15.112:0/3380595848 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2b10694-e52d-4edc-a833-036b2a3af16e", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff1c40445f0 con 0x7ff1cc15cad0 2024-04-25T10:25:14.791 INFO:teuthology.orchestra.run.smithi112.stdout:7 2024-04-25T10:25:14.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.789+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/3380595848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc15cad0 msgr2=0x7ff1cc15a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:14.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.789+0000 7ff1d2ae9640 1 --2- 172.21.15.112:0/3380595848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc15cad0 0x7ff1cc15a530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009eb0 tx=0x7ff1c4004a40 comp rx=0 tx=0).stop 2024-04-25T10:25:14.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.790+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/3380595848 shutdown_connections 2024-04-25T10:25:14.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.790+0000 7ff1d2ae9640 1 --2- 172.21.15.112:0/3380595848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1cc15cad0 0x7ff1cc15a530 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.790+0000 7ff1d2ae9640 1 --2- 172.21.15.112:0/3380595848 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1cc15c6c0 0x7ff1cc14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.790+0000 7ff1d2ae9640 1 --2- 172.21.15.112:0/3380595848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1cc1568d0 0x7ff1cc154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:14.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.790+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/3380595848 >> 172.21.15.112:0/3380595848 conn(0x7ff1cc072200 msgr2=0x7ff1cc1521e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:14.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.790+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/3380595848 shutdown_connections 2024-04-25T10:25:14.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T10:25:14.790+0000 7ff1d2ae9640 1 -- 172.21.15.112:0/3380595848 wait complete. 2024-04-25T10:25:14.803 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T10:25:14.803 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T10:25:14.810 INFO:tasks.ceph.osd.0:Started 2024-04-25T10:25:14.810 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T10:25:14.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T10:25:14.817 INFO:tasks.ceph.osd.1:Started 2024-04-25T10:25:14.817 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T10:25:14.817 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T10:25:14.822 INFO:tasks.ceph.osd.2:Started 2024-04-25T10:25:14.823 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T10:25:14.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T10:25:14.829 INFO:tasks.ceph.osd.3:Started 2024-04-25T10:25:14.829 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T10:25:14.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T10:25:14.831 INFO:tasks.ceph.osd.4:Started 2024-04-25T10:25:14.832 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T10:25:14.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T10:25:14.834 INFO:tasks.ceph.osd.5:Started 2024-04-25T10:25:14.834 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T10:25:14.834 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T10:25:14.836 INFO:tasks.ceph.osd.6:Started 2024-04-25T10:25:14.836 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T10:25:14.836 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T10:25:14.838 INFO:tasks.ceph.osd.7:Started 2024-04-25T10:25:14.839 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:25:14.896 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:14.894+0000 7f790ee19040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:25:15.017 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:15.014+0000 7fcca35ee040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T10:25:15.068 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:15.065+0000 7fcca35ee040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T10:25:15.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.126+0000 7fa7ce200640 1 Processor -- start 2024-04-25T10:25:15.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.126+0000 7fa7ce200640 1 -- start start 2024-04-25T10:25:15.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.129+0000 7fa7ce200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 0x7fa7c80ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.129+0000 7fa7ce200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c80af780 con 0x7fa7c8073d50 2024-04-25T10:25:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.129+0000 7fa7ce200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c8156c60 con 0x7fa7c8156850 2024-04-25T10:25:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.129+0000 7fa7ce200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c80af1c0 con 0x7fa7c80cdde0 2024-04-25T10:25:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.129+0000 7fa7c7e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa7c8073d50 0x7fa7c8074160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52038/0 (socket says 172.21.15.19:52038) 2024-04-25T10:25:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.129+0000 7fa7c7e00640 1 -- 172.21.15.19:0/3806505743 learned_addr learned my addr 172.21.15.19:0/3806505743 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:15.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.129+0000 7fa7c6a00640 1 --2- 172.21.15.19:0/3806505743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 0x7fa7c80ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.130+0000 7fa7c6a00640 1 -- 172.21.15.19:0/3806505743 >> v1:172.21.15.112:6789/0 conn(0x7fa7c8156850 legacy=0x7fa7c815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.130+0000 7fa7c6000640 1 -- 172.21.15.19:0/3806505743 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 617048670 0 0) 0x7fa7c80af780 con 0x7fa7c8073d50 2024-04-25T10:25:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.130+0000 7fa7c6a00640 1 -- 172.21.15.19:0/3806505743 >> v1:172.21.15.19:6789/0 conn(0x7fa7c8073d50 legacy=0x7fa7c8074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:15.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.130+0000 7fa7c6a00640 1 -- 172.21.15.19:0/3806505743 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c80af4a0 con 0x7fa7c80cdde0 2024-04-25T10:25:15.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.131+0000 7fa7c6a00640 1 --2- 172.21.15.19:0/3806505743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 0x7fa7c80ce1f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40097d0 tx=0x7fa7b402a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7288211ac489edd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:15.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.131+0000 7fa7c6000640 1 -- 172.21.15.19:0/3806505743 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4037070 con 0x7fa7c80cdde0 2024-04-25T10:25:15.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.131+0000 7fa7c6000640 1 -- 172.21.15.19:0/3806505743 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b4032440 con 0x7fa7c80cdde0 2024-04-25T10:25:15.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.131+0000 7fa7c6000640 1 -- 172.21.15.19:0/3806505743 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40327f0 con 0x7fa7c80cdde0 2024-04-25T10:25:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.132+0000 7fa7ce200640 1 -- 172.21.15.19:0/3806505743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 msgr2=0x7fa7c80ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:15.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.132+0000 7fa7ce200640 1 --2- 172.21.15.19:0/3806505743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 0x7fa7c80ce1f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40097d0 tx=0x7fa7b402a290 comp rx=0 tx=0).stop 2024-04-25T10:25:15.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.133+0000 7fa7ce200640 1 -- 172.21.15.19:0/3806505743 shutdown_connections 2024-04-25T10:25:15.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.133+0000 7fa7ce200640 1 --2- 172.21.15.19:0/3806505743 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 0x7fa7c80ce1f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:15.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.133+0000 7fa7ce200640 1 -- 172.21.15.19:0/3806505743 >> 172.21.15.19:0/3806505743 conn(0x7fa7c806f1f0 msgr2=0x7fa7c806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:15.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.133+0000 7fa7ce200640 1 -- 172.21.15.19:0/3806505743 shutdown_connections 2024-04-25T10:25:15.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.133+0000 7fa7ce200640 1 -- 172.21.15.19:0/3806505743 wait complete. 2024-04-25T10:25:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.136+0000 7fa7ce200640 1 Processor -- start 2024-04-25T10:25:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.136+0000 7fa7ce200640 1 -- start start 2024-04-25T10:25:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.137+0000 7fa7ce200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c8073d50 0x7fa7c81f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7ce200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 0x7fa7c81fa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7ce200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c8156850 0x7fa7c81e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7ce200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c8073830 con 0x7fa7c8073d50 2024-04-25T10:25:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7ce200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c8073550 con 0x7fa7c8156850 2024-04-25T10:25:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7ce200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c80b0620 con 0x7fa7c80cdde0 2024-04-25T10:25:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7c6a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 0x7fa7c81fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7c6a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 0x7fa7c81fa380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:39318/0 (socket says 172.21.15.19:39318) 2024-04-25T10:25:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7c6a00640 1 -- 172.21.15.19:0/2383585261 learned_addr learned my addr 172.21.15.19:0/2383585261 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7c7400640 1 --2- 172.21.15.19:0/2383585261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c8073d50 0x7fa7c81f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:15.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7c7e00640 1 --2- 172.21.15.19:0/2383585261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c8156850 0x7fa7c81e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7c6a00640 1 -- 172.21.15.19:0/2383585261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c8156850 msgr2=0x7fa7c81e5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7c6a00640 1 --2- 172.21.15.19:0/2383585261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c8156850 0x7fa7c81e5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7c6a00640 1 -- 172.21.15.19:0/2383585261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c8073d50 msgr2=0x7fa7c81f7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7c6a00640 1 --2- 172.21.15.19:0/2383585261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c8073d50 0x7fa7c81f7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.138+0000 7fa7c6a00640 1 -- 172.21.15.19:0/2383585261 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c81f7740 con 0x7fa7c80cdde0 2024-04-25T10:25:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.139+0000 7fa7c6a00640 1 --2- 172.21.15.19:0/2383585261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 0x7fa7c81fa380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40098f0 tx=0x7fa7b40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.140+0000 7fa7bf400640 1 -- 172.21.15.19:0/2383585261 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4041070 con 0x7fa7c80cdde0 2024-04-25T10:25:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.140+0000 7fa7bf400640 1 -- 172.21.15.19:0/2383585261 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b403c890 con 0x7fa7c80cdde0 2024-04-25T10:25:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.140+0000 7fa7bf400640 1 -- 172.21.15.19:0/2383585261 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4037040 con 0x7fa7c80cdde0 2024-04-25T10:25:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.140+0000 7fa7ce200640 1 -- 172.21.15.19:0/2383585261 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c81e87f0 con 0x7fa7c80cdde0 2024-04-25T10:25:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.140+0000 7fa7ce200640 1 -- 172.21.15.19:0/2383585261 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c81f9ea0 con 0x7fa7c80cdde0 2024-04-25T10:25:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.141+0000 7fa7bf400640 1 -- 172.21.15.19:0/2383585261 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa7b4044070 con 0x7fa7c80cdde0 2024-04-25T10:25:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.141+0000 7fa7bf400640 1 -- 172.21.15.19:0/2383585261 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa7b403d3f0 con 0x7fa7c80cdde0 2024-04-25T10:25:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.142+0000 7fa7ce200640 1 -- 172.21.15.19:0/2383585261 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c81e7ca0 con 0x7fa7c80cdde0 2024-04-25T10:25:15.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.144+0000 7fa7bf400640 1 -- 172.21.15.19:0/2383585261 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa7b404b070 con 0x7fa7c80cdde0 2024-04-25T10:25:15.186 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:15.184+0000 7fcca35ee040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T10:25:15.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.210+0000 7fa7ce200640 1 -- 172.21.15.19:0/2383585261 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7c8076520 con 0x7fa7c80cdde0 2024-04-25T10:25:15.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.211+0000 7fa7bf400640 1 -- 172.21.15.19:0/2383585261 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa7c81f7740 con 0x7fa7c80cdde0 2024-04-25T10:25:15.213 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:15.213 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":10,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:14.782322+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:25:15.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.212+0000 7fa7ce200640 1 -- 172.21.15.19:0/2383585261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 msgr2=0x7fa7c81fa380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:15.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.212+0000 7fa7ce200640 1 --2- 172.21.15.19:0/2383585261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 0x7fa7c81fa380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40098f0 tx=0x7fa7b40046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:15.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.212+0000 7fa7ce200640 1 -- 172.21.15.19:0/2383585261 shutdown_connections 2024-04-25T10:25:15.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.212+0000 7fa7ce200640 1 --2- 172.21.15.19:0/2383585261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7c8156850 0x7fa7c81e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:15.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.212+0000 7fa7ce200640 1 --2- 172.21.15.19:0/2383585261 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7c80cdde0 0x7fa7c81fa380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:15.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.212+0000 7fa7ce200640 1 --2- 172.21.15.19:0/2383585261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7c8073d50 0x7fa7c81f7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:15.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.212+0000 7fa7ce200640 1 -- 172.21.15.19:0/2383585261 >> 172.21.15.19:0/2383585261 conn(0x7fa7c806f1f0 msgr2=0x7fa7c814f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:15.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.212+0000 7fa7ce200640 1 -- 172.21.15.19:0/2383585261 shutdown_connections 2024-04-25T10:25:15.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:15.212+0000 7fa7ce200640 1 -- 172.21.15.19:0/2383585261 wait complete. 2024-04-25T10:25:15.235 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T10:25:15.235 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T10:25:15.420 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-04-25T10:25:15.419+0000 7f1d2341b640 -1 Falling back to public interface 2024-04-25T10:25:15.433 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:15.432+0000 7f790ee19040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T10:25:15.461 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-25T10:25:15.459+0000 7f8280914640 -1 Falling back to public interface 2024-04-25T10:25:15.462 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-25T10:25:15.459+0000 7f0d35cb5640 -1 Falling back to public interface 2024-04-25T10:25:15.462 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-25T10:25:15.459+0000 7f0d34c64640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-25T10:25:15.462 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-25T10:25:15.459+0000 7f0d34c64640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-25T10:25:15.466 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:15.464+0000 7fcca35ee040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T10:25:15.470 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-25T10:25:15.467+0000 7f04e9cdb640 -1 Falling back to public interface 2024-04-25T10:25:15.470 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-25T10:25:15.467+0000 7f907c3b1640 -1 Falling back to public interface 2024-04-25T10:25:15.517 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:15.515+0000 7fcca35ee040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T10:25:15.641 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-04-25T10:25:15.639+0000 7f8e47a16640 -1 Falling back to public interface 2024-04-25T10:25:15.670 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-04-25T10:25:15.669+0000 7f157ac31640 -1 Falling back to public interface 2024-04-25T10:25:15.671 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:15.668+0000 7fcca35ee040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T10:25:15.683 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-04-25T10:25:15.682+0000 7fb00a7b1640 -1 Falling back to public interface 2024-04-25T10:25:15.752 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:15.750+0000 7f790ee19040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T10:25:15.806 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:15.804+0000 7fcca35ee040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T10:25:15.816 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:15.814+0000 7f790ee19040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T10:25:15.855 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:15.853+0000 7fcca35ee040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T10:25:15.923 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:15.921+0000 7fcca35ee040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T10:25:15.956 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:15.954+0000 7f790ee19040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T10:25:15.968 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:15.965+0000 7fcca35ee040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T10:25:16.042 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:25:16.279 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.277+0000 7fe96c800640 1 Processor -- start 2024-04-25T10:25:16.279 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.277+0000 7fe96c800640 1 -- start start 2024-04-25T10:25:16.282 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.279+0000 7fe96c800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe9640c4c00 0x7fe9641545d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:16.282 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.279+0000 7fe96c800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9640b2ec0 0x7fe9640b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:16.282 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.279+0000 7fe96c800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9640c8280 con 0x7fe964071640 2024-04-25T10:25:16.282 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.279+0000 7fe96c800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe9640c94e0 con 0x7fe9640c4c00 2024-04-25T10:25:16.282 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.279+0000 7fe96c800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe9640c8560 con 0x7fe9640b2ec0 2024-04-25T10:25:16.282 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.280+0000 7fe96a800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9640b2ec0 0x7fe9640b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:16.282 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.280+0000 7fe969400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe9640c4c00 0x7fe9641545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:16.282 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.280+0000 7fe969e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe964071640 0x7fe9640c9970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52050/0 (socket says 172.21.15.19:52050) 2024-04-25T10:25:16.282 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.280+0000 7fe969e00640 1 -- 172.21.15.19:0/2324222675 learned_addr learned my addr 172.21.15.19:0/2324222675 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:16.282 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.280+0000 7fe969400640 1 -- 172.21.15.19:0/2324222675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9640b2ec0 msgr2=0x7fe9640b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:16.282 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.280+0000 7fe969400640 1 --2- 172.21.15.19:0/2324222675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9640b2ec0 0x7fe9640b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:16.283 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.280+0000 7fe969400640 1 -- 172.21.15.19:0/2324222675 >> v1:172.21.15.19:6789/0 conn(0x7fe964071640 legacy=0x7fe9640c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:16.283 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.280+0000 7fe969400640 1 -- 172.21.15.19:0/2324222675 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9640744e0 con 0x7fe9640c4c00 2024-04-25T10:25:16.283 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.280+0000 7fe96a800640 1 --2- 172.21.15.19:0/2324222675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9640b2ec0 0x7fe9640b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:16.284 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.281+0000 7fe969400640 1 --2- 172.21.15.19:0/2324222675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9640c4c00 0x7fe9641545d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe9540097a0 tx=0x7fe95402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba839f7ac4aad710 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:16.284 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.281+0000 7fe968a00640 1 -- 172.21.15.19:0/2324222675 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954037070 con 0x7fe9640c4c00 2024-04-25T10:25:16.284 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.281+0000 7fe968a00640 1 -- 172.21.15.19:0/2324222675 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe954032440 con 0x7fe9640c4c00 2024-04-25T10:25:16.284 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.281+0000 7fe968a00640 1 -- 172.21.15.19:0/2324222675 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954032810 con 0x7fe9640c4c00 2024-04-25T10:25:16.284 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.282+0000 7fe96c800640 1 -- 172.21.15.19:0/2324222675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9640c4c00 msgr2=0x7fe9641545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:16.284 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.282+0000 7fe96c800640 1 --2- 172.21.15.19:0/2324222675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9640c4c00 0x7fe9641545d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe9540097a0 tx=0x7fe95402a180 comp rx=0 tx=0).stop 2024-04-25T10:25:16.284 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.282+0000 7fe96c800640 1 -- 172.21.15.19:0/2324222675 shutdown_connections 2024-04-25T10:25:16.284 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.282+0000 7fe96c800640 1 --2- 172.21.15.19:0/2324222675 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9640b2ec0 0x7fe9640b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:16.284 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.282+0000 7fe96c800640 1 --2- 172.21.15.19:0/2324222675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9640c4c00 0x7fe9641545d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:16.284 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.282+0000 7fe96c800640 1 -- 172.21.15.19:0/2324222675 >> 172.21.15.19:0/2324222675 conn(0x7fe964070b20 msgr2=0x7fe964070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:16.285 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.282+0000 7fe96c800640 1 -- 172.21.15.19:0/2324222675 shutdown_connections 2024-04-25T10:25:16.285 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.282+0000 7fe96c800640 1 -- 172.21.15.19:0/2324222675 wait complete. 2024-04-25T10:25:16.286 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.284+0000 7fe96c800640 1 Processor -- start 2024-04-25T10:25:16.286 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.284+0000 7fe96c800640 1 -- start start 2024-04-25T10:25:16.289 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe96c800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9640b2ec0 0x7fe9641f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:16.289 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe96c800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9640c4c00 0x7fe96414b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:16.289 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe96c800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe96414b320 0x7fe964150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe96c800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe9640731a0 con 0x7fe96414b320 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe96c800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe964074aa0 con 0x7fe9640c4c00 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe96c800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe964154b10 con 0x7fe9640b2ec0 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe969400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9640c4c00 0x7fe96414b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe969400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9640c4c00 0x7fe96414b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:49372/0 (socket says 172.21.15.19:49372) 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe969400640 1 -- 172.21.15.19:0/4047402069 learned_addr learned my addr 172.21.15.19:0/4047402069 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe96a800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe96414b320 0x7fe964150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe969e00640 1 --2- 172.21.15.19:0/4047402069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9640b2ec0 0x7fe9641f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe969400640 1 -- 172.21.15.19:0/4047402069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9640b2ec0 msgr2=0x7fe9641f0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe969400640 1 --2- 172.21.15.19:0/4047402069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9640b2ec0 0x7fe9641f0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.286+0000 7fe969400640 1 -- 172.21.15.19:0/4047402069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe96414b320 msgr2=0x7fe964150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.287+0000 7fe969400640 1 --2- 172.21.15.19:0/4047402069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe96414b320 0x7fe964150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:16.290 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.287+0000 7fe969400640 1 -- 172.21.15.19:0/4047402069 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96414bdd0 con 0x7fe9640c4c00 2024-04-25T10:25:16.291 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.287+0000 7fe969400640 1 --2- 172.21.15.19:0/4047402069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9640c4c00 0x7fe96414b890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe954035040 tx=0x7fe9540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:16.291 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.287+0000 7fe95e000640 1 -- 172.21.15.19:0/4047402069 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954037040 con 0x7fe9640c4c00 2024-04-25T10:25:16.291 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.287+0000 7fe95e000640 1 -- 172.21.15.19:0/4047402069 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe954030440 con 0x7fe9640c4c00 2024-04-25T10:25:16.291 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.287+0000 7fe96c800640 1 -- 172.21.15.19:0/4047402069 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9641f38c0 con 0x7fe9640c4c00 2024-04-25T10:25:16.291 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.287+0000 7fe95e000640 1 -- 172.21.15.19:0/4047402069 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954030850 con 0x7fe9640c4c00 2024-04-25T10:25:16.291 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.287+0000 7fe96c800640 1 -- 172.21.15.19:0/4047402069 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9641f3e80 con 0x7fe9640c4c00 2024-04-25T10:25:16.291 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.288+0000 7fe95e000640 1 -- 172.21.15.19:0/4047402069 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe954044020 con 0x7fe9640c4c00 2024-04-25T10:25:16.291 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.288+0000 7fe95e000640 1 -- 172.21.15.19:0/4047402069 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fe95403bc00 con 0x7fe9640c4c00 2024-04-25T10:25:16.291 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.288+0000 7fe96c800640 1 -- 172.21.15.19:0/4047402069 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe964076570 con 0x7fe9640c4c00 2024-04-25T10:25:16.293 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.291+0000 7fe95e000640 1 -- 172.21.15.19:0/4047402069 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe95403be00 con 0x7fe9640c4c00 2024-04-25T10:25:16.310 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:16.308+0000 7f790ee19040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T10:25:16.360 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.358+0000 7fe96c800640 1 -- 172.21.15.19:0/4047402069 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe964069d90 con 0x7fe9640c4c00 2024-04-25T10:25:16.361 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.359+0000 7fe95e000640 1 -- 172.21.15.19:0/4047402069 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fe95403b430 con 0x7fe9640c4c00 2024-04-25T10:25:16.361 INFO:teuthology.misc.health.smithi019.stdout: 2024-04-25T10:25:16.361 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":10,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:14.782322+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:25:16.363 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.361+0000 7fe96c800640 1 -- 172.21.15.19:0/4047402069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9640c4c00 msgr2=0x7fe96414b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:16.363 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.361+0000 7fe96c800640 1 --2- 172.21.15.19:0/4047402069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9640c4c00 0x7fe96414b890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe954035040 tx=0x7fe9540046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:16.363 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.361+0000 7fe96c800640 1 -- 172.21.15.19:0/4047402069 shutdown_connections 2024-04-25T10:25:16.363 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.361+0000 7fe96c800640 1 --2- 172.21.15.19:0/4047402069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe96414b320 0x7fe964150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:16.363 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.361+0000 7fe96c800640 1 --2- 172.21.15.19:0/4047402069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9640c4c00 0x7fe96414b890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:16.363 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.361+0000 7fe96c800640 1 --2- 172.21.15.19:0/4047402069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9640b2ec0 0x7fe9641f0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:16.363 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.361+0000 7fe96c800640 1 -- 172.21.15.19:0/4047402069 >> 172.21.15.19:0/4047402069 conn(0x7fe964070b20 msgr2=0x7fe9640cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:16.363 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.361+0000 7fe96c800640 1 -- 172.21.15.19:0/4047402069 shutdown_connections 2024-04-25T10:25:16.363 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:16.361+0000 7fe96c800640 1 -- 172.21.15.19:0/4047402069 wait complete. 2024-04-25T10:25:16.370 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:16.368+0000 7f790ee19040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T10:25:16.381 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T10:25:16.446 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:16.444+0000 7fcca35ee040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T10:25:16.561 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:16.559+0000 7fcca35ee040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T10:25:16.566 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:16.564+0000 7f790ee19040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T10:25:16.750 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:16.748+0000 7f790ee19040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T10:25:16.813 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:16.811+0000 7f790ee19040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T10:25:16.899 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:16.897+0000 7f790ee19040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T10:25:16.955 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:16.953+0000 7f790ee19040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T10:25:17.527 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:17.525+0000 7f790ee19040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T10:25:17.584 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:17.581+0000 7fcc4407a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T10:25:17.584 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-25T10:25:17.582+0000 7fcc4407a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T10:25:17.668 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-04-25T10:25:17.666+0000 7f790ee19040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T10:25:18.933 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-25T10:25:18.931+0000 7f0d35cb5640 -1 osd.7 0 log_to_monitors true 2024-04-25T10:25:18.982 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-25T10:25:18.980+0000 7f04e9cdb640 -1 osd.6 0 log_to_monitors true 2024-04-25T10:25:18.987 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-25T10:25:18.985+0000 7f8280914640 -1 osd.4 0 log_to_monitors true 2024-04-25T10:25:19.001 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-25T10:25:18.999+0000 7f907c3b1640 -1 osd.5 0 log_to_monitors true 2024-04-25T10:25:19.023 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-04-25T10:25:19.022+0000 7f1d2341b640 -1 osd.3 0 log_to_monitors true 2024-04-25T10:25:19.305 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-04-25T10:25:19.303+0000 7f8e47a16640 -1 osd.1 0 log_to_monitors true 2024-04-25T10:25:19.333 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-04-25T10:25:19.332+0000 7f157ac31640 -1 osd.2 0 log_to_monitors true 2024-04-25T10:25:19.343 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-04-25T10:25:19.341+0000 7fb00a7b1640 -1 osd.0 0 log_to_monitors true 2024-04-25T10:25:22.750 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-25T10:25:22.746+0000 7f9078347640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T10:25:22.764 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-25T10:25:22.762+0000 7f9070142640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:25:22.768 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-25T10:25:22.766+0000 7f827c8aa640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T10:25:22.779 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-25T10:25:22.777+0000 7f0d31c4b640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T10:25:22.786 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-25T10:25:22.784+0000 7f82746a5640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:25:22.791 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-25T10:25:22.789+0000 7f0d29a46640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:25:22.825 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-25T10:25:22.823+0000 7f04e5c71640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T10:25:22.836 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-25T10:25:22.834+0000 7f04dda6c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:25:23.140 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-04-25T10:25:23.138+0000 7f1575000640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T10:25:23.150 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-04-25T10:25:23.149+0000 7f156b000640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:25:23.169 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-04-25T10:25:23.167+0000 7f8e42c00640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T10:25:23.177 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-04-25T10:25:23.176+0000 7f1d1ec00640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T10:25:23.179 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-04-25T10:25:23.177+0000 7f8e38200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:25:23.188 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-04-25T10:25:23.187+0000 7f1d14200640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:25:23.188 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:25:23.227 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-04-25T10:25:23.226+0000 7fb005600640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T10:25:23.232 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-04-25T10:25:23.230+0000 7faffb600640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:25:23.407 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.405+0000 7f5687e00640 1 Processor -- start 2024-04-25T10:25:23.407 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.405+0000 7f5687e00640 1 -- start start 2024-04-25T10:25:23.409 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.407+0000 7f5687e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f56880cddb0 0x7f5688156a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:23.409 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.407+0000 7f5687e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56880cc890 0x7f568806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:23.409 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5687e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56880ccd80 con 0x7f56880cc480 2024-04-25T10:25:23.410 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5687e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f568815d360 con 0x7f56880cc890 2024-04-25T10:25:23.410 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5687e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f568815c750 con 0x7f56880cddb0 2024-04-25T10:25:23.410 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5686a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f56880cddb0 0x7f5688156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:23.410 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5687400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56880cc890 0x7f568806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:23.410 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5686a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f56880cddb0 0x7f5688156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:54062/0 (socket says 172.21.15.19:54062) 2024-04-25T10:25:23.410 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5686a00640 1 -- 172.21.15.19:0/335890664 learned_addr learned my addr 172.21.15.19:0/335890664 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:23.410 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5687400640 1 -- 172.21.15.19:0/335890664 >> v2:172.21.15.112:3300/0 conn(0x7f56880cddb0 msgr2=0x7f5688156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:23.411 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5685600640 1 -- 172.21.15.19:0/335890664 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864996921 0 0) 0x7f56880ccd80 con 0x7f56880cc480 2024-04-25T10:25:23.411 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5687400640 1 --2- 172.21.15.19:0/335890664 >> v2:172.21.15.112:3300/0 conn(0x7f56880cddb0 0x7f5688156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:23.411 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5687400640 1 -- 172.21.15.19:0/335890664 >> v1:172.21.15.112:6789/0 conn(0x7f56880cc480 legacy=0x7f56880ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:23.411 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5687400640 1 -- 172.21.15.19:0/335890664 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568815ca30 con 0x7f56880cc890 2024-04-25T10:25:23.411 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.408+0000 7f5686a00640 1 --2- 172.21.15.19:0/335890664 >> v2:172.21.15.112:3300/0 conn(0x7f56880cddb0 0x7f5688156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:23.412 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.409+0000 7f5687400640 1 --2- 172.21.15.19:0/335890664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56880cc890 0x7f568806dd10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56880d2a00 tx=0x7f568002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22c9ea2b616bc9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:23.412 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.410+0000 7f5685600640 1 -- 172.21.15.19:0/335890664 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680007740 con 0x7f56880cc890 2024-04-25T10:25:23.412 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.410+0000 7f5685600640 1 -- 172.21.15.19:0/335890664 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56800078e0 con 0x7f56880cc890 2024-04-25T10:25:23.412 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.410+0000 7f5685600640 1 -- 172.21.15.19:0/335890664 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680007cb0 con 0x7f56880cc890 2024-04-25T10:25:23.412 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.410+0000 7f5687e00640 1 -- 172.21.15.19:0/335890664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56880cc890 msgr2=0x7f568806dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:23.412 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.410+0000 7f5687e00640 1 --2- 172.21.15.19:0/335890664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56880cc890 0x7f568806dd10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56880d2a00 tx=0x7f568002a710 comp rx=0 tx=0).stop 2024-04-25T10:25:23.412 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.410+0000 7f5687e00640 1 -- 172.21.15.19:0/335890664 shutdown_connections 2024-04-25T10:25:23.413 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.410+0000 7f5687e00640 1 --2- 172.21.15.19:0/335890664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56880cc890 0x7f568806dd10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:23.413 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.410+0000 7f5687e00640 1 --2- 172.21.15.19:0/335890664 >> v2:172.21.15.112:3300/0 conn(0x7f56880cddb0 0x7f5688156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:23.413 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.410+0000 7f5687e00640 1 -- 172.21.15.19:0/335890664 >> 172.21.15.19:0/335890664 conn(0x7f5688073cf0 msgr2=0x7f5688074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:23.413 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.411+0000 7f5687e00640 1 -- 172.21.15.19:0/335890664 shutdown_connections 2024-04-25T10:25:23.413 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.411+0000 7f5687e00640 1 -- 172.21.15.19:0/335890664 wait complete. 2024-04-25T10:25:23.414 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.413+0000 7f5687e00640 1 Processor -- start 2024-04-25T10:25:23.414 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.413+0000 7f5687e00640 1 -- start start 2024-04-25T10:25:23.417 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.414+0000 7f5687e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56880cc480 0x7f56881e9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:23.418 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.414+0000 7f5687e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56880cc890 0x7f568815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:23.418 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.414+0000 7f5687e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56880cddb0 0x7f56881e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:23.418 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.414+0000 7f5687e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f56880b6c10 con 0x7f56880cddb0 2024-04-25T10:25:23.418 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.414+0000 7f5687e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f568815cff0 con 0x7f56880cc890 2024-04-25T10:25:23.418 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.414+0000 7f5687e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f56880ce9f0 con 0x7f56880cc480 2024-04-25T10:25:23.418 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.414+0000 7f5687400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56880cddb0 0x7f56881e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:23.418 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5686a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56880cc480 0x7f56881e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:23.418 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5687400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56880cddb0 0x7f56881e5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54458/0 (socket says 172.21.15.19:54458) 2024-04-25T10:25:23.418 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5686a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56880cc480 0x7f56881e9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:38336/0 (socket says 172.21.15.19:38336) 2024-04-25T10:25:23.418 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5687400640 1 -- 172.21.15.19:0/1895826503 learned_addr learned my addr 172.21.15.19:0/1895826503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:23.418 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5686000640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56880cc890 0x7f568815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5686a00640 1 -- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56880cc890 msgr2=0x7f568815ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5686a00640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56880cc890 0x7f568815ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5686a00640 1 -- 172.21.15.19:0/1895826503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56880cddb0 msgr2=0x7f56881e5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5686a00640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56880cddb0 0x7f56881e5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5686a00640 1 -- 172.21.15.19:0/1895826503 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56881606f0 con 0x7f56880cc480 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5686000640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56880cc890 0x7f568815ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5687400640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56880cddb0 0x7f56881e5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.415+0000 7f5686a00640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56880cc480 0x7f56881e9480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f567800e860 tx=0x7f567800ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.416+0000 7f567ea00640 1 -- 172.21.15.19:0/1895826503 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678004030 con 0x7f56880cc480 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.416+0000 7f567ea00640 1 -- 172.21.15.19:0/1895826503 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56780041d0 con 0x7f56880cc480 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.416+0000 7f567ea00640 1 -- 172.21.15.19:0/1895826503 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567800c940 con 0x7f56880cc480 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.416+0000 7f5687e00640 1 -- 172.21.15.19:0/1895826503 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56881e7710 con 0x7f56880cc480 2024-04-25T10:25:23.419 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.416+0000 7f5687e00640 1 -- 172.21.15.19:0/1895826503 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f568815fa80 con 0x7f56880cc480 2024-04-25T10:25:23.420 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.417+0000 7f5687e00640 1 -- 172.21.15.19:0/1895826503 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56880b6790 con 0x7f56880cc480 2024-04-25T10:25:23.420 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.418+0000 7f567ea00640 1 -- 172.21.15.19:0/1895826503 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7f567800cae0 con 0x7f56880cc480 2024-04-25T10:25:23.420 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.419+0000 7f567ea00640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f56680744a0 0x7f56680769b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:23.421 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.419+0000 7f567ea00640 1 -- 172.21.15.19:0/1895826503 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f5678094570 con 0x7f56880cc480 2024-04-25T10:25:23.421 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.419+0000 7f5686000640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f56680744a0 0x7f56680769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:23.421 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.420+0000 7f5686000640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f56680744a0 0x7f56680769b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f56880b6110 tx=0x7f5674009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:23.425 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.424+0000 7f567ea00640 1 -- 172.21.15.19:0/1895826503 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f56880b6790 con 0x7f56880cc480 2024-04-25T10:25:23.622 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.620+0000 7f5687e00640 1 -- 172.21.15.19:0/1895826503 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5688076570 con 0x7f56880cc480 2024-04-25T10:25:23.623 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.621+0000 7f567ea00640 1 -- 172.21.15.19:0/1895826503 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f5678017020 con 0x7f56880cc480 2024-04-25T10:25:23.623 INFO:teuthology.misc.health.smithi019.stdout: 2024-04-25T10:25:23.623 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":12,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:20.600007+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:25:23.626 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.624+0000 7f5687e00640 1 -- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f56680744a0 msgr2=0x7f56680769b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:23.626 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.624+0000 7f5687e00640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f56680744a0 0x7f56680769b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f56880b6110 tx=0x7f5674009040 comp rx=0 tx=0).stop 2024-04-25T10:25:23.627 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.624+0000 7f5687e00640 1 -- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56880cc480 msgr2=0x7f56881e9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:23.627 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.624+0000 7f5687e00640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56880cc480 0x7f56881e9480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f567800e860 tx=0x7f567800ed20 comp rx=0 tx=0).stop 2024-04-25T10:25:23.627 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.625+0000 7f5687e00640 1 -- 172.21.15.19:0/1895826503 shutdown_connections 2024-04-25T10:25:23.627 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.625+0000 7f5687e00640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56880cddb0 0x7f56881e5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:23.627 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.625+0000 7f5687e00640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56880cc890 0x7f568815ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:23.627 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.625+0000 7f5687e00640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f56680744a0 0x7f56680769b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:23.627 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.625+0000 7f5687e00640 1 --2- 172.21.15.19:0/1895826503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56880cc480 0x7f56881e9480 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:23.627 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.625+0000 7f5687e00640 1 -- 172.21.15.19:0/1895826503 >> 172.21.15.19:0/1895826503 conn(0x7f5688073cf0 msgr2=0x7f56880cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:23.627 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.625+0000 7f5687e00640 1 -- 172.21.15.19:0/1895826503 shutdown_connections 2024-04-25T10:25:23.627 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:23.625+0000 7f5687e00640 1 -- 172.21.15.19:0/1895826503 wait complete. 2024-04-25T10:25:23.648 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T10:25:29.320 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:25:29.328 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:25:30.455 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:25:30.724 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.722+0000 7eff41e00640 1 Processor -- start 2024-04-25T10:25:30.724 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.722+0000 7eff41e00640 1 -- start start 2024-04-25T10:25:30.726 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.724+0000 7eff41e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7eff3c071640 0x7eff3c0c9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:30.727 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.724+0000 7eff41e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0c4c00 0x7eff3c1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:30.727 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff41e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7eff3c0b2ec0 0x7eff3c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:30.727 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff41e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7eff3c0c94e0 con 0x7eff3c071640 2024-04-25T10:25:30.727 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff41e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7eff3c0c8280 con 0x7eff3c0b2ec0 2024-04-25T10:25:30.727 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff41e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7eff3c0c8560 con 0x7eff3c0c4c00 2024-04-25T10:25:30.727 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff3a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0c4c00 0x7eff3c1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:30.727 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff3aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7eff3c071640 0x7eff3c0c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:30.727 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff3b400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7eff3c0b2ec0 0x7eff3c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:30.727 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff3a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0c4c00 0x7eff3c1545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:54808/0 (socket says 172.21.15.19:54808) 2024-04-25T10:25:30.727 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff3aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7eff3c071640 0x7eff3c0c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48840/0 (socket says 172.21.15.19:48840) 2024-04-25T10:25:30.727 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff3a000640 1 -- 172.21.15.19:0/371710068 learned_addr learned my addr 172.21.15.19:0/371710068 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:30.728 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff3aa00640 1 -- 172.21.15.19:0/371710068 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0c4c00 msgr2=0x7eff3c1545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:30.728 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff3aa00640 1 --2- 172.21.15.19:0/371710068 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0c4c00 0x7eff3c1545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:30.728 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff3aa00640 1 -- 172.21.15.19:0/371710068 >> v2:172.21.15.112:3300/0 conn(0x7eff3c0b2ec0 msgr2=0x7eff3c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:30.728 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff3aa00640 1 --2- 172.21.15.19:0/371710068 >> v2:172.21.15.112:3300/0 conn(0x7eff3c0b2ec0 0x7eff3c0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:30.728 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.725+0000 7eff3aa00640 1 -- 172.21.15.19:0/371710068 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3c0744e0 con 0x7eff3c071640 2024-04-25T10:25:30.728 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.726+0000 7eff3aa00640 1 --2- 172.21.15.19:0/371710068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3c071640 0x7eff3c0c9970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff3c072530 tx=0x7eff2c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d63619cd9d04b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:30.729 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.727+0000 7eff39600640 1 -- 172.21.15.19:0/371710068 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c037070 con 0x7eff3c071640 2024-04-25T10:25:30.730 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.727+0000 7eff39600640 1 -- 172.21.15.19:0/371710068 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2c02ae50 con 0x7eff3c071640 2024-04-25T10:25:30.730 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.727+0000 7eff39600640 1 -- 172.21.15.19:0/371710068 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c032660 con 0x7eff3c071640 2024-04-25T10:25:30.730 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.727+0000 7eff41e00640 1 -- 172.21.15.19:0/371710068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3c071640 msgr2=0x7eff3c0c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:30.730 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.728+0000 7eff41e00640 1 --2- 172.21.15.19:0/371710068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3c071640 0x7eff3c0c9970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff3c072530 tx=0x7eff2c02a100 comp rx=0 tx=0).stop 2024-04-25T10:25:30.730 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.728+0000 7eff41e00640 1 -- 172.21.15.19:0/371710068 shutdown_connections 2024-04-25T10:25:30.730 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.728+0000 7eff41e00640 1 --2- 172.21.15.19:0/371710068 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0c4c00 0x7eff3c1545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:30.730 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.728+0000 7eff41e00640 1 --2- 172.21.15.19:0/371710068 >> v2:172.21.15.112:3300/0 conn(0x7eff3c0b2ec0 0x7eff3c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:30.730 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.728+0000 7eff41e00640 1 --2- 172.21.15.19:0/371710068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3c071640 0x7eff3c0c9970 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:30.730 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.728+0000 7eff41e00640 1 -- 172.21.15.19:0/371710068 >> 172.21.15.19:0/371710068 conn(0x7eff3c070b20 msgr2=0x7eff3c070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:30.730 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.728+0000 7eff41e00640 1 -- 172.21.15.19:0/371710068 shutdown_connections 2024-04-25T10:25:30.730 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.728+0000 7eff41e00640 1 -- 172.21.15.19:0/371710068 wait complete. 2024-04-25T10:25:30.732 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.730+0000 7eff41e00640 1 Processor -- start 2024-04-25T10:25:30.732 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.730+0000 7eff41e00640 1 -- start start 2024-04-25T10:25:30.734 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff41e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0b2ec0 0x7eff3c14a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:30.734 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff41e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0c4c00 0x7eff3c14cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:30.734 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff41e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3c14b2d0 0x7eff3c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:30.734 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff41e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c0c9eb0 con 0x7eff3c14b2d0 2024-04-25T10:25:30.734 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff41e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c074aa0 con 0x7eff3c0c4c00 2024-04-25T10:25:30.734 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff41e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7eff3c0731a0 con 0x7eff3c0b2ec0 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff3b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3c14b2d0 0x7eff3c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff3aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0b2ec0 0x7eff3c14a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff3a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0c4c00 0x7eff3c14cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff3aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0b2ec0 0x7eff3c14a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:54820/0 (socket says 172.21.15.19:54820) 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff3a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0c4c00 0x7eff3c14cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:58204/0 (socket says 172.21.15.19:58204) 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.732+0000 7eff3aa00640 1 -- 172.21.15.19:0/2444318489 learned_addr learned my addr 172.21.15.19:0/2444318489 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff3b400640 1 -- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0b2ec0 msgr2=0x7eff3c14a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff3b400640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0b2ec0 0x7eff3c14a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff3b400640 1 -- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0c4c00 msgr2=0x7eff3c14cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff3b400640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0c4c00 0x7eff3c14cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff3b400640 1 -- 172.21.15.19:0/2444318489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3c14d250 con 0x7eff3c14b2d0 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff3aa00640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0b2ec0 0x7eff3c14a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:30.735 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff3a000640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0c4c00 0x7eff3c14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:30.736 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff3b400640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3c14b2d0 0x7eff3c0cc980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0c8860 tx=0x7eff3400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:30.736 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff33400640 1 -- 172.21.15.19:0/2444318489 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34018020 con 0x7eff3c14b2d0 2024-04-25T10:25:30.736 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff33400640 1 -- 172.21.15.19:0/2444318489 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3400bb20 con 0x7eff3c14b2d0 2024-04-25T10:25:30.736 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff33400640 1 -- 172.21.15.19:0/2444318489 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34014400 con 0x7eff3c14b2d0 2024-04-25T10:25:30.737 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff41e00640 1 -- 172.21.15.19:0/2444318489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3c158920 con 0x7eff3c14b2d0 2024-04-25T10:25:30.737 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.733+0000 7eff41e00640 1 -- 172.21.15.19:0/2444318489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3c06f9f0 con 0x7eff3c14b2d0 2024-04-25T10:25:30.737 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.735+0000 7eff41e00640 1 -- 172.21.15.19:0/2444318489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff3c14d420 con 0x7eff3c14b2d0 2024-04-25T10:25:30.737 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.736+0000 7eff33400640 1 -- 172.21.15.19:0/2444318489 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7eff34005d10 con 0x7eff3c14b2d0 2024-04-25T10:25:30.739 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.737+0000 7eff33400640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff1c0744e0 0x7eff1c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:30.739 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.737+0000 7eff33400640 1 -- 172.21.15.19:0/2444318489 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7eff340954e0 con 0x7eff3c14b2d0 2024-04-25T10:25:30.739 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.738+0000 7eff3aa00640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff1c0744e0 0x7eff1c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:30.740 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.738+0000 7eff3aa00640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff1c0744e0 0x7eff1c0769f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009560 tx=0x7eff2c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:30.745 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.743+0000 7eff33400640 1 -- 172.21.15.19:0/2444318489 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7eff34022030 con 0x7eff3c14b2d0 2024-04-25T10:25:30.951 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.949+0000 7eff41e00640 1 -- 172.21.15.19:0/2444318489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff3c14c670 con 0x7eff3c14b2d0 2024-04-25T10:25:30.952 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.950+0000 7eff33400640 1 -- 172.21.15.19:0/2444318489 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7eff3405f960 con 0x7eff3c14b2d0 2024-04-25T10:25:30.952 INFO:teuthology.misc.health.smithi019.stdout: 2024-04-25T10:25:30.953 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":16,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:26.797583+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:25:30.955 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.953+0000 7eff41e00640 1 -- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff1c0744e0 msgr2=0x7eff1c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:30.955 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.953+0000 7eff41e00640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff1c0744e0 0x7eff1c0769f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009560 tx=0x7eff2c02e000 comp rx=0 tx=0).stop 2024-04-25T10:25:30.955 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.953+0000 7eff41e00640 1 -- 172.21.15.19:0/2444318489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3c14b2d0 msgr2=0x7eff3c0cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:30.955 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.953+0000 7eff41e00640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3c14b2d0 0x7eff3c0cc980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0c8860 tx=0x7eff3400ef10 comp rx=0 tx=0).stop 2024-04-25T10:25:30.955 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.953+0000 7eff41e00640 1 -- 172.21.15.19:0/2444318489 shutdown_connections 2024-04-25T10:25:30.955 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.953+0000 7eff41e00640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff3c14b2d0 0x7eff3c0cc980 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:30.956 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.953+0000 7eff41e00640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff3c0c4c00 0x7eff3c14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:30.956 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.953+0000 7eff41e00640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff1c0744e0 0x7eff1c0769f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:30.956 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.953+0000 7eff41e00640 1 --2- 172.21.15.19:0/2444318489 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7eff3c0b2ec0 0x7eff3c14a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:30.956 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.953+0000 7eff41e00640 1 -- 172.21.15.19:0/2444318489 >> 172.21.15.19:0/2444318489 conn(0x7eff3c070b20 msgr2=0x7eff3c06f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:30.956 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.953+0000 7eff41e00640 1 -- 172.21.15.19:0/2444318489 shutdown_connections 2024-04-25T10:25:30.956 INFO:teuthology.misc.health.smithi019.stderr:2024-04-25T10:25:30.954+0000 7eff41e00640 1 -- 172.21.15.19:0/2444318489 wait complete. 2024-04-25T10:25:30.978 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T10:25:30.979 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T10:25:30.979 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:25:30.979 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:25:30.986 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:25:30.987 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:25:30.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:25:30.994 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:25:30.994 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-25T10:25:30.994 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-25T10:25:30.999 INFO:tasks.ceph.mds.e:Started 2024-04-25T10:25:30.999 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:25:30.999 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:25:31.002 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:25:31.002 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:25:31.002 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:25:31.004 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:25:31.005 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-25T10:25:31.005 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-25T10:25:31.007 INFO:tasks.ceph.mds.f:Started 2024-04-25T10:25:31.007 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T10:25:31.008 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:25:31.099 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2024-04-25T10:25:31.100 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2024-04-25T10:25:31.102 INFO:tasks.ceph.mds.f.smithi112.stdout:starting mds.f at 2024-04-25T10:25:31.229 INFO:tasks.ceph.mds.e.smithi019.stdout:starting mds.e at 2024-04-25T10:25:31.241 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-04-25T10:25:31.246 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-04-25T10:25:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.269+0000 7f8e64a00640 1 Processor -- start 2024-04-25T10:25:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.270+0000 7f8e64a00640 1 -- start start 2024-04-25T10:25:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.271+0000 7f8e64a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8e6015b2c0 0x7f8e600c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.271+0000 7f8e64a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8e600cdde0 0x7f8e600ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.271+0000 7f8e64a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e60158010 con 0x7f8e60073160 2024-04-25T10:25:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.271+0000 7f8e64a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8e60074970 con 0x7f8e6015b2c0 2024-04-25T10:25:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.271+0000 7f8e64a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8e600c8600 con 0x7f8e600cdde0 2024-04-25T10:25:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.272+0000 7f8e5de00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8e6015b2c0 0x7f8e600c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.272+0000 7f8e5de00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8e6015b2c0 0x7f8e600c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48878/0 (socket says 172.21.15.19:48878) 2024-04-25T10:25:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.272+0000 7f8e5de00640 1 -- 172.21.15.19:0/3876283526 learned_addr learned my addr 172.21.15.19:0/3876283526 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.272+0000 7f8e57e00640 1 --1- 172.21.15.19:0/3876283526 >> v1:172.21.15.19:6789/0 conn(0x7f8e60073160 0x7f8e6015e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34880/0 (socket says 172.21.15.19:34880) 2024-04-25T10:25:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.272+0000 7f8e5e800640 1 --2- 172.21.15.19:0/3876283526 >> v2:172.21.15.112:3300/0 conn(0x7f8e600cdde0 0x7f8e600ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.272+0000 7f8e5de00640 1 -- 172.21.15.19:0/3876283526 >> v2:172.21.15.112:3300/0 conn(0x7f8e600cdde0 msgr2=0x7f8e600ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.272+0000 7f8e5de00640 1 --2- 172.21.15.19:0/3876283526 >> v2:172.21.15.112:3300/0 conn(0x7f8e600cdde0 0x7f8e600ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.272+0000 7f8e5de00640 1 -- 172.21.15.19:0/3876283526 >> v1:172.21.15.19:6789/0 conn(0x7f8e60073160 legacy=0x7f8e6015e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.272+0000 7f8e5de00640 1 -- 172.21.15.19:0/3876283526 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e600c88e0 con 0x7f8e6015b2c0 2024-04-25T10:25:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.273+0000 7f8e5de00640 1 --2- 172.21.15.19:0/3876283526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e6015b2c0 0x7f8e600c9810 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e60070ca0 tx=0x7f8e5002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396b910d2452949a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.274+0000 7f8e5d400640 1 -- 172.21.15.19:0/3876283526 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50037070 con 0x7f8e6015b2c0 2024-04-25T10:25:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.274+0000 7f8e5d400640 1 -- 172.21.15.19:0/3876283526 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e5002ae50 con 0x7f8e6015b2c0 2024-04-25T10:25:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.274+0000 7f8e5d400640 1 -- 172.21.15.19:0/3876283526 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50032860 con 0x7f8e6015b2c0 2024-04-25T10:25:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.274+0000 7f8e64a00640 1 -- 172.21.15.19:0/3876283526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e6015b2c0 msgr2=0x7f8e600c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.274+0000 7f8e64a00640 1 --2- 172.21.15.19:0/3876283526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e6015b2c0 0x7f8e600c9810 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e60070ca0 tx=0x7f8e5002a300 comp rx=0 tx=0).stop 2024-04-25T10:25:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.274+0000 7f8e64a00640 1 -- 172.21.15.19:0/3876283526 shutdown_connections 2024-04-25T10:25:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.274+0000 7f8e64a00640 1 --2- 172.21.15.19:0/3876283526 >> v2:172.21.15.112:3300/0 conn(0x7f8e600cdde0 0x7f8e600ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.274+0000 7f8e64a00640 1 --2- 172.21.15.19:0/3876283526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e6015b2c0 0x7f8e600c9810 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.274+0000 7f8e64a00640 1 -- 172.21.15.19:0/3876283526 >> 172.21.15.19:0/3876283526 conn(0x7f8e6006f1f0 msgr2=0x7f8e6006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.275+0000 7f8e64a00640 1 -- 172.21.15.19:0/3876283526 shutdown_connections 2024-04-25T10:25:31.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.275+0000 7f8e64a00640 1 -- 172.21.15.19:0/3876283526 wait complete. 2024-04-25T10:25:31.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.277+0000 7f8e64a00640 1 Processor -- start 2024-04-25T10:25:31.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.277+0000 7f8e64a00640 1 -- start start 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.278+0000 7f8e64a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e60073160 0x7f8e601f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.278+0000 7f8e64a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e600cdde0 0x7f8e601e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.278+0000 7f8e64a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6015b6e0 0x7f8e60153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.278+0000 7f8e64a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6006d4c0 con 0x7f8e600cdde0 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.278+0000 7f8e64a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6015a580 con 0x7f8e60073160 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.278+0000 7f8e64a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6015e930 con 0x7f8e6015b6e0 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e57e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e600cdde0 0x7f8e601e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e5de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e60073160 0x7f8e601f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e5e800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6015b6e0 0x7f8e60153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e5e800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6015b6e0 0x7f8e60153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:54868/0 (socket says 172.21.15.19:54868) 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e5e800640 1 -- 172.21.15.19:0/2815747334 learned_addr learned my addr 172.21.15.19:0/2815747334 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e5de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e60073160 0x7f8e601f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:58282/0 (socket says 172.21.15.19:58282) 2024-04-25T10:25:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e5e800640 1 -- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e60073160 msgr2=0x7f8e601f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e5e800640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e60073160 0x7f8e601f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e5e800640 1 -- 172.21.15.19:0/2815747334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e600cdde0 msgr2=0x7f8e601e6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e5e800640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e600cdde0 0x7f8e601e6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e5e800640 1 -- 172.21.15.19:0/2815747334 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e601f3970 con 0x7f8e6015b6e0 2024-04-25T10:25:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e5e800640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6015b6e0 0x7f8e60153380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800ef90 tx=0x7f8e5800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:31.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e56000640 1 -- 172.21.15.19:0/2815747334 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58018020 con 0x7f8e6015b6e0 2024-04-25T10:25:31.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e56000640 1 -- 172.21.15.19:0/2815747334 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e58014480 con 0x7f8e6015b6e0 2024-04-25T10:25:31.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.279+0000 7f8e56000640 1 -- 172.21.15.19:0/2815747334 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58009e60 con 0x7f8e6015b6e0 2024-04-25T10:25:31.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.280+0000 7f8e64a00640 1 -- 172.21.15.19:0/2815747334 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e601f2bb0 con 0x7f8e6015b6e0 2024-04-25T10:25:31.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.280+0000 7f8e64a00640 1 -- 172.21.15.19:0/2815747334 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e601f3170 con 0x7f8e6015b6e0 2024-04-25T10:25:31.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.281+0000 7f8e64a00640 1 -- 172.21.15.19:0/2815747334 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e600af9a0 con 0x7f8e6015b6e0 2024-04-25T10:25:31.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.282+0000 7f8e56000640 1 -- 172.21.15.19:0/2815747334 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8e58005d10 con 0x7f8e6015b6e0 2024-04-25T10:25:31.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.283+0000 7f8e56000640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8e3c0744b0 0x7f8e3c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.283+0000 7f8e56000640 1 -- 172.21.15.19:0/2815747334 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8e58095b50 con 0x7f8e6015b6e0 2024-04-25T10:25:31.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.283+0000 7f8e5de00640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8e3c0744b0 0x7f8e3c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.284+0000 7f8e5de00640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8e3c0744b0 0x7f8e3c0769c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e50034000 tx=0x7f8e5002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:31.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.288+0000 7f8e56000640 1 -- 172.21.15.19:0/2815747334 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8e58022030 con 0x7f8e6015b6e0 2024-04-25T10:25:31.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.483+0000 7f8e64a00640 1 -- 172.21.15.19:0/2815747334 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e60076520 con 0x7f8e6015b6e0 2024-04-25T10:25:31.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.484+0000 7f8e56000640 1 -- 172.21.15.19:0/2815747334 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f8e58010040 con 0x7f8e6015b6e0 2024-04-25T10:25:31.486 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:31.487 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:26.797583+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:25:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 -- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8e3c0744b0 msgr2=0x7f8e3c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8e3c0744b0 0x7f8e3c0769c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e50034000 tx=0x7f8e5002e000 comp rx=0 tx=0).stop 2024-04-25T10:25:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 -- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6015b6e0 msgr2=0x7f8e60153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6015b6e0 0x7f8e60153380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800ef90 tx=0x7f8e5800c490 comp rx=0 tx=0).stop 2024-04-25T10:25:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 -- 172.21.15.19:0/2815747334 shutdown_connections 2024-04-25T10:25:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8e3c0744b0 0x7f8e3c0769c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6015b6e0 0x7f8e60153380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e600cdde0 0x7f8e601e6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 --2- 172.21.15.19:0/2815747334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e60073160 0x7f8e601f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 -- 172.21.15.19:0/2815747334 >> 172.21.15.19:0/2815747334 conn(0x7f8e6006f1f0 msgr2=0x7f8e600c8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 -- 172.21.15.19:0/2815747334 shutdown_connections 2024-04-25T10:25:31.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.487+0000 7f8e64a00640 1 -- 172.21.15.19:0/2815747334 wait complete. 2024-04-25T10:25:31.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:25:24.611615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:25:31.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:25:31.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.790+0000 7f6b30a00640 1 Processor -- start 2024-04-25T10:25:31.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.790+0000 7f6b30a00640 1 -- start start 2024-04-25T10:25:31.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.792+0000 7f6b30a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6b2c153fa0 0x7f6b2c1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.792+0000 7f6b30a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b2c06ef40 0x7f6b2c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.792+0000 7f6b30a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b2c15af60 con 0x7f6b2c06fd20 2024-04-25T10:25:31.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.792+0000 7f6b30a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6b2c1548f0 con 0x7f6b2c06ef40 2024-04-25T10:25:31.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.792+0000 7f6b30a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6b2c0c6dd0 con 0x7f6b2c153fa0 2024-04-25T10:25:31.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.792+0000 7f6b2b200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b2c06ef40 0x7f6b2c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.793+0000 7f6b2b200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b2c06ef40 0x7f6b2c06f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48904/0 (socket says 172.21.15.19:48904) 2024-04-25T10:25:31.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.793+0000 7f6b2b200640 1 -- 172.21.15.19:0/315185389 learned_addr learned my addr 172.21.15.19:0/315185389 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:31.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.793+0000 7f6b21e00640 1 --2- 172.21.15.19:0/315185389 >> v2:172.21.15.112:3300/0 conn(0x7f6b2c153fa0 0x7f6b2c1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.793+0000 7f6b2b200640 1 -- 172.21.15.19:0/315185389 >> v2:172.21.15.112:3300/0 conn(0x7f6b2c153fa0 msgr2=0x7f6b2c1543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:31.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.793+0000 7f6b2b200640 1 --2- 172.21.15.19:0/315185389 >> v2:172.21.15.112:3300/0 conn(0x7f6b2c153fa0 0x7f6b2c1543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.793+0000 7f6b2b200640 1 -- 172.21.15.19:0/315185389 >> v1:172.21.15.19:6789/0 conn(0x7f6b2c06fd20 legacy=0x7f6b2c0c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:31.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.793+0000 7f6b2b200640 1 -- 172.21.15.19:0/315185389 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c0c61c0 con 0x7f6b2c06ef40 2024-04-25T10:25:31.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.794+0000 7f6b2b200640 1 --2- 172.21.15.19:0/315185389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b2c06ef40 0x7f6b2c06f350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009e50 tx=0x7f6b2402a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3257c8c1f91c0504 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:31.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.795+0000 7f6b29e00640 1 -- 172.21.15.19:0/315185389 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24036070 con 0x7f6b2c06ef40 2024-04-25T10:25:31.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.795+0000 7f6b29e00640 1 -- 172.21.15.19:0/315185389 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b24031600 con 0x7f6b2c06ef40 2024-04-25T10:25:31.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.795+0000 7f6b29e00640 1 -- 172.21.15.19:0/315185389 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b240319d0 con 0x7f6b2c06ef40 2024-04-25T10:25:31.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.795+0000 7f6b30a00640 1 -- 172.21.15.19:0/315185389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b2c06ef40 msgr2=0x7f6b2c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:31.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.795+0000 7f6b30a00640 1 --2- 172.21.15.19:0/315185389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b2c06ef40 0x7f6b2c06f350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009e50 tx=0x7f6b2402a7f0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.795+0000 7f6b30a00640 1 -- 172.21.15.19:0/315185389 shutdown_connections 2024-04-25T10:25:31.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.795+0000 7f6b30a00640 1 --2- 172.21.15.19:0/315185389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b2c06ef40 0x7f6b2c06f350 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.795+0000 7f6b30a00640 1 --2- 172.21.15.19:0/315185389 >> v2:172.21.15.112:3300/0 conn(0x7f6b2c153fa0 0x7f6b2c1543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.795+0000 7f6b30a00640 1 -- 172.21.15.19:0/315185389 >> 172.21.15.19:0/315185389 conn(0x7f6b2c0ca120 msgr2=0x7f6b2c0ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:31.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.796+0000 7f6b30a00640 1 -- 172.21.15.19:0/315185389 shutdown_connections 2024-04-25T10:25:31.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.796+0000 7f6b30a00640 1 -- 172.21.15.19:0/315185389 wait complete. 2024-04-25T10:25:31.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.798+0000 7f6b30a00640 1 Processor -- start 2024-04-25T10:25:31.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.798+0000 7f6b30a00640 1 -- start start 2024-04-25T10:25:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.799+0000 7f6b30a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b2c06ef40 0x7f6b2c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b30a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b2c06fd20 0x7f6b2c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b30a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b2c153fa0 0x7f6b2c15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b30a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c0c6a60 con 0x7f6b2c06ef40 2024-04-25T10:25:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b30a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c0c6780 con 0x7f6b2c153fa0 2024-04-25T10:25:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b30a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2c073010 con 0x7f6b2c06fd20 2024-04-25T10:25:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b2a800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b2c06ef40 0x7f6b2c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b2a800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b2c06ef40 0x7f6b2c1560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48912/0 (socket says 172.21.15.19:48912) 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b2a800640 1 -- 172.21.15.19:0/3973829718 learned_addr learned my addr 172.21.15.19:0/3973829718 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b21e00640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b2c06fd20 0x7f6b2c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b2b200640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b2c153fa0 0x7f6b2c15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b2a800640 1 -- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b2c06fd20 msgr2=0x7f6b2c154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b2a800640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b2c06fd20 0x7f6b2c154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b2a800640 1 -- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b2c153fa0 msgr2=0x7f6b2c15ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b2a800640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b2c153fa0 0x7f6b2c15ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.800+0000 7f6b2a800640 1 -- 172.21.15.19:0/3973829718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c155a10 con 0x7f6b2c06ef40 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.801+0000 7f6b2a800640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b2c06ef40 0x7f6b2c1560c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00c3c0 tx=0x7f6b1c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.801+0000 7f6b23400640 1 -- 172.21.15.19:0/3973829718 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0052d0 con 0x7f6b2c06ef40 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.801+0000 7f6b23400640 1 -- 172.21.15.19:0/3973829718 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b1c005490 con 0x7f6b2c06ef40 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.801+0000 7f6b30a00640 1 -- 172.21.15.19:0/3973829718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b2c157aa0 con 0x7f6b2c06ef40 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.801+0000 7f6b23400640 1 -- 172.21.15.19:0/3973829718 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c007260 con 0x7f6b2c06ef40 2024-04-25T10:25:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.801+0000 7f6b30a00640 1 -- 172.21.15.19:0/3973829718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b2c156600 con 0x7f6b2c06ef40 2024-04-25T10:25:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.802+0000 7f6b30a00640 1 -- 172.21.15.19:0/3973829718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b2c155ec0 con 0x7f6b2c06ef40 2024-04-25T10:25:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.804+0000 7f6b23400640 1 -- 172.21.15.19:0/3973829718 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6b1c007400 con 0x7f6b2c06ef40 2024-04-25T10:25:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.805+0000 7f6b23400640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b080744e0 0x7f6b080769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.805+0000 7f6b23400640 1 -- 172.21.15.19:0/3973829718 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6b1c094260 con 0x7f6b2c06ef40 2024-04-25T10:25:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.805+0000 7f6b21e00640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b080744e0 0x7f6b080769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:31.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.806+0000 7f6b21e00640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b080744e0 0x7f6b080769f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0c9a60 tx=0x7f6b14009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:31.810+0000 7f6b23400640 1 -- 172.21.15.19:0/3973829718 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b2c155ec0 con 0x7f6b2c06ef40 2024-04-25T10:25:32.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.006+0000 7f6b30a00640 1 -- 172.21.15.19:0/3973829718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6b2c1567d0 con 0x7f6b2c06ef40 2024-04-25T10:25:32.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.007+0000 7f6b23400640 1 -- 172.21.15.19:0/3973829718 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f6b2c1567d0 con 0x7f6b2c06ef40 2024-04-25T10:25:32.009 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-04-25T10:25:32.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.009+0000 7f6b30a00640 1 -- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b080744e0 msgr2=0x7f6b080769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.009+0000 7f6b30a00640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b080744e0 0x7f6b080769f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0c9a60 tx=0x7f6b14009190 comp rx=0 tx=0).stop 2024-04-25T10:25:32.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.009+0000 7f6b30a00640 1 -- 172.21.15.19:0/3973829718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b2c06ef40 msgr2=0x7f6b2c1560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.009+0000 7f6b30a00640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b2c06ef40 0x7f6b2c1560c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00c3c0 tx=0x7f6b1c00c880 comp rx=0 tx=0).stop 2024-04-25T10:25:32.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.009+0000 7f6b30a00640 1 -- 172.21.15.19:0/3973829718 shutdown_connections 2024-04-25T10:25:32.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.010+0000 7f6b30a00640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b2c153fa0 0x7f6b2c15ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.010+0000 7f6b30a00640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b080744e0 0x7f6b080769f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.010+0000 7f6b30a00640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b2c06fd20 0x7f6b2c154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.010+0000 7f6b30a00640 1 --2- 172.21.15.19:0/3973829718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b2c06ef40 0x7f6b2c1560c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.010+0000 7f6b30a00640 1 -- 172.21.15.19:0/3973829718 >> 172.21.15.19:0/3973829718 conn(0x7f6b2c0ca120 msgr2=0x7f6b2c1529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:32.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.010+0000 7f6b30a00640 1 -- 172.21.15.19:0/3973829718 shutdown_connections 2024-04-25T10:25:32.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.010+0000 7f6b30a00640 1 -- 172.21.15.19:0/3973829718 wait complete. 2024-04-25T10:25:32.038 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:25:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.313+0000 7f3cd6c00640 1 Processor -- start 2024-04-25T10:25:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.313+0000 7f3cd6c00640 1 -- start start 2024-04-25T10:25:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.315+0000 7f3cd6c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cd00cd7e0 0x7f3cd015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.315+0000 7f3cd6c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd00cedb0 con 0x7f3cd015d080 2024-04-25T10:25:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.315+0000 7f3cd6c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd00ce850 con 0x7f3cd008de70 2024-04-25T10:25:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.315+0000 7f3cd6c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd00ceaf0 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.315+0000 7f3ccfe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cd00cd7e0 0x7f3cd015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.315+0000 7f3ccf400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3cd015d080 0x7f3cd008d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34896/0 (socket says 172.21.15.19:34896) 2024-04-25T10:25:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.315+0000 7f3ccfe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cd00cd7e0 0x7f3cd015cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48924/0 (socket says 172.21.15.19:48924) 2024-04-25T10:25:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.315+0000 7f3ccf400640 1 -- 172.21.15.19:0/557021792 learned_addr learned my addr 172.21.15.19:0/557021792 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.316+0000 7f3ccea00640 1 -- 172.21.15.19:0/557021792 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357747843 0 0) 0x7f3cd00ce850 con 0x7f3cd008de70 2024-04-25T10:25:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.316+0000 7f3ccfe00640 1 -- 172.21.15.19:0/557021792 >> v1:172.21.15.112:6789/0 conn(0x7f3cd008de70 legacy=0x7f3cd0166e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.316+0000 7f3ccfe00640 1 -- 172.21.15.19:0/557021792 >> v1:172.21.15.19:6789/0 conn(0x7f3cd015d080 legacy=0x7f3cd008d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.316+0000 7f3ccfe00640 1 -- 172.21.15.19:0/557021792 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd00cc890 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.317+0000 7f3ccfe00640 1 --2- 172.21.15.19:0/557021792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cd00cd7e0 0x7f3cd015cb40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80097a0 tx=0x7f3cb802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976f9c0b631f64b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:32.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.317+0000 7f3ccea00640 1 -- 172.21.15.19:0/557021792 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8037070 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.317+0000 7f3ccea00640 1 -- 172.21.15.19:0/557021792 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb802ae50 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.317+0000 7f3ccea00640 1 -- 172.21.15.19:0/557021792 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8032660 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.318+0000 7f3cd6c00640 1 -- 172.21.15.19:0/557021792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cd00cd7e0 msgr2=0x7f3cd015cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.318+0000 7f3cd6c00640 1 --2- 172.21.15.19:0/557021792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cd00cd7e0 0x7f3cd015cb40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80097a0 tx=0x7f3cb802a1c0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.318+0000 7f3cd6c00640 1 -- 172.21.15.19:0/557021792 shutdown_connections 2024-04-25T10:25:32.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.318+0000 7f3cd6c00640 1 --2- 172.21.15.19:0/557021792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cd00cd7e0 0x7f3cd015cb40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.318+0000 7f3cd6c00640 1 -- 172.21.15.19:0/557021792 >> 172.21.15.19:0/557021792 conn(0x7f3cd006f290 msgr2=0x7f3cd0068560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:32.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.318+0000 7f3cd6c00640 1 -- 172.21.15.19:0/557021792 shutdown_connections 2024-04-25T10:25:32.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.318+0000 7f3cd6c00640 1 -- 172.21.15.19:0/557021792 wait complete. 2024-04-25T10:25:32.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.320+0000 7f3cd6c00640 1 Processor -- start 2024-04-25T10:25:32.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.320+0000 7f3cd6c00640 1 -- start start 2024-04-25T10:25:32.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.322+0000 7f3cd6c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cd008de70 0x7f3cd014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:32.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.322+0000 7f3cd6c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cd00cd7e0 0x7f3cd00b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:32.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.322+0000 7f3cd6c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd015d080 0x7f3cd01f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:32.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.322+0000 7f3cd6c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd015d490 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.322+0000 7f3cd6c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd015c620 con 0x7f3cd015d080 2024-04-25T10:25:32.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.322+0000 7f3cd6c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd00cce50 con 0x7f3cd008de70 2024-04-25T10:25:32.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.322+0000 7f3ccfe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cd008de70 0x7f3cd014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:32.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.322+0000 7f3ccfe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cd008de70 0x7f3cd014fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:54896/0 (socket says 172.21.15.19:54896) 2024-04-25T10:25:32.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.322+0000 7f3ccfe00640 1 -- 172.21.15.19:0/2844508591 learned_addr learned my addr 172.21.15.19:0/2844508591 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:32.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.322+0000 7f3cd4c00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd015d080 0x7f3cd01f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:32.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.322+0000 7f3ccf400640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cd00cd7e0 0x7f3cd00b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:32.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.323+0000 7f3ccf400640 1 -- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cd008de70 msgr2=0x7f3cd014fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.323+0000 7f3ccf400640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cd008de70 0x7f3cd014fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.323+0000 7f3ccf400640 1 -- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd015d080 msgr2=0x7f3cd01f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.323+0000 7f3ccf400640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd015d080 0x7f3cd01f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.323+0000 7f3ccf400640 1 -- 172.21.15.19:0/2844508591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd01f3610 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.323+0000 7f3ccfe00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cd008de70 0x7f3cd014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.323+0000 7f3cd4c00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd015d080 0x7f3cd01f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.323+0000 7f3ccf400640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cd00cd7e0 0x7f3cd00b6240 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000c8c0 tx=0x7f3cc000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.323+0000 7f3cc7e00640 1 -- 172.21.15.19:0/2844508591 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0018070 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.324+0000 7f3cc7e00640 1 -- 172.21.15.19:0/2844508591 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc000a640 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.324+0000 7f3cc7e00640 1 -- 172.21.15.19:0/2844508591 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc000aa30 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.324+0000 7f3cd6c00640 1 -- 172.21.15.19:0/2844508591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd00d1670 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.324+0000 7f3cd6c00640 1 -- 172.21.15.19:0/2844508591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd01f68a0 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.325+0000 7f3cd6c00640 1 -- 172.21.15.19:0/2844508591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd01609c0 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.326+0000 7f3cc7e00640 1 -- 172.21.15.19:0/2844508591 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3cc000abd0 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.327+0000 7f3cc7e00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3cac0744b0 0x7f3cac0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:32.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.327+0000 7f3cc7e00640 1 -- 172.21.15.19:0/2844508591 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3cc00944e0 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.327+0000 7f3ccfe00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3cac0744b0 0x7f3cac0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:32.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.328+0000 7f3ccfe00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3cac0744b0 0x7f3cac0769c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3cb802a200 tx=0x7f3cb802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:32.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.332+0000 7f3cc7e00640 1 -- 172.21.15.19:0/2844508591 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3cd01609c0 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.571+0000 7f3cd6c00640 1 -- 172.21.15.19:0/2844508591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cd01f6310 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.572+0000 7f3cc7e00640 1 -- 172.21.15.19:0/2844508591 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5521 (secure 0 0 0) 0x7f3cc005e8d0 con 0x7f3cd00cd7e0 2024-04-25T10:25:32.573 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:32.574 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4288,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T10:25:32.574 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 3 2024-04-25T10:25:32.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.574+0000 7f3cd6c00640 1 -- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3cac0744b0 msgr2=0x7f3cac0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.574+0000 7f3cd6c00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3cac0744b0 0x7f3cac0769c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3cb802a200 tx=0x7f3cb802e000 comp rx=0 tx=0).stop 2024-04-25T10:25:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.574+0000 7f3cd6c00640 1 -- 172.21.15.19:0/2844508591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cd00cd7e0 msgr2=0x7f3cd00b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.574+0000 7f3cd6c00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cd00cd7e0 0x7f3cd00b6240 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000c8c0 tx=0x7f3cc000cd80 comp rx=0 tx=0).stop 2024-04-25T10:25:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.575+0000 7f3cd6c00640 1 -- 172.21.15.19:0/2844508591 shutdown_connections 2024-04-25T10:25:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.575+0000 7f3cd6c00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd015d080 0x7f3cd01f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.575+0000 7f3cd6c00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cd00cd7e0 0x7f3cd00b6240 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.575+0000 7f3cd6c00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3cac0744b0 0x7f3cac0769c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.575+0000 7f3cd6c00640 1 --2- 172.21.15.19:0/2844508591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cd008de70 0x7f3cd014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.575+0000 7f3cd6c00640 1 -- 172.21.15.19:0/2844508591 >> 172.21.15.19:0/2844508591 conn(0x7f3cd006f290 msgr2=0x7f3cd00c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.575+0000 7f3cd6c00640 1 -- 172.21.15.19:0/2844508591 shutdown_connections 2024-04-25T10:25:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.575+0000 7f3cd6c00640 1 -- 172.21.15.19:0/2844508591 wait complete. 2024-04-25T10:25:32.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:25:32.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.885+0000 7f9857000640 1 Processor -- start 2024-04-25T10:25:32.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.885+0000 7f9857000640 1 -- start start 2024-04-25T10:25:32.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.888+0000 7f9857000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98500c40d0 0x7f98500c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:32.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.888+0000 7f9857000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f985015c400 0x7f985015c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:32.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.888+0000 7f9857000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98500c4bd0 con 0x7f9850152e80 2024-04-25T10:25:32.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.888+0000 7f9857000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9850158bb0 con 0x7f985015c400 2024-04-25T10:25:32.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.888+0000 7f9857000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9850158e70 con 0x7f98500c40d0 2024-04-25T10:25:32.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.888+0000 7f984fe00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9850152e80 0x7f9850073960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34904/0 (socket says 172.21.15.19:34904) 2024-04-25T10:25:32.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.888+0000 7f984fe00640 1 -- 172.21.15.19:0/1503793341 learned_addr learned my addr 172.21.15.19:0/1503793341 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:32.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.888+0000 7f9847e00640 1 --2- 172.21.15.19:0/1503793341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98500c40d0 0x7f98500c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:32.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.888+0000 7f9855000640 1 --2- 172.21.15.19:0/1503793341 >> v2:172.21.15.112:3300/0 conn(0x7f985015c400 0x7f985015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:32.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.889+0000 7f984f400640 1 -- 172.21.15.19:0/1503793341 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788591004 0 0) 0x7f98500c4bd0 con 0x7f9850152e80 2024-04-25T10:25:32.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.889+0000 7f984f400640 1 -- 172.21.15.19:0/1503793341 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9834003520 con 0x7f9850152e80 2024-04-25T10:25:32.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.889+0000 7f9847e00640 1 -- 172.21.15.19:0/1503793341 >> v2:172.21.15.112:3300/0 conn(0x7f985015c400 msgr2=0x7f985015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:32.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.889+0000 7f9847e00640 1 --2- 172.21.15.19:0/1503793341 >> v2:172.21.15.112:3300/0 conn(0x7f985015c400 0x7f985015c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.889+0000 7f9847e00640 1 -- 172.21.15.19:0/1503793341 >> v1:172.21.15.19:6789/0 conn(0x7f9850152e80 legacy=0x7f9850073960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.889+0000 7f9847e00640 1 -- 172.21.15.19:0/1503793341 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9850159150 con 0x7f98500c40d0 2024-04-25T10:25:32.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.889+0000 7f9855000640 1 --2- 172.21.15.19:0/1503793341 >> v2:172.21.15.112:3300/0 conn(0x7f985015c400 0x7f985015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:32.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.890+0000 7f9847e00640 1 --2- 172.21.15.19:0/1503793341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98500c40d0 0x7f98500c44e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f98380097a0 tx=0x7f983802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d7429de3502bebf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:32.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.890+0000 7f984f400640 1 -- 172.21.15.19:0/1503793341 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9838037070 con 0x7f98500c40d0 2024-04-25T10:25:32.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.890+0000 7f984f400640 1 -- 172.21.15.19:0/1503793341 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9838032440 con 0x7f98500c40d0 2024-04-25T10:25:32.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.890+0000 7f984f400640 1 -- 172.21.15.19:0/1503793341 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9838032810 con 0x7f98500c40d0 2024-04-25T10:25:32.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.891+0000 7f9857000640 1 -- 172.21.15.19:0/1503793341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98500c40d0 msgr2=0x7f98500c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.891+0000 7f9857000640 1 --2- 172.21.15.19:0/1503793341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98500c40d0 0x7f98500c44e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f98380097a0 tx=0x7f983802a210 comp rx=0 tx=0).stop 2024-04-25T10:25:32.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.891+0000 7f9857000640 1 -- 172.21.15.19:0/1503793341 shutdown_connections 2024-04-25T10:25:32.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.891+0000 7f9857000640 1 --2- 172.21.15.19:0/1503793341 >> v2:172.21.15.112:3300/0 conn(0x7f985015c400 0x7f985015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.891+0000 7f9857000640 1 --2- 172.21.15.19:0/1503793341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98500c40d0 0x7f98500c44e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.891+0000 7f9857000640 1 -- 172.21.15.19:0/1503793341 >> 172.21.15.19:0/1503793341 conn(0x7f985006f1f0 msgr2=0x7f985006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:32.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.891+0000 7f9857000640 1 -- 172.21.15.19:0/1503793341 shutdown_connections 2024-04-25T10:25:32.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.891+0000 7f9857000640 1 -- 172.21.15.19:0/1503793341 wait complete. 2024-04-25T10:25:32.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.893+0000 7f9857000640 1 Processor -- start 2024-04-25T10:25:32.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.894+0000 7f9857000640 1 -- start start 2024-04-25T10:25:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f9857000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98500c40d0 0x7f98500c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f9857000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9850152e80 0x7f98500b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f9857000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f985015c400 0x7f98500b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f9857000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f985015cd50 con 0x7f9850152e80 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f9857000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9850159710 con 0x7f98500c40d0 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f9857000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f98500c2a10 con 0x7f985015c400 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f984fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98500c40d0 0x7f98500c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f9847e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9850152e80 0x7f98500b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f984fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98500c40d0 0x7f98500c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:58326/0 (socket says 172.21.15.19:58326) 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f9847e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9850152e80 0x7f98500b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48944/0 (socket says 172.21.15.19:48944) 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f984fe00640 1 -- 172.21.15.19:0/2497574726 learned_addr learned my addr 172.21.15.19:0/2497574726 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.895+0000 7f9855000640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f985015c400 0x7f98500b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.896+0000 7f984fe00640 1 -- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f985015c400 msgr2=0x7f98500b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.896+0000 7f984fe00640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f985015c400 0x7f98500b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.896+0000 7f984fe00640 1 -- 172.21.15.19:0/2497574726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9850152e80 msgr2=0x7f98500b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.896+0000 7f984fe00640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9850152e80 0x7f98500b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.896+0000 7f984fe00640 1 -- 172.21.15.19:0/2497574726 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98501f3d40 con 0x7f98500c40d0 2024-04-25T10:25:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.896+0000 7f9847e00640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9850152e80 0x7f98500b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:32.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.896+0000 7f984fe00640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98500c40d0 0x7f98500c60f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f984000c390 tx=0x7f984000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:32.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.896+0000 7f984cc00640 1 -- 172.21.15.19:0/2497574726 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840017070 con 0x7f98500c40d0 2024-04-25T10:25:32.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.896+0000 7f984cc00640 1 -- 172.21.15.19:0/2497574726 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9840005ce0 con 0x7f98500c40d0 2024-04-25T10:25:32.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.896+0000 7f984cc00640 1 -- 172.21.15.19:0/2497574726 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98400072f0 con 0x7f98500c40d0 2024-04-25T10:25:32.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.896+0000 7f9857000640 1 -- 172.21.15.19:0/2497574726 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98501f4020 con 0x7f98500c40d0 2024-04-25T10:25:32.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.897+0000 7f9857000640 1 -- 172.21.15.19:0/2497574726 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98500c9dd0 con 0x7f98500c40d0 2024-04-25T10:25:32.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.898+0000 7f9857000640 1 -- 172.21.15.19:0/2497574726 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98500b05b0 con 0x7f98500c40d0 2024-04-25T10:25:32.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.899+0000 7f984cc00640 1 -- 172.21.15.19:0/2497574726 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f984001a070 con 0x7f98500c40d0 2024-04-25T10:25:32.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.900+0000 7f984cc00640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f982c0744b0 0x7f982c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:32.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.900+0000 7f984cc00640 1 -- 172.21.15.19:0/2497574726 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f9840094180 con 0x7f98500c40d0 2024-04-25T10:25:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.900+0000 7f9847e00640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f982c0744b0 0x7f982c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.901+0000 7f9847e00640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f982c0744b0 0x7f982c0769c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9838034000 tx=0x7f983802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:32.905+0000 7f984cc00640 1 -- 172.21.15.19:0/2497574726 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f98500b05b0 con 0x7f98500c40d0 2024-04-25T10:25:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.108+0000 7f9857000640 1 -- 172.21.15.19:0/2497574726 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9850076520 con 0x7f98500c40d0 2024-04-25T10:25:33.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.113+0000 7f984cc00640 1 -- 172.21.15.19:0/2497574726 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f984005e690 con 0x7f98500c40d0 2024-04-25T10:25:33.115 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:33.115 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:26.797583+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:25:33.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 -- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f982c0744b0 msgr2=0x7f982c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f982c0744b0 0x7f982c0769c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9838034000 tx=0x7f983802e000 comp rx=0 tx=0).stop 2024-04-25T10:25:33.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 -- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98500c40d0 msgr2=0x7f98500c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98500c40d0 0x7f98500c60f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f984000c390 tx=0x7f984000c850 comp rx=0 tx=0).stop 2024-04-25T10:25:33.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 -- 172.21.15.19:0/2497574726 shutdown_connections 2024-04-25T10:25:33.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f982c0744b0 0x7f982c0769c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f985015c400 0x7f98500b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9850152e80 0x7f98500b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 --2- 172.21.15.19:0/2497574726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98500c40d0 0x7f98500c60f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 -- 172.21.15.19:0/2497574726 >> 172.21.15.19:0/2497574726 conn(0x7f985006f1f0 msgr2=0x7f9850151d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:33.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 -- 172.21.15.19:0/2497574726 shutdown_connections 2024-04-25T10:25:33.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.116+0000 7f9857000640 1 -- 172.21.15.19:0/2497574726 wait complete. 2024-04-25T10:25:33.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:25:24.611615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:25:33.143 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:25:33.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.432+0000 7fba24a00640 1 Processor -- start 2024-04-25T10:25:33.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.432+0000 7fba24a00640 1 -- start start 2024-04-25T10:25:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.434+0000 7fba24a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba20152e80 0x7fba20073960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.435+0000 7fba24a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba2015cb10 0x7fba200c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.435+0000 7fba24a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba200c4bd0 con 0x7fba200c40d0 2024-04-25T10:25:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.435+0000 7fba24a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fba20158bb0 con 0x7fba2015cb10 2024-04-25T10:25:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.435+0000 7fba24a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fba20158e70 con 0x7fba20152e80 2024-04-25T10:25:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.435+0000 7fba1e800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba2015cb10 0x7fba200c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.435+0000 7fba1e800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba2015cb10 0x7fba200c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48950/0 (socket says 172.21.15.19:48950) 2024-04-25T10:25:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.435+0000 7fba1e800640 1 -- 172.21.15.19:0/47602855 learned_addr learned my addr 172.21.15.19:0/47602855 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.435+0000 7fba1de00640 1 --2- 172.21.15.19:0/47602855 >> v2:172.21.15.112:3300/0 conn(0x7fba20152e80 0x7fba20073960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.435+0000 7fba1e800640 1 -- 172.21.15.19:0/47602855 >> v2:172.21.15.112:3300/0 conn(0x7fba20152e80 msgr2=0x7fba20073960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.435+0000 7fba1e800640 1 --2- 172.21.15.19:0/47602855 >> v2:172.21.15.112:3300/0 conn(0x7fba20152e80 0x7fba20073960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.436+0000 7fba1e800640 1 -- 172.21.15.19:0/47602855 >> v1:172.21.15.19:6789/0 conn(0x7fba200c40d0 legacy=0x7fba2015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.436+0000 7fba1e800640 1 -- 172.21.15.19:0/47602855 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba20159150 con 0x7fba2015cb10 2024-04-25T10:25:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.437+0000 7fba1e800640 1 --2- 172.21.15.19:0/47602855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba2015cb10 0x7fba200c44e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba20074180 tx=0x7fba1802a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95ed9467e9da365 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.437+0000 7fba1ca00640 1 -- 172.21.15.19:0/47602855 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18037070 con 0x7fba2015cb10 2024-04-25T10:25:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.437+0000 7fba1ca00640 1 -- 172.21.15.19:0/47602855 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba18032640 con 0x7fba2015cb10 2024-04-25T10:25:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.437+0000 7fba1ca00640 1 -- 172.21.15.19:0/47602855 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1802ae60 con 0x7fba2015cb10 2024-04-25T10:25:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.438+0000 7fba24a00640 1 -- 172.21.15.19:0/47602855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba2015cb10 msgr2=0x7fba200c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.438+0000 7fba24a00640 1 --2- 172.21.15.19:0/47602855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba2015cb10 0x7fba200c44e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba20074180 tx=0x7fba1802a310 comp rx=0 tx=0).stop 2024-04-25T10:25:33.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.438+0000 7fba24a00640 1 -- 172.21.15.19:0/47602855 shutdown_connections 2024-04-25T10:25:33.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.438+0000 7fba24a00640 1 --2- 172.21.15.19:0/47602855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba2015cb10 0x7fba200c44e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.438+0000 7fba24a00640 1 --2- 172.21.15.19:0/47602855 >> v2:172.21.15.112:3300/0 conn(0x7fba20152e80 0x7fba20073960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.438+0000 7fba24a00640 1 -- 172.21.15.19:0/47602855 >> 172.21.15.19:0/47602855 conn(0x7fba2006f1f0 msgr2=0x7fba2006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:33.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.438+0000 7fba24a00640 1 -- 172.21.15.19:0/47602855 shutdown_connections 2024-04-25T10:25:33.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.438+0000 7fba24a00640 1 -- 172.21.15.19:0/47602855 wait complete. 2024-04-25T10:25:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.440+0000 7fba24a00640 1 Processor -- start 2024-04-25T10:25:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.440+0000 7fba24a00640 1 -- start start 2024-04-25T10:25:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.442+0000 7fba24a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba200c40d0 0x7fba20153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.442+0000 7fba24a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba20152e80 0x7fba201557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.442+0000 7fba24a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba2015cb10 0x7fba2014b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.442+0000 7fba24a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fba200c2a10 con 0x7fba2015cb10 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.442+0000 7fba24a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fba20159710 con 0x7fba20152e80 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.442+0000 7fba24a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fba20073ea0 con 0x7fba200c40d0 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.442+0000 7fba1e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba2015cb10 0x7fba2014b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.442+0000 7fba1d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba20152e80 0x7fba201557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.442+0000 7fba1de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba200c40d0 0x7fba20153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.442+0000 7fba1e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba2015cb10 0x7fba2014b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48958/0 (socket says 172.21.15.19:48958) 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.442+0000 7fba1e800640 1 -- 172.21.15.19:0/2315991987 learned_addr learned my addr 172.21.15.19:0/2315991987 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.443+0000 7fba1e800640 1 -- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba200c40d0 msgr2=0x7fba20153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.443+0000 7fba1e800640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba200c40d0 0x7fba20153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.443+0000 7fba1e800640 1 -- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba20152e80 msgr2=0x7fba201557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.443+0000 7fba1e800640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba20152e80 0x7fba201557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.443+0000 7fba1e800640 1 -- 172.21.15.19:0/2315991987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba20155d10 con 0x7fba2015cb10 2024-04-25T10:25:33.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.443+0000 7fba1e800640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba2015cb10 0x7fba2014b5a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba1802a350 tx=0x7fba180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:33.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.443+0000 7fba16000640 1 -- 172.21.15.19:0/2315991987 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18037040 con 0x7fba2015cb10 2024-04-25T10:25:33.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.443+0000 7fba16000640 1 -- 172.21.15.19:0/2315991987 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba18042070 con 0x7fba2015cb10 2024-04-25T10:25:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.443+0000 7fba16000640 1 -- 172.21.15.19:0/2315991987 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1802ae60 con 0x7fba2015cb10 2024-04-25T10:25:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.443+0000 7fba24a00640 1 -- 172.21.15.19:0/2315991987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba20155010 con 0x7fba2015cb10 2024-04-25T10:25:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.444+0000 7fba24a00640 1 -- 172.21.15.19:0/2315991987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba200c5ce0 con 0x7fba2015cb10 2024-04-25T10:25:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.445+0000 7fba24a00640 1 -- 172.21.15.19:0/2315991987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba200c99c0 con 0x7fba2015cb10 2024-04-25T10:25:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.446+0000 7fba16000640 1 -- 172.21.15.19:0/2315991987 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fba18030990 con 0x7fba2015cb10 2024-04-25T10:25:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.447+0000 7fba16000640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fba000744b0 0x7fba000769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.447+0000 7fba16000640 1 -- 172.21.15.19:0/2315991987 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fba180b54d0 con 0x7fba2015cb10 2024-04-25T10:25:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.447+0000 7fba1de00640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fba000744b0 0x7fba000769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:33.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.448+0000 7fba1de00640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fba000744b0 0x7fba000769c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba1000a490 tx=0x7fba1000a860 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:33.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.453+0000 7fba16000640 1 -- 172.21.15.19:0/2315991987 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba200c99c0 con 0x7fba2015cb10 2024-04-25T10:25:33.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.660+0000 7fba24a00640 1 -- 172.21.15.19:0/2315991987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fba20154cf0 con 0x7fba2015cb10 2024-04-25T10:25:33.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.661+0000 7fba16000640 1 -- 172.21.15.19:0/2315991987 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fba20154cf0 con 0x7fba2015cb10 2024-04-25T10:25:33.663 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-04-25T10:25:33.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.664+0000 7fba24a00640 1 -- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fba000744b0 msgr2=0x7fba000769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.664+0000 7fba24a00640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fba000744b0 0x7fba000769c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba1000a490 tx=0x7fba1000a860 comp rx=0 tx=0).stop 2024-04-25T10:25:33.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.664+0000 7fba24a00640 1 -- 172.21.15.19:0/2315991987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba2015cb10 msgr2=0x7fba2014b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.664+0000 7fba24a00640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba2015cb10 0x7fba2014b5a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba1802a350 tx=0x7fba180046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.664+0000 7fba24a00640 1 -- 172.21.15.19:0/2315991987 shutdown_connections 2024-04-25T10:25:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.664+0000 7fba24a00640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba2015cb10 0x7fba2014b5a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.664+0000 7fba24a00640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba20152e80 0x7fba201557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.664+0000 7fba24a00640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fba000744b0 0x7fba000769c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.664+0000 7fba24a00640 1 --2- 172.21.15.19:0/2315991987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba200c40d0 0x7fba20153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.665+0000 7fba24a00640 1 -- 172.21.15.19:0/2315991987 >> 172.21.15.19:0/2315991987 conn(0x7fba2006f1f0 msgr2=0x7fba200c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.665+0000 7fba24a00640 1 -- 172.21.15.19:0/2315991987 shutdown_connections 2024-04-25T10:25:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.665+0000 7fba24a00640 1 -- 172.21.15.19:0/2315991987 wait complete. 2024-04-25T10:25:33.691 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:25:33.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.968+0000 7f8d23000640 1 Processor -- start 2024-04-25T10:25:33.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.968+0000 7f8d23000640 1 -- start start 2024-04-25T10:25:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.970+0000 7f8d23000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d1c06c5c0 0x7f8d1c0c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.970+0000 7f8d23000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d1c06d9f0 con 0x7f8d1c0c86f0 2024-04-25T10:25:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.970+0000 7f8d23000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d1c15d780 con 0x7f8d1c154620 2024-04-25T10:25:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.970+0000 7f8d23000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8d1c15dab0 con 0x7f8d1c06c5c0 2024-04-25T10:25:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.971+0000 7f8d21c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8d1c154620 0x7f8d1c15df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:33780/0 (socket says 172.21.15.19:33780) 2024-04-25T10:25:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.971+0000 7f8d21c00640 1 -- 172.21.15.19:0/3377410628 learned_addr learned my addr 172.21.15.19:0/3377410628 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.971+0000 7f8d22600640 1 --2- 172.21.15.19:0/3377410628 >> v2:172.21.15.19:3300/0 conn(0x7f8d1c06c5c0 0x7f8d1c0c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.971+0000 7f8d22600640 1 -- 172.21.15.19:0/3377410628 >> v1:172.21.15.112:6789/0 conn(0x7f8d1c154620 legacy=0x7f8d1c15df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.971+0000 7f8d22600640 1 -- 172.21.15.19:0/3377410628 >> v1:172.21.15.19:6789/0 conn(0x7f8d1c0c86f0 legacy=0x7f8d1c0c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.971+0000 7f8d22600640 1 -- 172.21.15.19:0/3377410628 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c06dc90 con 0x7f8d1c06c5c0 2024-04-25T10:25:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.971+0000 7f8d1be00640 1 -- 172.21.15.19:0/3377410628 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041769621 0 0) 0x7f8d1c15d780 con 0x7f8d1c154620 2024-04-25T10:25:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.972+0000 7f8d22600640 1 --2- 172.21.15.19:0/3377410628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c06c5c0 0x7f8d1c0c9aa0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8d140097a0 tx=0x7f8d1402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136fefed662238be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:33.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.973+0000 7f8d1be00640 1 -- 172.21.15.19:0/3377410628 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14037070 con 0x7f8d1c06c5c0 2024-04-25T10:25:33.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.973+0000 7f8d1be00640 1 -- 172.21.15.19:0/3377410628 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d14032640 con 0x7f8d1c06c5c0 2024-04-25T10:25:33.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.973+0000 7f8d1be00640 1 -- 172.21.15.19:0/3377410628 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14032a10 con 0x7f8d1c06c5c0 2024-04-25T10:25:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.973+0000 7f8d23000640 1 -- 172.21.15.19:0/3377410628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c06c5c0 msgr2=0x7f8d1c0c9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.973+0000 7f8d23000640 1 --2- 172.21.15.19:0/3377410628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c06c5c0 0x7f8d1c0c9aa0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8d140097a0 tx=0x7f8d1402a2c0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.974+0000 7f8d23000640 1 -- 172.21.15.19:0/3377410628 shutdown_connections 2024-04-25T10:25:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.974+0000 7f8d23000640 1 --2- 172.21.15.19:0/3377410628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c06c5c0 0x7f8d1c0c9aa0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.974+0000 7f8d23000640 1 -- 172.21.15.19:0/3377410628 >> 172.21.15.19:0/3377410628 conn(0x7f8d1c0ca9d0 msgr2=0x7f8d1c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.974+0000 7f8d23000640 1 -- 172.21.15.19:0/3377410628 shutdown_connections 2024-04-25T10:25:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.974+0000 7f8d23000640 1 -- 172.21.15.19:0/3377410628 wait complete. 2024-04-25T10:25:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.976+0000 7f8d23000640 1 Processor -- start 2024-04-25T10:25:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.976+0000 7f8d23000640 1 -- start start 2024-04-25T10:25:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.978+0000 7f8d23000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c06c5c0 0x7f8d1c0c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.978+0000 7f8d23000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1c0c86f0 0x7f8d1c0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.978+0000 7f8d23000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c154620 0x7f8d1c151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.978+0000 7f8d23000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c15a1e0 con 0x7f8d1c154620 2024-04-25T10:25:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.978+0000 7f8d23000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c06cb90 con 0x7f8d1c06c5c0 2024-04-25T10:25:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.978+0000 7f8d23000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8d1c15e650 con 0x7f8d1c0c86f0 2024-04-25T10:25:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.978+0000 7f8d22600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c154620 0x7f8d1c151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.978+0000 7f8d22600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c154620 0x7f8d1c151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48970/0 (socket says 172.21.15.19:48970) 2024-04-25T10:25:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.978+0000 7f8d22600640 1 -- 172.21.15.19:0/999937659 learned_addr learned my addr 172.21.15.19:0/999937659 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.978+0000 7f8d21c00640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c06c5c0 0x7f8d1c0c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.978+0000 7f8d21200640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1c0c86f0 0x7f8d1c0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.979+0000 7f8d22600640 1 -- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1c0c86f0 msgr2=0x7f8d1c0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.979+0000 7f8d22600640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1c0c86f0 0x7f8d1c0c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.979+0000 7f8d22600640 1 -- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c06c5c0 msgr2=0x7f8d1c0c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.979+0000 7f8d22600640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c06c5c0 0x7f8d1c0c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.979+0000 7f8d22600640 1 -- 172.21.15.19:0/999937659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c157980 con 0x7f8d1c154620 2024-04-25T10:25:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.979+0000 7f8d22600640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c154620 0x7f8d1c151740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8d140098c0 tx=0x7f8d140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.979+0000 7f8d19600640 1 -- 172.21.15.19:0/999937659 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14041020 con 0x7f8d1c154620 2024-04-25T10:25:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.979+0000 7f8d19600640 1 -- 172.21.15.19:0/999937659 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d140308f0 con 0x7f8d1c154620 2024-04-25T10:25:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.979+0000 7f8d19600640 1 -- 172.21.15.19:0/999937659 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14037040 con 0x7f8d1c154620 2024-04-25T10:25:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.979+0000 7f8d23000640 1 -- 172.21.15.19:0/999937659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1c155580 con 0x7f8d1c154620 2024-04-25T10:25:33.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.980+0000 7f8d23000640 1 -- 172.21.15.19:0/999937659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1c1576a0 con 0x7f8d1c154620 2024-04-25T10:25:33.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.981+0000 7f8d23000640 1 -- 172.21.15.19:0/999937659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1c050740 con 0x7f8d1c154620 2024-04-25T10:25:33.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.982+0000 7f8d19600640 1 -- 172.21.15.19:0/999937659 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8d14044020 con 0x7f8d1c154620 2024-04-25T10:25:33.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.983+0000 7f8d19600640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8cfc0744e0 0x7f8cfc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.983+0000 7f8d19600640 1 -- 172.21.15.19:0/999937659 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8d140b54f0 con 0x7f8d1c154620 2024-04-25T10:25:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.983+0000 7f8d21c00640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8cfc0744e0 0x7f8cfc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.984+0000 7f8d21c00640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8cfc0744e0 0x7f8cfc0769f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0012e0 tx=0x7f8d0c004d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:33.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:33.991+0000 7f8d19600640 1 -- 172.21.15.19:0/999937659 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d1404b070 con 0x7f8d1c154620 2024-04-25T10:25:34.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.199+0000 7f8d23000640 1 -- 172.21.15.19:0/999937659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8d1c15c970 con 0x7f8d1c154620 2024-04-25T10:25:34.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.200+0000 7f8d19600640 1 -- 172.21.15.19:0/999937659 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f8d1407f970 con 0x7f8d1c154620 2024-04-25T10:25:34.202 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:34.202 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-04-25T10:25:34.202 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-04-25T10:25:34.202 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-04-25T10:25:34.202 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-04-25T10:25:34.202 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-04-25T10:25:34.202 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.202+0000 7f8d23000640 1 -- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8cfc0744e0 msgr2=0x7f8cfc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.202+0000 7f8d23000640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8cfc0744e0 0x7f8cfc0769f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0012e0 tx=0x7f8d0c004d40 comp rx=0 tx=0).stop 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.202+0000 7f8d23000640 1 -- 172.21.15.19:0/999937659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c154620 msgr2=0x7f8d1c151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.202+0000 7f8d23000640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c154620 0x7f8d1c151740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8d140098c0 tx=0x7f8d140046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.202+0000 7f8d23000640 1 -- 172.21.15.19:0/999937659 shutdown_connections 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.202+0000 7f8d23000640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d1c154620 0x7f8d1c151740 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.202+0000 7f8d23000640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8cfc0744e0 0x7f8cfc0769f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.202+0000 7f8d23000640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1c0c86f0 0x7f8d1c0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.202+0000 7f8d23000640 1 --2- 172.21.15.19:0/999937659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c06c5c0 0x7f8d1c0c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.202+0000 7f8d23000640 1 -- 172.21.15.19:0/999937659 >> 172.21.15.19:0/999937659 conn(0x7f8d1c0ca9d0 msgr2=0x7f8d1c1526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.203+0000 7f8d23000640 1 -- 172.21.15.19:0/999937659 shutdown_connections 2024-04-25T10:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.203+0000 7f8d23000640 1 -- 172.21.15.19:0/999937659 wait complete. 2024-04-25T10:25:34.230 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:25:34.230 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:25:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.519+0000 7f2804e00640 1 Processor -- start 2024-04-25T10:25:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.520+0000 7f2804e00640 1 -- start start 2024-04-25T10:25:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.521+0000 7f2804e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28000cb3e0 0x7f28000cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.521+0000 7f2804e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2800154650 0x7f28000cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.521+0000 7f2804e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28000ca4b0 con 0x7f28000caf00 2024-04-25T10:25:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.521+0000 7f2804e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f280015b280 con 0x7f28000cb3e0 2024-04-25T10:25:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.521+0000 7f2804e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f28000ca790 con 0x7f2800154650 2024-04-25T10:25:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.522+0000 7f27f6a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28000cb3e0 0x7f28000cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.522+0000 7f27ff400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f28000caf00 0x7f280015ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34944/0 (socket says 172.21.15.19:34944) 2024-04-25T10:25:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.522+0000 7f27ff400640 1 -- 172.21.15.19:0/3128502217 learned_addr learned my addr 172.21.15.19:0/3128502217 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.522+0000 7f27ffe00640 1 --2- 172.21.15.19:0/3128502217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2800154650 0x7f28000cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.522+0000 7f27f6a00640 1 -- 172.21.15.19:0/3128502217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2800154650 msgr2=0x7f28000cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.522+0000 7f27f6a00640 1 --2- 172.21.15.19:0/3128502217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2800154650 0x7f28000cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.522+0000 7f27f6a00640 1 -- 172.21.15.19:0/3128502217 >> v1:172.21.15.19:6789/0 conn(0x7f28000caf00 legacy=0x7f280015ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.522+0000 7f27f6a00640 1 -- 172.21.15.19:0/3128502217 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28000caa70 con 0x7f28000cb3e0 2024-04-25T10:25:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.522+0000 7f27fea00640 1 -- 172.21.15.19:0/3128502217 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990205267 0 0) 0x7f28000ca4b0 con 0x7f28000caf00 2024-04-25T10:25:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.524+0000 7f27f6a00640 1 --2- 172.21.15.19:0/3128502217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28000cb3e0 0x7f28000cc230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27897fbaca1c0743 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.524+0000 7f27fea00640 1 -- 172.21.15.19:0/3128502217 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8007740 con 0x7f28000cb3e0 2024-04-25T10:25:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.524+0000 7f27fea00640 1 -- 172.21.15.19:0/3128502217 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e80078e0 con 0x7f28000cb3e0 2024-04-25T10:25:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.524+0000 7f27fea00640 1 -- 172.21.15.19:0/3128502217 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8007cb0 con 0x7f28000cb3e0 2024-04-25T10:25:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.525+0000 7f2804e00640 1 -- 172.21.15.19:0/3128502217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28000cb3e0 msgr2=0x7f28000cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.525+0000 7f2804e00640 1 --2- 172.21.15.19:0/3128502217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28000cb3e0 0x7f28000cc230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e802a6f0 comp rx=0 tx=0).stop 2024-04-25T10:25:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.525+0000 7f2804e00640 1 -- 172.21.15.19:0/3128502217 shutdown_connections 2024-04-25T10:25:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.525+0000 7f2804e00640 1 --2- 172.21.15.19:0/3128502217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2800154650 0x7f28000cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.525+0000 7f2804e00640 1 --2- 172.21.15.19:0/3128502217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28000cb3e0 0x7f28000cc230 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.525+0000 7f2804e00640 1 -- 172.21.15.19:0/3128502217 >> 172.21.15.19:0/3128502217 conn(0x7f2800069010 msgr2=0x7f2800072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.525+0000 7f2804e00640 1 -- 172.21.15.19:0/3128502217 shutdown_connections 2024-04-25T10:25:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.525+0000 7f2804e00640 1 -- 172.21.15.19:0/3128502217 wait complete. 2024-04-25T10:25:34.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.528+0000 7f2804e00640 1 Processor -- start 2024-04-25T10:25:34.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.528+0000 7f2804e00640 1 -- start start 2024-04-25T10:25:34.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f2804e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28000caf00 0x7f280014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:34.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f2804e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28000cb3e0 0x7f2800159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:34.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f2804e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2800154650 0x7f280015d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:34.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f2804e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f28000710e0 con 0x7f28000cb3e0 2024-04-25T10:25:34.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f2804e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f280015a650 con 0x7f2800154650 2024-04-25T10:25:34.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f2804e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f28000cbe60 con 0x7f28000caf00 2024-04-25T10:25:34.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f27f6a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28000cb3e0 0x7f2800159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:34.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f27f6a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28000cb3e0 0x7f2800159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48998/0 (socket says 172.21.15.19:48998) 2024-04-25T10:25:34.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f27f6a00640 1 -- 172.21.15.19:0/756992754 learned_addr learned my addr 172.21.15.19:0/756992754 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:34.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f27ff400640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28000caf00 0x7f280014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:34.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f27ffe00640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2800154650 0x7f280015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:34.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f27f6a00640 1 -- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28000caf00 msgr2=0x7f280014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:34.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f27f6a00640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28000caf00 0x7f280014f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:34.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f27f6a00640 1 -- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2800154650 msgr2=0x7f280015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:34.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f27f6a00640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2800154650 0x7f280015d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:34.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.530+0000 7f27f6a00640 1 -- 172.21.15.19:0/756992754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2800153130 con 0x7f28000cb3e0 2024-04-25T10:25:34.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.531+0000 7f27f6a00640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28000cb3e0 0x7f2800159cf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:34.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.531+0000 7f27f7e00640 1 -- 172.21.15.19:0/756992754 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e803f070 con 0x7f28000cb3e0 2024-04-25T10:25:34.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.531+0000 7f27f7e00640 1 -- 172.21.15.19:0/756992754 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e8031c40 con 0x7f28000cb3e0 2024-04-25T10:25:34.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.531+0000 7f27f7e00640 1 -- 172.21.15.19:0/756992754 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8044460 con 0x7f28000cb3e0 2024-04-25T10:25:34.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.531+0000 7f2804e00640 1 -- 172.21.15.19:0/756992754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28001539f0 con 0x7f28000cb3e0 2024-04-25T10:25:34.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.531+0000 7f2804e00640 1 -- 172.21.15.19:0/756992754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2800152c10 con 0x7f28000cb3e0 2024-04-25T10:25:34.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.533+0000 7f2804e00640 1 -- 172.21.15.19:0/756992754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28000ca1a0 con 0x7f28000cb3e0 2024-04-25T10:25:34.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.534+0000 7f27f7e00640 1 -- 172.21.15.19:0/756992754 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f27e803b410 con 0x7f28000cb3e0 2024-04-25T10:25:34.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.535+0000 7f27f7e00640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f27dc0744e0 0x7f27dc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:34.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.536+0000 7f27f7e00640 1 -- 172.21.15.19:0/756992754 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f27e80b65c0 con 0x7f28000cb3e0 2024-04-25T10:25:34.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.536+0000 7f27ff400640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f27dc0744e0 0x7f27dc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:34.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.537+0000 7f27ff400640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f27dc0744e0 0x7f27dc0769f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27f0007fd0 tx=0x7f27f0007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:34.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.540+0000 7f27f7e00640 1 -- 172.21.15.19:0/756992754 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f28000ca1a0 con 0x7f28000cb3e0 2024-04-25T10:25:34.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:34.744+0000 7f2804e00640 1 -- 172.21.15.19:0/756992754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2800153f10 con 0x7f28000cb3e0 2024-04-25T10:25:35.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.129+0000 7f27f7e00640 1 -- 172.21.15.19:0/756992754 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f27e8080ad0 con 0x7f28000cb3e0 2024-04-25T10:25:35.132 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-04-25T10:25:35.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.133+0000 7f2804e00640 1 -- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f27dc0744e0 msgr2=0x7f27dc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:35.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.133+0000 7f2804e00640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f27dc0744e0 0x7f27dc0769f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27f0007fd0 tx=0x7f27f0007de0 comp rx=0 tx=0).stop 2024-04-25T10:25:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.133+0000 7f2804e00640 1 -- 172.21.15.19:0/756992754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28000cb3e0 msgr2=0x7f2800159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.133+0000 7f2804e00640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28000cb3e0 0x7f2800159cf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e8004a40 comp rx=0 tx=0).stop 2024-04-25T10:25:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.134+0000 7f2804e00640 1 -- 172.21.15.19:0/756992754 shutdown_connections 2024-04-25T10:25:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.134+0000 7f2804e00640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2800154650 0x7f280015d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.134+0000 7f2804e00640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28000cb3e0 0x7f2800159cf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.134+0000 7f2804e00640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f27dc0744e0 0x7f27dc0769f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.134+0000 7f2804e00640 1 --2- 172.21.15.19:0/756992754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28000caf00 0x7f280014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.134+0000 7f2804e00640 1 -- 172.21.15.19:0/756992754 >> 172.21.15.19:0/756992754 conn(0x7f2800069010 msgr2=0x7f28000b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.134+0000 7f2804e00640 1 -- 172.21.15.19:0/756992754 shutdown_connections 2024-04-25T10:25:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.134+0000 7f2804e00640 1 -- 172.21.15.19:0/756992754 wait complete. 2024-04-25T10:25:35.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T10:25:35.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.438+0000 7f5408e00640 1 Processor -- start 2024-04-25T10:25:35.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.438+0000 7f5408e00640 1 -- start start 2024-04-25T10:25:35.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.440+0000 7f5408e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f54040c8e20 0x7f54040742a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:35.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.440+0000 7f5408e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f54040747e0 0x7f5404166bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:35.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.441+0000 7f5408e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54040c9230 con 0x7f5404156760 2024-04-25T10:25:35.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.441+0000 7f5408e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f54040c94c0 con 0x7f54040747e0 2024-04-25T10:25:35.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.441+0000 7f5408e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f54040c5320 con 0x7f54040c8e20 2024-04-25T10:25:35.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.441+0000 7f5403400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5404156760 0x7f54040c9dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34952/0 (socket says 172.21.15.19:34952) 2024-04-25T10:25:35.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.441+0000 7f5403400640 1 -- 172.21.15.19:0/2857909508 learned_addr learned my addr 172.21.15.19:0/2857909508 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:35.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.441+0000 7f5403e00640 1 --2- 172.21.15.19:0/2857909508 >> v2:172.21.15.19:3300/0 conn(0x7f54040747e0 0x7f5404166bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:35.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.441+0000 7f5402a00640 1 --2- 172.21.15.19:0/2857909508 >> v2:172.21.15.112:3300/0 conn(0x7f54040c8e20 0x7f54040742a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:35.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.441+0000 7f5402000640 1 -- 172.21.15.19:0/2857909508 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2169385335 0 0) 0x7f54040c9230 con 0x7f5404156760 2024-04-25T10:25:35.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.442+0000 7f5402000640 1 -- 172.21.15.19:0/2857909508 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53e8003520 con 0x7f5404156760 2024-04-25T10:25:35.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.442+0000 7f5403e00640 1 -- 172.21.15.19:0/2857909508 >> v2:172.21.15.112:3300/0 conn(0x7f54040c8e20 msgr2=0x7f54040742a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:35.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.442+0000 7f5403e00640 1 --2- 172.21.15.19:0/2857909508 >> v2:172.21.15.112:3300/0 conn(0x7f54040c8e20 0x7f54040742a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:35.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.442+0000 7f5403e00640 1 -- 172.21.15.19:0/2857909508 >> v1:172.21.15.19:6789/0 conn(0x7f5404156760 legacy=0x7f54040c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:35.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.442+0000 7f5403e00640 1 -- 172.21.15.19:0/2857909508 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54040c8740 con 0x7f54040747e0 2024-04-25T10:25:35.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.442+0000 7f5402a00640 1 --2- 172.21.15.19:0/2857909508 >> v2:172.21.15.112:3300/0 conn(0x7f54040c8e20 0x7f54040742a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:35.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.443+0000 7f5403e00640 1 --2- 172.21.15.19:0/2857909508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54040747e0 0x7f5404166bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5404075a00 tx=0x7f53fc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6f858a89954803 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:35.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.443+0000 7f5402000640 1 -- 172.21.15.19:0/2857909508 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc007740 con 0x7f54040747e0 2024-04-25T10:25:35.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.443+0000 7f5402000640 1 -- 172.21.15.19:0/2857909508 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc0078e0 con 0x7f54040747e0 2024-04-25T10:25:35.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.443+0000 7f5402000640 1 -- 172.21.15.19:0/2857909508 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc007c90 con 0x7f54040747e0 2024-04-25T10:25:35.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.444+0000 7f5408e00640 1 -- 172.21.15.19:0/2857909508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54040747e0 msgr2=0x7f5404166bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:35.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.444+0000 7f5408e00640 1 --2- 172.21.15.19:0/2857909508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54040747e0 0x7f5404166bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5404075a00 tx=0x7f53fc02a680 comp rx=0 tx=0).stop 2024-04-25T10:25:35.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.444+0000 7f5408e00640 1 -- 172.21.15.19:0/2857909508 shutdown_connections 2024-04-25T10:25:35.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.444+0000 7f5408e00640 1 --2- 172.21.15.19:0/2857909508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54040747e0 0x7f5404166bc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:35.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.444+0000 7f5408e00640 1 --2- 172.21.15.19:0/2857909508 >> v2:172.21.15.112:3300/0 conn(0x7f54040c8e20 0x7f54040742a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:35.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.444+0000 7f5408e00640 1 -- 172.21.15.19:0/2857909508 >> 172.21.15.19:0/2857909508 conn(0x7f5404073780 msgr2=0x7f5404073b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:35.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.444+0000 7f5408e00640 1 -- 172.21.15.19:0/2857909508 shutdown_connections 2024-04-25T10:25:35.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.444+0000 7f5408e00640 1 -- 172.21.15.19:0/2857909508 wait complete. 2024-04-25T10:25:35.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.447+0000 7f5408e00640 1 Processor -- start 2024-04-25T10:25:35.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.447+0000 7f5408e00640 1 -- start start 2024-04-25T10:25:35.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.448+0000 7f5408e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f54040747e0 0x7f54041f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:35.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.448+0000 7f5408e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54040c8e20 0x7f540415d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:35.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.448+0000 7f5408e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5404156760 0x7f540414ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:35.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.448+0000 7f5408e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f54040c7fe0 con 0x7f54040c8e20 2024-04-25T10:25:35.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.448+0000 7f5408e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f540406e080 con 0x7f5404156760 2024-04-25T10:25:35.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.448+0000 7f5408e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f540415f850 con 0x7f54040747e0 2024-04-25T10:25:35.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.449+0000 7f5402a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54040c8e20 0x7f540415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:35.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.449+0000 7f5403e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5404156760 0x7f540414ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:35.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.449+0000 7f5402a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54040c8e20 0x7f540415d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49012/0 (socket says 172.21.15.19:49012) 2024-04-25T10:25:35.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.449+0000 7f5402a00640 1 -- 172.21.15.19:0/2759366917 learned_addr learned my addr 172.21.15.19:0/2759366917 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:35.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.449+0000 7f5403400640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f54040747e0 0x7f54041f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:35.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.449+0000 7f5402a00640 1 -- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f54040747e0 msgr2=0x7f54041f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:35.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.449+0000 7f5402a00640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f54040747e0 0x7f54041f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:35.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.449+0000 7f5402a00640 1 -- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5404156760 msgr2=0x7f540414ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:35.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.449+0000 7f5402a00640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5404156760 0x7f540414ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:35.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.449+0000 7f5402a00640 1 -- 172.21.15.19:0/2759366917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54041f2fe0 con 0x7f54040c8e20 2024-04-25T10:25:35.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.449+0000 7f5403e00640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5404156760 0x7f540414ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:35.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.450+0000 7f5402a00640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54040c8e20 0x7f540415d940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53f000e990 tx=0x7f53f000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:35.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.450+0000 7f53fb400640 1 -- 172.21.15.19:0/2759366917 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0017070 con 0x7f54040c8e20 2024-04-25T10:25:35.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.450+0000 7f53fb400640 1 -- 172.21.15.19:0/2759366917 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f000c980 con 0x7f54040c8e20 2024-04-25T10:25:35.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.450+0000 7f53fb400640 1 -- 172.21.15.19:0/2759366917 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f000cd50 con 0x7f54040c8e20 2024-04-25T10:25:35.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.450+0000 7f5408e00640 1 -- 172.21.15.19:0/2759366917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54040cbc70 con 0x7f54040c8e20 2024-04-25T10:25:35.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.450+0000 7f5408e00640 1 -- 172.21.15.19:0/2759366917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54040cc230 con 0x7f54040c8e20 2024-04-25T10:25:35.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.451+0000 7f5408e00640 1 -- 172.21.15.19:0/2759366917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5404050740 con 0x7f54040c8e20 2024-04-25T10:25:35.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.453+0000 7f53fb400640 1 -- 172.21.15.19:0/2759366917 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f53f001a070 con 0x7f54040c8e20 2024-04-25T10:25:35.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.454+0000 7f53fb400640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53e40744e0 0x7f53e40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:35.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.455+0000 7f53fb400640 1 -- 172.21.15.19:0/2759366917 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f53f0094e50 con 0x7f54040c8e20 2024-04-25T10:25:35.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.455+0000 7f5403400640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53e40744e0 0x7f53e40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:35.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.456+0000 7f5403400640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53e40744e0 0x7f53e40769f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53f4005880 tx=0x7f53f4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.461+0000 7f53fb400640 1 -- 172.21.15.19:0/2759366917 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53f005f0d0 con 0x7f54040c8e20 2024-04-25T10:25:35.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:35.670+0000 7f5408e00640 1 -- 172.21.15.19:0/2759366917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f5404156360 con 0x7f54040c8e20 2024-04-25T10:25:36.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.145+0000 7f53fb400640 1 -- 172.21.15.19:0/2759366917 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f53f00633d0 con 0x7f54040c8e20 2024-04-25T10:25:36.147 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-04-25T10:25:36.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.150+0000 7f5408e00640 1 -- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53e40744e0 msgr2=0x7f53e40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:36.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.150+0000 7f5408e00640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53e40744e0 0x7f53e40769f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53f4005880 tx=0x7f53f4009040 comp rx=0 tx=0).stop 2024-04-25T10:25:36.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.150+0000 7f5408e00640 1 -- 172.21.15.19:0/2759366917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54040c8e20 msgr2=0x7f540415d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:36.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.150+0000 7f5408e00640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54040c8e20 0x7f540415d940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53f000e990 tx=0x7f53f000ee50 comp rx=0 tx=0).stop 2024-04-25T10:25:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.151+0000 7f5408e00640 1 -- 172.21.15.19:0/2759366917 shutdown_connections 2024-04-25T10:25:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.151+0000 7f5408e00640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5404156760 0x7f540414ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:36.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.151+0000 7f5408e00640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54040c8e20 0x7f540415d940 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:36.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.151+0000 7f5408e00640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53e40744e0 0x7f53e40769f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:36.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.151+0000 7f5408e00640 1 --2- 172.21.15.19:0/2759366917 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f54040747e0 0x7f54041f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:36.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.151+0000 7f5408e00640 1 -- 172.21.15.19:0/2759366917 >> 172.21.15.19:0/2759366917 conn(0x7f5404073780 msgr2=0x7f5404155c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:36.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.157+0000 7f5408e00640 1 -- 172.21.15.19:0/2759366917 shutdown_connections 2024-04-25T10:25:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.157+0000 7f5408e00640 1 -- 172.21.15.19:0/2759366917 wait complete. 2024-04-25T10:25:36.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:25:36.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.453+0000 7f408be00640 1 Processor -- start 2024-04-25T10:25:36.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.453+0000 7f408be00640 1 -- start start 2024-04-25T10:25:36.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.455+0000 7f408be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f408c06fd20 0x7f408c0c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:36.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.455+0000 7f408be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 0x7f408c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:36.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.455+0000 7f408be00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f408c1544e0 0x7f408c06ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:36.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.455+0000 7f408be00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f408c1548f0 con 0x7f408c1544e0 2024-04-25T10:25:36.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.455+0000 7f408be00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f408c0c6dd0 con 0x7f408c06fd20 2024-04-25T10:25:36.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.455+0000 7f408be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f408c15af60 con 0x7f408c0c77a0 2024-04-25T10:25:36.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f408c06fd20 0x7f408c0c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:36.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 0x7f408c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:36.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 0x7f408c153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:54972/0 (socket says 172.21.15.19:54972) 2024-04-25T10:25:36.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408a000640 1 -- 172.21.15.19:0/1282421438 learned_addr learned my addr 172.21.15.19:0/1282421438 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:36.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f408c06fd20 0x7f408c0c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:58384/0 (socket says 172.21.15.19:58384) 2024-04-25T10:25:36.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408b400640 1 --2- 172.21.15.19:0/1282421438 >> v2:172.21.15.19:3300/0 conn(0x7f408c1544e0 0x7f408c06ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:36.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408a000640 1 -- 172.21.15.19:0/1282421438 >> v2:172.21.15.112:3300/0 conn(0x7f408c06fd20 msgr2=0x7f408c0c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:36.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408a000640 1 --2- 172.21.15.19:0/1282421438 >> v2:172.21.15.112:3300/0 conn(0x7f408c06fd20 0x7f408c0c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:36.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408a000640 1 -- 172.21.15.19:0/1282421438 >> v2:172.21.15.19:3300/0 conn(0x7f408c1544e0 msgr2=0x7f408c06ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:36.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408a000640 1 --2- 172.21.15.19:0/1282421438 >> v2:172.21.15.19:3300/0 conn(0x7f408c1544e0 0x7f408c06ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:36.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408a000640 1 -- 172.21.15.19:0/1282421438 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408c0c61c0 con 0x7f408c0c77a0 2024-04-25T10:25:36.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.456+0000 7f408aa00640 1 --2- 172.21.15.19:0/1282421438 >> v2:172.21.15.112:3300/0 conn(0x7f408c06fd20 0x7f408c0c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:36.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.457+0000 7f408a000640 1 --2- 172.21.15.19:0/1282421438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 0x7f408c153fa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f408c072970 tx=0x7f407402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c38acee68e0c983 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.458+0000 7f4089600640 1 -- 172.21.15.19:0/1282421438 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074037070 con 0x7f408c0c77a0 2024-04-25T10:25:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.458+0000 7f4089600640 1 -- 172.21.15.19:0/1282421438 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4074032440 con 0x7f408c0c77a0 2024-04-25T10:25:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.458+0000 7f4089600640 1 -- 172.21.15.19:0/1282421438 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074032810 con 0x7f408c0c77a0 2024-04-25T10:25:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.459+0000 7f408be00640 1 -- 172.21.15.19:0/1282421438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 msgr2=0x7f408c153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.459+0000 7f408be00640 1 --2- 172.21.15.19:0/1282421438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 0x7f408c153fa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f408c072970 tx=0x7f407402a270 comp rx=0 tx=0).stop 2024-04-25T10:25:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.459+0000 7f408be00640 1 -- 172.21.15.19:0/1282421438 shutdown_connections 2024-04-25T10:25:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.459+0000 7f408be00640 1 --2- 172.21.15.19:0/1282421438 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 0x7f408c153fa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.459+0000 7f408be00640 1 --2- 172.21.15.19:0/1282421438 >> v2:172.21.15.19:3300/0 conn(0x7f408c1544e0 0x7f408c06ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.459+0000 7f408be00640 1 --2- 172.21.15.19:0/1282421438 >> v2:172.21.15.112:3300/0 conn(0x7f408c06fd20 0x7f408c0c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.459+0000 7f408be00640 1 -- 172.21.15.19:0/1282421438 >> 172.21.15.19:0/1282421438 conn(0x7f408c0ca120 msgr2=0x7f408c0ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.459+0000 7f408be00640 1 -- 172.21.15.19:0/1282421438 shutdown_connections 2024-04-25T10:25:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.459+0000 7f408be00640 1 -- 172.21.15.19:0/1282421438 wait complete. 2024-04-25T10:25:36.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.461+0000 7f408be00640 1 Processor -- start 2024-04-25T10:25:36.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.461+0000 7f408be00640 1 -- start start 2024-04-25T10:25:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.463+0000 7f408be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f408c06fd20 0x7f408c143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.463+0000 7f408be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 0x7f408c1e4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.463+0000 7f408be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f408c1544e0 0x7f408c0c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.463+0000 7f408be00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f408c0c6a60 con 0x7f408c1544e0 2024-04-25T10:25:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.463+0000 7f408be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f408c0c6780 con 0x7f408c06fd20 2024-04-25T10:25:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.463+0000 7f408be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f408c073010 con 0x7f408c0c77a0 2024-04-25T10:25:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.463+0000 7f408b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f408c1544e0 0x7f408c0c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.463+0000 7f408b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f408c1544e0 0x7f408c0c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49026/0 (socket says 172.21.15.19:49026) 2024-04-25T10:25:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.463+0000 7f408b400640 1 -- 172.21.15.19:0/2826466221 learned_addr learned my addr 172.21.15.19:0/2826466221 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.463+0000 7f408a000640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 0x7f408c1e4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.463+0000 7f408aa00640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f408c06fd20 0x7f408c143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.464+0000 7f408b400640 1 -- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 msgr2=0x7f408c1e4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.464+0000 7f408b400640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 0x7f408c1e4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.464+0000 7f408b400640 1 -- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f408c06fd20 msgr2=0x7f408c143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.464+0000 7f408b400640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f408c06fd20 0x7f408c143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.464+0000 7f408b400640 1 -- 172.21.15.19:0/2826466221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408c1e5460 con 0x7f408c1544e0 2024-04-25T10:25:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.464+0000 7f408b400640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f408c1544e0 0x7f408c0c8d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f408400efc0 tx=0x7f408400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.464+0000 7f4082a00640 1 -- 172.21.15.19:0/2826466221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084018020 con 0x7f408c1544e0 2024-04-25T10:25:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.464+0000 7f4082a00640 1 -- 172.21.15.19:0/2826466221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4084014480 con 0x7f408c1544e0 2024-04-25T10:25:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.464+0000 7f4082a00640 1 -- 172.21.15.19:0/2826466221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084009e60 con 0x7f408c1544e0 2024-04-25T10:25:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.464+0000 7f408be00640 1 -- 172.21.15.19:0/2826466221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408c0c2de0 con 0x7f408c1544e0 2024-04-25T10:25:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.464+0000 7f408be00640 1 -- 172.21.15.19:0/2826466221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f408c0c37b0 con 0x7f408c1544e0 2024-04-25T10:25:36.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.466+0000 7f408be00640 1 -- 172.21.15.19:0/2826466221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f408c076520 con 0x7f408c1544e0 2024-04-25T10:25:36.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.467+0000 7f4082a00640 1 -- 172.21.15.19:0/2826466221 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4084005d10 con 0x7f408c1544e0 2024-04-25T10:25:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.468+0000 7f4082a00640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f40680744b0 0x7f40680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.468+0000 7f4082a00640 1 -- 172.21.15.19:0/2826466221 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f4084095de0 con 0x7f408c1544e0 2024-04-25T10:25:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.468+0000 7f408aa00640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f40680744b0 0x7f40680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.469+0000 7f408aa00640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f40680744b0 0x7f40680769c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f407c009580 tx=0x7f407c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.474+0000 7f4082a00640 1 -- 172.21.15.19:0/2826466221 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4084022030 con 0x7f408c1544e0 2024-04-25T10:25:36.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:36.723+0000 7f408be00640 1 -- 172.21.15.19:0/2826466221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f408c075fc0 con 0x7f408c1544e0 2024-04-25T10:25:37.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.148+0000 7f4082a00640 1 -- 172.21.15.19:0/2826466221 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f4084010040 con 0x7f408c1544e0 2024-04-25T10:25:37.150 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T10:25:37.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.154+0000 7f408be00640 1 -- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f40680744b0 msgr2=0x7f40680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:37.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.154+0000 7f408be00640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f40680744b0 0x7f40680769c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f407c009580 tx=0x7f407c009190 comp rx=0 tx=0).stop 2024-04-25T10:25:37.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.154+0000 7f408be00640 1 -- 172.21.15.19:0/2826466221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f408c1544e0 msgr2=0x7f408c0c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:37.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.154+0000 7f408be00640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f408c1544e0 0x7f408c0c8d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f408400efc0 tx=0x7f408400c490 comp rx=0 tx=0).stop 2024-04-25T10:25:37.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.155+0000 7f408be00640 1 -- 172.21.15.19:0/2826466221 shutdown_connections 2024-04-25T10:25:37.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.155+0000 7f408be00640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f408c1544e0 0x7f408c0c8d60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:37.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.155+0000 7f408be00640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f40680744b0 0x7f40680769c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:37.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.155+0000 7f408be00640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f408c0c77a0 0x7f408c1e4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:37.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.155+0000 7f408be00640 1 --2- 172.21.15.19:0/2826466221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f408c06fd20 0x7f408c143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:37.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.155+0000 7f408be00640 1 -- 172.21.15.19:0/2826466221 >> 172.21.15.19:0/2826466221 conn(0x7f408c0ca120 msgr2=0x7f408c0cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:37.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.155+0000 7f408be00640 1 -- 172.21.15.19:0/2826466221 shutdown_connections 2024-04-25T10:25:37.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.155+0000 7f408be00640 1 -- 172.21.15.19:0/2826466221 wait complete. 2024-04-25T10:25:37.221 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T10:25:37.221 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T10:25:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.476+0000 7f3ae2000640 1 Processor -- start 2024-04-25T10:25:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.476+0000 7f3ae2000640 1 -- start start 2024-04-25T10:25:37.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.478+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc0c7d50 0x7f3adc0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:37.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.478+0000 7f3ae2000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3adc0c8160 0x7f3adc0cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.478+0000 7f3ae2000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3adc0735f0 con 0x7f3adc15aed0 2024-04-25T10:25:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.478+0000 7f3ae2000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3adc0ca700 con 0x7f3adc0c8160 2024-04-25T10:25:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.478+0000 7f3ae2000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3adc0c9e10 con 0x7f3adc0c7d50 2024-04-25T10:25:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.479+0000 7f3ae0c00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3adc15aed0 0x7f3adc0745b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34954/0 (socket says 172.21.15.19:34954) 2024-04-25T10:25:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.479+0000 7f3ae0c00640 1 -- 172.21.15.19:0/2458723688 learned_addr learned my addr 172.21.15.19:0/2458723688 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.479+0000 7f3adbe00640 1 --2- 172.21.15.19:0/2458723688 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc0c7d50 0x7f3adc0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.479+0000 7f3ae1600640 1 --2- 172.21.15.19:0/2458723688 >> v2:172.21.15.19:3300/0 conn(0x7f3adc0c8160 0x7f3adc0cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.479+0000 7f3adbe00640 1 -- 172.21.15.19:0/2458723688 >> v2:172.21.15.19:3300/0 conn(0x7f3adc0c8160 msgr2=0x7f3adc0cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.479+0000 7f3adbe00640 1 --2- 172.21.15.19:0/2458723688 >> v2:172.21.15.19:3300/0 conn(0x7f3adc0c8160 0x7f3adc0cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:37.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.479+0000 7f3adbe00640 1 -- 172.21.15.19:0/2458723688 >> v1:172.21.15.19:6789/0 conn(0x7f3adc15aed0 legacy=0x7f3adc0745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:37.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.479+0000 7f3adbe00640 1 -- 172.21.15.19:0/2458723688 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3adc073310 con 0x7f3adc0c7d50 2024-04-25T10:25:37.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.481+0000 7f3adbe00640 1 --2- 172.21.15.19:0/2458723688 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc0c7d50 0x7f3adc0cd5b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80097a0 tx=0x7f3ac802a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7422c47b5c99bd92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:37.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.481+0000 7f3adb400640 1 -- 172.21.15.19:0/2458723688 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8037070 con 0x7f3adc0c7d50 2024-04-25T10:25:37.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.481+0000 7f3adb400640 1 -- 172.21.15.19:0/2458723688 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac8032440 con 0x7f3adc0c7d50 2024-04-25T10:25:37.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.481+0000 7f3adb400640 1 -- 172.21.15.19:0/2458723688 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8032810 con 0x7f3adc0c7d50 2024-04-25T10:25:37.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.482+0000 7f3ae2000640 1 -- 172.21.15.19:0/2458723688 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc0c7d50 msgr2=0x7f3adc0cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:37.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.482+0000 7f3ae2000640 1 --2- 172.21.15.19:0/2458723688 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc0c7d50 0x7f3adc0cd5b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80097a0 tx=0x7f3ac802a230 comp rx=0 tx=0).stop 2024-04-25T10:25:37.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.482+0000 7f3ae2000640 1 -- 172.21.15.19:0/2458723688 shutdown_connections 2024-04-25T10:25:37.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.482+0000 7f3ae2000640 1 --2- 172.21.15.19:0/2458723688 >> v2:172.21.15.19:3300/0 conn(0x7f3adc0c8160 0x7f3adc0cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:37.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.482+0000 7f3ae2000640 1 --2- 172.21.15.19:0/2458723688 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc0c7d50 0x7f3adc0cd5b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:37.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.482+0000 7f3ae2000640 1 -- 172.21.15.19:0/2458723688 >> 172.21.15.19:0/2458723688 conn(0x7f3adc070ca0 msgr2=0x7f3adc0710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:37.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.482+0000 7f3ae2000640 1 -- 172.21.15.19:0/2458723688 shutdown_connections 2024-04-25T10:25:37.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.482+0000 7f3ae2000640 1 -- 172.21.15.19:0/2458723688 wait complete. 2024-04-25T10:25:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.484+0000 7f3ae2000640 1 Processor -- start 2024-04-25T10:25:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.484+0000 7f3ae2000640 1 -- start start 2024-04-25T10:25:37.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.486+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3adc0c7d50 0x7f3adc0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:37.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.486+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc0c8160 0x7f3adc151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:37.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.486+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc15aed0 0x7f3adc1521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:37.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.486+0000 7f3ae2000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc0cab90 con 0x7f3adc0c7d50 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.486+0000 7f3ae2000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc0ca390 con 0x7f3adc0c8160 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.486+0000 7f3ae2000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3adc072ed0 con 0x7f3adc15aed0 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.486+0000 7f3ae0c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3adc0c7d50 0x7f3adc0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.486+0000 7f3adbe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc0c8160 0x7f3adc151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.486+0000 7f3ae0c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3adc0c7d50 0x7f3adc0cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49042/0 (socket says 172.21.15.19:49042) 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.486+0000 7f3ae0c00640 1 -- 172.21.15.19:0/2417466416 learned_addr learned my addr 172.21.15.19:0/2417466416 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.486+0000 7f3ae1600640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc15aed0 0x7f3adc1521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ae0c00640 1 -- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc15aed0 msgr2=0x7f3adc1521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ae0c00640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc15aed0 0x7f3adc1521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ae0c00640 1 -- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc0c8160 msgr2=0x7f3adc151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ae0c00640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc0c8160 0x7f3adc151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ae0c00640 1 -- 172.21.15.19:0/2417466416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3adc1f1200 con 0x7f3adc0c7d50 2024-04-25T10:25:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3adbe00640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc0c8160 0x7f3adc151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ae1600640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc15aed0 0x7f3adc1521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ae0c00640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3adc0c7d50 0x7f3adc0cc430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c3c0 tx=0x7f3ad000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ad8c00640 1 -- 172.21.15.19:0/2417466416 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0017070 con 0x7f3adc0c7d50 2024-04-25T10:25:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ad8c00640 1 -- 172.21.15.19:0/2417466416 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad0005ce0 con 0x7f3adc0c7d50 2024-04-25T10:25:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ae2000640 1 -- 172.21.15.19:0/2417466416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3adc1f4a50 con 0x7f3adc0c7d50 2024-04-25T10:25:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ad8c00640 1 -- 172.21.15.19:0/2417466416 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad00072f0 con 0x7f3adc0c7d50 2024-04-25T10:25:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.487+0000 7f3ae2000640 1 -- 172.21.15.19:0/2417466416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3adc15aa00 con 0x7f3adc0c7d50 2024-04-25T10:25:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.488+0000 7f3ae2000640 1 -- 172.21.15.19:0/2417466416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3adc0705b0 con 0x7f3adc0c7d50 2024-04-25T10:25:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.489+0000 7f3ad8c00640 1 -- 172.21.15.19:0/2417466416 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3ad001a070 con 0x7f3adc0c7d50 2024-04-25T10:25:37.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.490+0000 7f3ad8c00640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3abc0744b0 0x7f3abc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:37.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.491+0000 7f3ad8c00640 1 -- 172.21.15.19:0/2417466416 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f3ad0094540 con 0x7f3adc0c7d50 2024-04-25T10:25:37.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.491+0000 7f3adbe00640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3abc0744b0 0x7f3abc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:37.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.491+0000 7f3adbe00640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3abc0744b0 0x7f3abc0769c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8034000 tx=0x7f3ac802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:37.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.496+0000 7f3ad8c00640 1 -- 172.21.15.19:0/2417466416 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3adc0705b0 con 0x7f3adc0c7d50 2024-04-25T10:25:37.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:37.701+0000 7f3ae2000640 1 -- 172.21.15.19:0/2417466416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f3adc050740 con 0x7f3adc0c7d50 2024-04-25T10:25:38.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.163+0000 7f3ad8c00640 1 -- 172.21.15.19:0/2417466416 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f3ad005e670 con 0x7f3adc0c7d50 2024-04-25T10:25:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.167+0000 7f3ae2000640 1 -- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3abc0744b0 msgr2=0x7f3abc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.167+0000 7f3ae2000640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3abc0744b0 0x7f3abc0769c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8034000 tx=0x7f3ac802e000 comp rx=0 tx=0).stop 2024-04-25T10:25:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.167+0000 7f3ae2000640 1 -- 172.21.15.19:0/2417466416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3adc0c7d50 msgr2=0x7f3adc0cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.167+0000 7f3ae2000640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3adc0c7d50 0x7f3adc0cc430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c3c0 tx=0x7f3ad000c880 comp rx=0 tx=0).stop 2024-04-25T10:25:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.167+0000 7f3ae2000640 1 -- 172.21.15.19:0/2417466416 shutdown_connections 2024-04-25T10:25:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.167+0000 7f3ae2000640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3abc0744b0 0x7f3abc0769c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.167+0000 7f3ae2000640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3adc15aed0 0x7f3adc1521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.167+0000 7f3ae2000640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3adc0c8160 0x7f3adc151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.167+0000 7f3ae2000640 1 --2- 172.21.15.19:0/2417466416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3adc0c7d50 0x7f3adc0cc430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:38.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.167+0000 7f3ae2000640 1 -- 172.21.15.19:0/2417466416 >> 172.21.15.19:0/2417466416 conn(0x7f3adc070ca0 msgr2=0x7f3adc15d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:38.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.168+0000 7f3ae2000640 1 -- 172.21.15.19:0/2417466416 shutdown_connections 2024-04-25T10:25:38.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.168+0000 7f3ae2000640 1 -- 172.21.15.19:0/2417466416 wait complete. 2024-04-25T10:25:38.202 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:25:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.485+0000 7f7ac3e00640 1 Processor -- start 2024-04-25T10:25:38.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.485+0000 7f7ac3e00640 1 -- start start 2024-04-25T10:25:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.487+0000 7f7ac3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7ac40c26b0 0x7f7ac40c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.488+0000 7f7ac3e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac4158ff0 con 0x7f7ac4074190 2024-04-25T10:25:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.488+0000 7f7ac3e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac4159270 con 0x7f7ac40c4560 2024-04-25T10:25:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.488+0000 7f7ac3e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac4159e80 con 0x7f7ac40c26b0 2024-04-25T10:25:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.488+0000 7f7ac2a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7ac40c4560 0x7f7ac4142220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:37756/0 (socket says 172.21.15.19:37756) 2024-04-25T10:25:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.488+0000 7f7ac2a00640 1 -- 172.21.15.19:0/3893968383 learned_addr learned my addr 172.21.15.19:0/3893968383 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.488+0000 7f7aba000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7ac40c26b0 0x7f7ac40c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.488+0000 7f7aba000640 1 -- 172.21.15.19:0/3893968383 >> v1:172.21.15.112:6789/0 conn(0x7f7ac40c4560 legacy=0x7f7ac4142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.488+0000 7f7aba000640 1 -- 172.21.15.19:0/3893968383 >> v1:172.21.15.19:6789/0 conn(0x7f7ac4074190 legacy=0x7f7ac40730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.488+0000 7f7aba000640 1 -- 172.21.15.19:0/3893968383 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac4159550 con 0x7f7ac40c26b0 2024-04-25T10:25:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.488+0000 7f7ac2000640 1 -- 172.21.15.19:0/3893968383 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481788368 0 0) 0x7f7ac4159270 con 0x7f7ac40c4560 2024-04-25T10:25:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.490+0000 7f7aba000640 1 --2- 172.21.15.19:0/3893968383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac40c26b0 0x7f7ac40c2ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009dc0 tx=0x7f7aac02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373c55b3d74e27f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.490+0000 7f7ac2000640 1 -- 172.21.15.19:0/3893968383 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac036020 con 0x7f7ac40c26b0 2024-04-25T10:25:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.490+0000 7f7ac2000640 1 -- 172.21.15.19:0/3893968383 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac032800 con 0x7f7ac40c26b0 2024-04-25T10:25:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.490+0000 7f7ac2000640 1 -- 172.21.15.19:0/3893968383 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac032bd0 con 0x7f7ac40c26b0 2024-04-25T10:25:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.491+0000 7f7ac3e00640 1 -- 172.21.15.19:0/3893968383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac40c26b0 msgr2=0x7f7ac40c2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.491+0000 7f7ac3e00640 1 --2- 172.21.15.19:0/3893968383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac40c26b0 0x7f7ac40c2ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009dc0 tx=0x7f7aac02c940 comp rx=0 tx=0).stop 2024-04-25T10:25:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.491+0000 7f7ac3e00640 1 -- 172.21.15.19:0/3893968383 shutdown_connections 2024-04-25T10:25:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.491+0000 7f7ac3e00640 1 --2- 172.21.15.19:0/3893968383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac40c26b0 0x7f7ac40c2ac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.491+0000 7f7ac3e00640 1 -- 172.21.15.19:0/3893968383 >> 172.21.15.19:0/3893968383 conn(0x7f7ac40cd690 msgr2=0x7f7ac40cdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.491+0000 7f7ac3e00640 1 -- 172.21.15.19:0/3893968383 shutdown_connections 2024-04-25T10:25:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.491+0000 7f7ac3e00640 1 -- 172.21.15.19:0/3893968383 wait complete. 2024-04-25T10:25:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.493+0000 7f7ac3e00640 1 Processor -- start 2024-04-25T10:25:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.493+0000 7f7ac3e00640 1 -- start start 2024-04-25T10:25:38.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.495+0000 7f7ac3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac4074190 0x7f7ac41f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.495+0000 7f7ac3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ac40c26b0 0x7f7ac4153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.495+0000 7f7ac3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac40c4560 0x7f7ac4154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.495+0000 7f7ac3e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac40737d0 con 0x7f7ac4074190 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.495+0000 7f7ac3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac4159b10 con 0x7f7ac40c4560 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.495+0000 7f7ac3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac4073950 con 0x7f7ac40c26b0 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.495+0000 7f7ac2a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac4074190 0x7f7ac41f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.495+0000 7f7ac2a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac4074190 0x7f7ac41f6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50942/0 (socket says 172.21.15.19:50942) 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.495+0000 7f7ac2a00640 1 -- 172.21.15.19:0/2882629585 learned_addr learned my addr 172.21.15.19:0/2882629585 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.495+0000 7f7ac3400640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac40c4560 0x7f7ac4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.495+0000 7f7aba000640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ac40c26b0 0x7f7ac4153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.496+0000 7f7ac2a00640 1 -- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ac40c26b0 msgr2=0x7f7ac4153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.496+0000 7f7ac2a00640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ac40c26b0 0x7f7ac4153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.496+0000 7f7ac2a00640 1 -- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac40c4560 msgr2=0x7f7ac4154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.496+0000 7f7ac2a00640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac40c4560 0x7f7ac4154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.496+0000 7f7ac2a00640 1 -- 172.21.15.19:0/2882629585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac40affa0 con 0x7f7ac4074190 2024-04-25T10:25:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.496+0000 7f7ac2a00640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac4074190 0x7f7ac41f6290 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400c3f0 tx=0x7f7ab400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.496+0000 7f7abbe00640 1 -- 172.21.15.19:0/2882629585 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40074e0 con 0x7f7ac4074190 2024-04-25T10:25:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.496+0000 7f7abbe00640 1 -- 172.21.15.19:0/2882629585 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab40047e0 con 0x7f7ac4074190 2024-04-25T10:25:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.496+0000 7f7ac3e00640 1 -- 172.21.15.19:0/2882629585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac40b0280 con 0x7f7ac4074190 2024-04-25T10:25:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.496+0000 7f7abbe00640 1 -- 172.21.15.19:0/2882629585 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4004bd0 con 0x7f7ac4074190 2024-04-25T10:25:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.497+0000 7f7ac3e00640 1 -- 172.21.15.19:0/2882629585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac40b0880 con 0x7f7ac4074190 2024-04-25T10:25:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.498+0000 7f7ac3e00640 1 -- 172.21.15.19:0/2882629585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac40b0ab0 con 0x7f7ac4074190 2024-04-25T10:25:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.499+0000 7f7abbe00640 1 -- 172.21.15.19:0/2882629585 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7ab4011070 con 0x7f7ac4074190 2024-04-25T10:25:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.500+0000 7f7abbe00640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f7aa00744e0 0x7f7aa00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.501+0000 7f7abbe00640 1 -- 172.21.15.19:0/2882629585 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f7ab4094dd0 con 0x7f7ac4074190 2024-04-25T10:25:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.501+0000 7f7aba000640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f7aa00744e0 0x7f7aa00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:38.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.501+0000 7f7aba000640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f7aa00744e0 0x7f7aa00769f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7aac037000 tx=0x7f7aac00d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:38.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.505+0000 7f7abbe00640 1 -- 172.21.15.19:0/2882629585 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7ac40b0ab0 con 0x7f7ac4074190 2024-04-25T10:25:38.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:38.712+0000 7f7ac3e00640 1 -- 172.21.15.19:0/2882629585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7ac41e7f10 con 0x7f7ac4074190 2024-04-25T10:25:40.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.193+0000 7f7abbe00640 1 -- 172.21.15.19:0/2882629585 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f7ab405edd0 con 0x7f7ac4074190 2024-04-25T10:25:40.196 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data_ec' created 2024-04-25T10:25:40.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.198+0000 7f7ac3e00640 1 -- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f7aa00744e0 msgr2=0x7f7aa00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:40.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.198+0000 7f7ac3e00640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f7aa00744e0 0x7f7aa00769f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7aac037000 tx=0x7f7aac00d040 comp rx=0 tx=0).stop 2024-04-25T10:25:40.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.198+0000 7f7ac3e00640 1 -- 172.21.15.19:0/2882629585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac4074190 msgr2=0x7f7ac41f6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:40.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.198+0000 7f7ac3e00640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac4074190 0x7f7ac41f6290 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400c3f0 tx=0x7f7ab400c8b0 comp rx=0 tx=0).stop 2024-04-25T10:25:40.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.199+0000 7f7ac3e00640 1 -- 172.21.15.19:0/2882629585 shutdown_connections 2024-04-25T10:25:40.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.199+0000 7f7ac3e00640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac40c4560 0x7f7ac4154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:40.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.199+0000 7f7ac3e00640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f7aa00744e0 0x7f7aa00769f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:40.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.199+0000 7f7ac3e00640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ac40c26b0 0x7f7ac4153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:40.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.199+0000 7f7ac3e00640 1 --2- 172.21.15.19:0/2882629585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac4074190 0x7f7ac41f6290 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:40.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.199+0000 7f7ac3e00640 1 -- 172.21.15.19:0/2882629585 >> 172.21.15.19:0/2882629585 conn(0x7f7ac40cd690 msgr2=0x7f7ac40cdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:40.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.200+0000 7f7ac3e00640 1 -- 172.21.15.19:0/2882629585 shutdown_connections 2024-04-25T10:25:40.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.202+0000 7f7ac3e00640 1 -- 172.21.15.19:0/2882629585 wait complete. 2024-04-25T10:25:40.243 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T10:25:40.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.505+0000 7f93a7200640 1 Processor -- start 2024-04-25T10:25:40.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.505+0000 7f93a7200640 1 -- start start 2024-04-25T10:25:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.507+0000 7f93a7200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 0x7f93a80c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.507+0000 7f93a7200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93a815c760 con 0x7f93a8159740 2024-04-25T10:25:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.507+0000 7f93a7200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93a815c9e0 con 0x7f93a81536a0 2024-04-25T10:25:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.507+0000 7f93a7200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f93a80c9b30 con 0x7f93a80b3100 2024-04-25T10:25:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.508+0000 7f93a5400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f93a81536a0 0x7f93a80ca090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:37770/0 (socket says 172.21.15.19:37770) 2024-04-25T10:25:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.508+0000 7f93a5400640 1 -- 172.21.15.19:0/3631642683 learned_addr learned my addr 172.21.15.19:0/3631642683 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.508+0000 7f93a5e00640 1 --2- 172.21.15.19:0/3631642683 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 0x7f93a80c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.508+0000 7f93a4a00640 1 -- 172.21.15.19:0/3631642683 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3584077531 0 0) 0x7f93a815c9e0 con 0x7f93a81536a0 2024-04-25T10:25:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.508+0000 7f93a5e00640 1 -- 172.21.15.19:0/3631642683 >> v1:172.21.15.112:6789/0 conn(0x7f93a81536a0 legacy=0x7f93a80ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.508+0000 7f93a5e00640 1 -- 172.21.15.19:0/3631642683 >> v1:172.21.15.19:6789/0 conn(0x7f93a8159740 legacy=0x7f93a8159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.508+0000 7f93a5e00640 1 -- 172.21.15.19:0/3631642683 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a815cc80 con 0x7f93a80b3100 2024-04-25T10:25:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.509+0000 7f93a5e00640 1 --2- 172.21.15.19:0/3631642683 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 0x7f93a80c95f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f93a815cbb0 tx=0x7f939802a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7803f0aeb54ee2f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.510+0000 7f93a4a00640 1 -- 172.21.15.19:0/3631642683 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9398037070 con 0x7f93a80b3100 2024-04-25T10:25:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.510+0000 7f93a4a00640 1 -- 172.21.15.19:0/3631642683 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9398032440 con 0x7f93a80b3100 2024-04-25T10:25:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.510+0000 7f93a4a00640 1 -- 172.21.15.19:0/3631642683 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9398032810 con 0x7f93a80b3100 2024-04-25T10:25:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.510+0000 7f93a7200640 1 -- 172.21.15.19:0/3631642683 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 msgr2=0x7f93a80c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.510+0000 7f93a7200640 1 --2- 172.21.15.19:0/3631642683 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 0x7f93a80c95f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f93a815cbb0 tx=0x7f939802a2a0 comp rx=0 tx=0).stop 2024-04-25T10:25:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.510+0000 7f93a7200640 1 -- 172.21.15.19:0/3631642683 shutdown_connections 2024-04-25T10:25:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.510+0000 7f93a7200640 1 --2- 172.21.15.19:0/3631642683 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 0x7f93a80c95f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.511+0000 7f93a7200640 1 -- 172.21.15.19:0/3631642683 >> 172.21.15.19:0/3631642683 conn(0x7f93a8070d10 msgr2=0x7f93a8071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.511+0000 7f93a7200640 1 -- 172.21.15.19:0/3631642683 shutdown_connections 2024-04-25T10:25:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.511+0000 7f93a7200640 1 -- 172.21.15.19:0/3631642683 wait complete. 2024-04-25T10:25:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.513+0000 7f93a7200640 1 Processor -- start 2024-04-25T10:25:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.513+0000 7f93a7200640 1 -- start start 2024-04-25T10:25:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a7200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 0x7f93a8154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a81536a0 0x7f93a80c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a7200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a8159740 0x7f93a8158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a7200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93a815d520 con 0x7f93a8159740 2024-04-25T10:25:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f93a815d240 con 0x7f93a81536a0 2024-04-25T10:25:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a7200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f93a80b36e0 con 0x7f93a80b3100 2024-04-25T10:25:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a6800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a8159740 0x7f93a8158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a5e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 0x7f93a8154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a81536a0 0x7f93a80c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a5e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 0x7f93a8154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:38802/0 (socket says 172.21.15.19:38802) 2024-04-25T10:25:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a5e00640 1 -- 172.21.15.19:0/4221421158 learned_addr learned my addr 172.21.15.19:0/4221421158 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a5e00640 1 -- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a81536a0 msgr2=0x7f93a80c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a5e00640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a81536a0 0x7f93a80c5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a5e00640 1 -- 172.21.15.19:0/4221421158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a8159740 msgr2=0x7f93a8158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a5e00640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a8159740 0x7f93a8158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.515+0000 7f93a5e00640 1 -- 172.21.15.19:0/4221421158 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a80c5a50 con 0x7f93a80b3100 2024-04-25T10:25:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.516+0000 7f93a5e00640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 0x7f93a8154c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9398000c00 tx=0x7f93980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.516+0000 7f939e000640 1 -- 172.21.15.19:0/4221421158 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9398041070 con 0x7f93a80b3100 2024-04-25T10:25:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.516+0000 7f939e000640 1 -- 172.21.15.19:0/4221421158 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939803c870 con 0x7f93a80b3100 2024-04-25T10:25:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.516+0000 7f939e000640 1 -- 172.21.15.19:0/4221421158 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9398037040 con 0x7f93a80b3100 2024-04-25T10:25:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.516+0000 7f93a7200640 1 -- 172.21.15.19:0/4221421158 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a8150990 con 0x7f93a80b3100 2024-04-25T10:25:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.516+0000 7f93a7200640 1 -- 172.21.15.19:0/4221421158 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a80c73e0 con 0x7f93a80b3100 2024-04-25T10:25:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.518+0000 7f93a7200640 1 -- 172.21.15.19:0/4221421158 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a8050740 con 0x7f93a80b3100 2024-04-25T10:25:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.519+0000 7f939e000640 1 -- 172.21.15.19:0/4221421158 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9398044070 con 0x7f93a80b3100 2024-04-25T10:25:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.520+0000 7f939e000640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f93880744b0 0x7f93880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.520+0000 7f939e000640 1 -- 172.21.15.19:0/4221421158 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f93980b5b30 con 0x7f93a80b3100 2024-04-25T10:25:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.520+0000 7f93a5400640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f93880744b0 0x7f93880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.521+0000 7f93a5400640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f93880744b0 0x7f93880769c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f93a815c1e0 tx=0x7f9394007e40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.525+0000 7f939e000640 1 -- 172.21.15.19:0/4221421158 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f939807f940 con 0x7f93a80b3100 2024-04-25T10:25:40.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:40.734+0000 7f93a7200640 1 -- 172.21.15.19:0/4221421158 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f93a80c9090 con 0x7f93a80b3100 2024-04-25T10:25:41.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.210+0000 7f939e000640 1 -- 172.21.15.19:0/4221421158 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f9398083c40 con 0x7f93a80b3100 2024-04-25T10:25:41.212 INFO:teuthology.orchestra.run.smithi019.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T10:25:41.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.220+0000 7f93a7200640 1 -- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f93880744b0 msgr2=0x7f93880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:41.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.220+0000 7f93a7200640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f93880744b0 0x7f93880769c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f93a815c1e0 tx=0x7f9394007e40 comp rx=0 tx=0).stop 2024-04-25T10:25:41.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.220+0000 7f93a7200640 1 -- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 msgr2=0x7f93a8154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:41.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.220+0000 7f93a7200640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 0x7f93a8154c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9398000c00 tx=0x7f93980046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:41.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.222+0000 7f93a7200640 1 -- 172.21.15.19:0/4221421158 shutdown_connections 2024-04-25T10:25:41.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.222+0000 7f93a7200640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a8159740 0x7f93a8158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:41.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.222+0000 7f93a7200640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a81536a0 0x7f93a80c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.222+0000 7f93a7200640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f93880744b0 0x7f93880769c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.222+0000 7f93a7200640 1 --2- 172.21.15.19:0/4221421158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93a80b3100 0x7f93a8154c80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.222+0000 7f93a7200640 1 -- 172.21.15.19:0/4221421158 >> 172.21.15.19:0/4221421158 conn(0x7f93a8070d10 msgr2=0x7f93a8075af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.222+0000 7f93a7200640 1 -- 172.21.15.19:0/4221421158 shutdown_connections 2024-04-25T10:25:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.222+0000 7f93a7200640 1 -- 172.21.15.19:0/4221421158 wait complete. 2024-04-25T10:25:41.271 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T10:25:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.521+0000 7fae59200640 1 Processor -- start 2024-04-25T10:25:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.521+0000 7fae59200640 1 -- start start 2024-04-25T10:25:41.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.524+0000 7fae59200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fae541569d0 0x7fae540b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:41.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.524+0000 7fae59200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae5415ffb0 0x7fae541603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:41.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.524+0000 7fae59200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae540c6ae0 con 0x7fae540c66d0 2024-04-25T10:25:41.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.524+0000 7fae59200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fae5415c800 con 0x7fae541569d0 2024-04-25T10:25:41.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.524+0000 7fae59200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fae5415cae0 con 0x7fae5415ffb0 2024-04-25T10:25:41.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.524+0000 7fae4be00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fae540c66d0 0x7fae540d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52506/0 (socket says 172.21.15.19:52506) 2024-04-25T10:25:41.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.524+0000 7fae53400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fae541569d0 0x7fae540b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:41.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.524+0000 7fae4be00640 1 -- 172.21.15.19:0/3515445379 learned_addr learned my addr 172.21.15.19:0/3515445379 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:41.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.524+0000 7fae53e00640 1 --2- 172.21.15.19:0/3515445379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae5415ffb0 0x7fae541603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:41.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.525+0000 7fae53400640 1 -- 172.21.15.19:0/3515445379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae5415ffb0 msgr2=0x7fae541603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:41.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.525+0000 7fae53400640 1 --2- 172.21.15.19:0/3515445379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae5415ffb0 0x7fae541603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:41.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.525+0000 7fae53400640 1 -- 172.21.15.19:0/3515445379 >> v1:172.21.15.19:6789/0 conn(0x7fae540c66d0 legacy=0x7fae540d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:41.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.525+0000 7fae53400640 1 -- 172.21.15.19:0/3515445379 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5415cdc0 con 0x7fae541569d0 2024-04-25T10:25:41.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.526+0000 7fae53400640 1 --2- 172.21.15.19:0/3515445379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae541569d0 0x7fae540b73a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fae440097a0 tx=0x7fae4402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e2afcaff7bce489 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.526+0000 7fae52a00640 1 -- 172.21.15.19:0/3515445379 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44037070 con 0x7fae541569d0 2024-04-25T10:25:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.526+0000 7fae52a00640 1 -- 172.21.15.19:0/3515445379 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae44032440 con 0x7fae541569d0 2024-04-25T10:25:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.526+0000 7fae52a00640 1 -- 172.21.15.19:0/3515445379 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44032810 con 0x7fae541569d0 2024-04-25T10:25:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.527+0000 7fae59200640 1 -- 172.21.15.19:0/3515445379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae541569d0 msgr2=0x7fae540b73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.527+0000 7fae59200640 1 --2- 172.21.15.19:0/3515445379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae541569d0 0x7fae540b73a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fae440097a0 tx=0x7fae4402a230 comp rx=0 tx=0).stop 2024-04-25T10:25:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.527+0000 7fae59200640 1 -- 172.21.15.19:0/3515445379 shutdown_connections 2024-04-25T10:25:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.527+0000 7fae59200640 1 --2- 172.21.15.19:0/3515445379 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae5415ffb0 0x7fae541603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.527+0000 7fae59200640 1 --2- 172.21.15.19:0/3515445379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae541569d0 0x7fae540b73a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.527+0000 7fae59200640 1 -- 172.21.15.19:0/3515445379 >> 172.21.15.19:0/3515445379 conn(0x7fae5408dc80 msgr2=0x7fae5408e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.527+0000 7fae59200640 1 -- 172.21.15.19:0/3515445379 shutdown_connections 2024-04-25T10:25:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.527+0000 7fae59200640 1 -- 172.21.15.19:0/3515445379 wait complete. 2024-04-25T10:25:41.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.529+0000 7fae59200640 1 Processor -- start 2024-04-25T10:25:41.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.530+0000 7fae59200640 1 -- start start 2024-04-25T10:25:41.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.531+0000 7fae59200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae540c66d0 0x7fae541f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:41.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.531+0000 7fae59200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae541569d0 0x7fae54158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:41.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.531+0000 7fae59200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae5415ffb0 0x7fae54154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:41.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.531+0000 7fae59200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fae5415d380 con 0x7fae5415ffb0 2024-04-25T10:25:41.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.531+0000 7fae59200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fae5415c4d0 con 0x7fae540c66d0 2024-04-25T10:25:41.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.531+0000 7fae59200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fae54160900 con 0x7fae541569d0 2024-04-25T10:25:41.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.531+0000 7fae53e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae5415ffb0 0x7fae54154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:41.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.531+0000 7fae53400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae540c66d0 0x7fae541f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:41.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.532+0000 7fae53400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae540c66d0 0x7fae541f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:38844/0 (socket says 172.21.15.19:38844) 2024-04-25T10:25:41.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.532+0000 7fae53400640 1 -- 172.21.15.19:0/4228606706 learned_addr learned my addr 172.21.15.19:0/4228606706 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:41.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.532+0000 7fae4be00640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae541569d0 0x7fae54158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:41.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.532+0000 7fae53400640 1 -- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae541569d0 msgr2=0x7fae54158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:41.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.532+0000 7fae53400640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae541569d0 0x7fae54158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:41.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.532+0000 7fae53400640 1 -- 172.21.15.19:0/4228606706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae5415ffb0 msgr2=0x7fae54154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:41.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.532+0000 7fae53400640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae5415ffb0 0x7fae54154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:41.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.532+0000 7fae53400640 1 -- 172.21.15.19:0/4228606706 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae541f35b0 con 0x7fae540c66d0 2024-04-25T10:25:41.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.532+0000 7fae53400640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae540c66d0 0x7fae541f3070 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae4402a820 tx=0x7fae440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:41.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.533+0000 7fae4b400640 1 -- 172.21.15.19:0/4228606706 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44037040 con 0x7fae540c66d0 2024-04-25T10:25:41.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.533+0000 7fae4b400640 1 -- 172.21.15.19:0/4228606706 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae44042070 con 0x7fae540c66d0 2024-04-25T10:25:41.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.533+0000 7fae4b400640 1 -- 172.21.15.19:0/4228606706 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44030940 con 0x7fae540c66d0 2024-04-25T10:25:41.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.533+0000 7fae59200640 1 -- 172.21.15.19:0/4228606706 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae54158eb0 con 0x7fae540c66d0 2024-04-25T10:25:41.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.533+0000 7fae59200640 1 -- 172.21.15.19:0/4228606706 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae541f6840 con 0x7fae540c66d0 2024-04-25T10:25:41.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.534+0000 7fae59200640 1 -- 172.21.15.19:0/4228606706 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae5415a670 con 0x7fae540c66d0 2024-04-25T10:25:41.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.535+0000 7fae4b400640 1 -- 172.21.15.19:0/4228606706 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fae44030ae0 con 0x7fae540c66d0 2024-04-25T10:25:41.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.536+0000 7fae4b400640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae300744b0 0x7fae300769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:41.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.536+0000 7fae4b400640 1 -- 172.21.15.19:0/4228606706 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fae440b6280 con 0x7fae540c66d0 2024-04-25T10:25:41.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.536+0000 7fae4be00640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae300744b0 0x7fae300769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:41.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.537+0000 7fae4be00640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae300744b0 0x7fae300769c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fae541f40a0 tx=0x7fae3c007e80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:41.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.540+0000 7fae4b400640 1 -- 172.21.15.19:0/4228606706 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fae5415a670 con 0x7fae540c66d0 2024-04-25T10:25:41.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:41.788+0000 7fae59200640 1 -- 172.21.15.19:0/4228606706 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fae540b6f70 con 0x7fae540c66d0 2024-04-25T10:25:42.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.222+0000 7fae4b400640 1 -- 172.21.15.19:0/4228606706 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fae540b6f70 con 0x7fae540c66d0 2024-04-25T10:25:42.225 INFO:teuthology.orchestra.run.smithi019.stderr:added data pool 4 to fsmap 2024-04-25T10:25:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 -- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae300744b0 msgr2=0x7fae300769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae300744b0 0x7fae300769c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fae541f40a0 tx=0x7fae3c007e80 comp rx=0 tx=0).stop 2024-04-25T10:25:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 -- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae540c66d0 msgr2=0x7fae541f3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae540c66d0 0x7fae541f3070 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae4402a820 tx=0x7fae440046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 -- 172.21.15.19:0/4228606706 shutdown_connections 2024-04-25T10:25:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae5415ffb0 0x7fae54154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae300744b0 0x7fae300769c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae541569d0 0x7fae54158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 --2- 172.21.15.19:0/4228606706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae540c66d0 0x7fae541f3070 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 -- 172.21.15.19:0/4228606706 >> 172.21.15.19:0/4228606706 conn(0x7fae5408dc80 msgr2=0x7fae5415aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 -- 172.21.15.19:0/4228606706 shutdown_connections 2024-04-25T10:25:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.228+0000 7fae59200640 1 -- 172.21.15.19:0/4228606706 wait complete. 2024-04-25T10:25:42.264 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:25:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.543+0000 7f7453200640 1 Processor -- start 2024-04-25T10:25:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.544+0000 7f7453200640 1 -- start start 2024-04-25T10:25:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.546+0000 7f7453200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f744c0c7f90 0x7f744c073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.546+0000 7f7453200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f744c0cac80 0x7f744c073b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.546+0000 7f7453200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f744c15a8b0 con 0x7f744c15a370 2024-04-25T10:25:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.546+0000 7f7453200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f744c070f70 con 0x7f744c0c7f90 2024-04-25T10:25:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.546+0000 7f7453200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f744c072ea0 con 0x7f744c0cac80 2024-04-25T10:25:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.546+0000 7f7451e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f744c15a370 0x7f744c070860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52508/0 (socket says 172.21.15.19:52508) 2024-04-25T10:25:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.546+0000 7f7451e00640 1 -- 172.21.15.19:0/247696075 learned_addr learned my addr 172.21.15.19:0/247696075 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.546+0000 7f7451400640 1 --2- 172.21.15.19:0/247696075 >> v2:172.21.15.19:3300/0 conn(0x7f744c0c7f90 0x7f744c073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.546+0000 7f7452800640 1 --2- 172.21.15.19:0/247696075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f744c0cac80 0x7f744c073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.547+0000 7f7450a00640 1 -- 172.21.15.19:0/247696075 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 184521322 0 0) 0x7f744c15a8b0 con 0x7f744c15a370 2024-04-25T10:25:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.547+0000 7f7450a00640 1 -- 172.21.15.19:0/247696075 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7434003520 con 0x7f744c15a370 2024-04-25T10:25:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.547+0000 7f7451400640 1 -- 172.21.15.19:0/247696075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f744c0cac80 msgr2=0x7f744c073b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.547+0000 7f7451400640 1 --2- 172.21.15.19:0/247696075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f744c0cac80 0x7f744c073b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.547+0000 7f7451400640 1 -- 172.21.15.19:0/247696075 >> v1:172.21.15.19:6789/0 conn(0x7f744c15a370 legacy=0x7f744c070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:42.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.547+0000 7f7451400640 1 -- 172.21.15.19:0/247696075 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744c15ab70 con 0x7f744c0c7f90 2024-04-25T10:25:42.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.547+0000 7f7452800640 1 --2- 172.21.15.19:0/247696075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f744c0cac80 0x7f744c073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.548+0000 7f7451400640 1 --2- 172.21.15.19:0/247696075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c0c7f90 0x7f744c073610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f743c0097a0 tx=0x7f743c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefcb555e5db3423 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.548+0000 7f7450a00640 1 -- 172.21.15.19:0/247696075 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c037070 con 0x7f744c0c7f90 2024-04-25T10:25:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.548+0000 7f7450a00640 1 -- 172.21.15.19:0/247696075 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c02ae50 con 0x7f744c0c7f90 2024-04-25T10:25:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.548+0000 7f7450a00640 1 -- 172.21.15.19:0/247696075 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c032660 con 0x7f744c0c7f90 2024-04-25T10:25:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.549+0000 7f7453200640 1 -- 172.21.15.19:0/247696075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c0c7f90 msgr2=0x7f744c073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.549+0000 7f7453200640 1 --2- 172.21.15.19:0/247696075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c0c7f90 0x7f744c073610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f743c0097a0 tx=0x7f743c02a100 comp rx=0 tx=0).stop 2024-04-25T10:25:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.549+0000 7f7453200640 1 -- 172.21.15.19:0/247696075 shutdown_connections 2024-04-25T10:25:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.549+0000 7f7453200640 1 --2- 172.21.15.19:0/247696075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f744c0cac80 0x7f744c073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.549+0000 7f7453200640 1 --2- 172.21.15.19:0/247696075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c0c7f90 0x7f744c073610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.549+0000 7f7453200640 1 -- 172.21.15.19:0/247696075 >> 172.21.15.19:0/247696075 conn(0x7f744c0cdbc0 msgr2=0x7f744c0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:42.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.549+0000 7f7453200640 1 -- 172.21.15.19:0/247696075 shutdown_connections 2024-04-25T10:25:42.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.549+0000 7f7453200640 1 -- 172.21.15.19:0/247696075 wait complete. 2024-04-25T10:25:42.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.551+0000 7f7453200640 1 Processor -- start 2024-04-25T10:25:42.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.552+0000 7f7453200640 1 -- start start 2024-04-25T10:25:42.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.553+0000 7f7453200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c0c7f90 0x7f744c15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:42.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.553+0000 7f7453200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f744c0cac80 0x7f744c1f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:42.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.553+0000 7f7453200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f744c15a370 0x7f744c15df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:42.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.553+0000 7f7453200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f744c15b130 con 0x7f744c0c7f90 2024-04-25T10:25:42.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.553+0000 7f7453200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f744c073180 con 0x7f744c15a370 2024-04-25T10:25:42.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.553+0000 7f7453200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f744c0c4b20 con 0x7f744c0cac80 2024-04-25T10:25:42.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.553+0000 7f7451e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c0c7f90 0x7f744c15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:42.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.554+0000 7f7451400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f744c0cac80 0x7f744c1f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:42.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.554+0000 7f7451e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c0c7f90 0x7f744c15cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50998/0 (socket says 172.21.15.19:50998) 2024-04-25T10:25:42.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.554+0000 7f7452800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f744c15a370 0x7f744c15df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:42.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.554+0000 7f7451e00640 1 -- 172.21.15.19:0/3723631270 learned_addr learned my addr 172.21.15.19:0/3723631270 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:42.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.554+0000 7f7452800640 1 -- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f744c0cac80 msgr2=0x7f744c1f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:42.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.554+0000 7f7452800640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f744c0cac80 0x7f744c1f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.554+0000 7f7452800640 1 -- 172.21.15.19:0/3723631270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c0c7f90 msgr2=0x7f744c15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:42.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.554+0000 7f7452800640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c0c7f90 0x7f744c15cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.554+0000 7f7452800640 1 -- 172.21.15.19:0/3723631270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744c1f33c0 con 0x7f744c15a370 2024-04-25T10:25:42.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.555+0000 7f7452800640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f744c15a370 0x7f744c15df40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f744c15e9a0 tx=0x7f744800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:42.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.555+0000 7f7446000640 1 -- 172.21.15.19:0/3723631270 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448018030 con 0x7f744c15a370 2024-04-25T10:25:42.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.555+0000 7f7446000640 1 -- 172.21.15.19:0/3723631270 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744800cc90 con 0x7f744c15a370 2024-04-25T10:25:42.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.555+0000 7f7453200640 1 -- 172.21.15.19:0/3723631270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744c15d7e0 con 0x7f744c15a370 2024-04-25T10:25:42.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.555+0000 7f7446000640 1 -- 172.21.15.19:0/3723631270 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448003bb0 con 0x7f744c15a370 2024-04-25T10:25:42.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.555+0000 7f7453200640 1 -- 172.21.15.19:0/3723631270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744c1eff20 con 0x7f744c15a370 2024-04-25T10:25:42.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.557+0000 7f7453200640 1 -- 172.21.15.19:0/3723631270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f744c050740 con 0x7f744c15a370 2024-04-25T10:25:42.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.558+0000 7f7446000640 1 -- 172.21.15.19:0/3723631270 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7448005d10 con 0x7f744c15a370 2024-04-25T10:25:42.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.559+0000 7f7446000640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f74300744b0 0x7f74300769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:42.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.559+0000 7f7446000640 1 -- 172.21.15.19:0/3723631270 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7448095d70 con 0x7f744c15a370 2024-04-25T10:25:42.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.559+0000 7f7451e00640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f74300744b0 0x7f74300769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:42.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.560+0000 7f7451e00640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f74300744b0 0x7f74300769c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7440005880 tx=0x7f7440009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:42.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.564+0000 7f7446000640 1 -- 172.21.15.19:0/3723631270 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7448022070 con 0x7f744c15a370 2024-04-25T10:25:42.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.811+0000 7f7453200640 1 -- 172.21.15.19:0/3723631270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f744c0c59e0 con 0x7f744c15a370 2024-04-25T10:25:42.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.812+0000 7f7446000640 1 -- 172.21.15.19:0/3723631270 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6834 (secure 0 0 0) 0x7f7448010040 con 0x7f744c15a370 2024-04-25T10:25:42.814 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:42.814 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4288,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:25:42.205484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-25T10:25:42.814 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-04-25T10:25:42.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 -- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f74300744b0 msgr2=0x7f74300769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:42.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f74300744b0 0x7f74300769c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7440005880 tx=0x7f7440009040 comp rx=0 tx=0).stop 2024-04-25T10:25:42.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 -- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f744c15a370 msgr2=0x7f744c15df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:42.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f744c15a370 0x7f744c15df40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f744c15e9a0 tx=0x7f744800ef90 comp rx=0 tx=0).stop 2024-04-25T10:25:42.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 -- 172.21.15.19:0/3723631270 shutdown_connections 2024-04-25T10:25:42.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f744c15a370 0x7f744c15df40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f74300744b0 0x7f74300769c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f744c0cac80 0x7f744c1f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 --2- 172.21.15.19:0/3723631270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c0c7f90 0x7f744c15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:42.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 -- 172.21.15.19:0/3723631270 >> 172.21.15.19:0/3723631270 conn(0x7f744c0cdbc0 msgr2=0x7f744c073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:42.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 -- 172.21.15.19:0/3723631270 shutdown_connections 2024-04-25T10:25:42.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:42.815+0000 7f7453200640 1 -- 172.21.15.19:0/3723631270 wait complete. 2024-04-25T10:25:42.841 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:25:43.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.125+0000 7fa7f3200640 1 Processor -- start 2024-04-25T10:25:43.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.125+0000 7fa7f3200640 1 -- start start 2024-04-25T10:25:43.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.127+0000 7fa7f3200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7f40b4090 0x7fa7f40b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:43.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.127+0000 7fa7f3200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f415c5f0 con 0x7fa7f41567a0 2024-04-25T10:25:43.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.127+0000 7fa7f3200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f415c8d0 con 0x7fa7f40ccdc0 2024-04-25T10:25:43.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.127+0000 7fa7f3200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa7f40cd1d0 con 0x7fa7f40b4090 2024-04-25T10:25:43.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.128+0000 7fa7f1e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7f40b4090 0x7fa7f40b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:43.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.128+0000 7fa7f1400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa7f41567a0 0x7fa7f40b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52512/0 (socket says 172.21.15.19:52512) 2024-04-25T10:25:43.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.128+0000 7fa7f1400640 1 -- 172.21.15.19:0/4214369526 learned_addr learned my addr 172.21.15.19:0/4214369526 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:43.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.128+0000 7fa7f1e00640 1 -- 172.21.15.19:0/4214369526 >> v1:172.21.15.112:6789/0 conn(0x7fa7f40ccdc0 legacy=0x7fa7f40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.128+0000 7fa7f1e00640 1 -- 172.21.15.19:0/4214369526 >> v1:172.21.15.19:6789/0 conn(0x7fa7f41567a0 legacy=0x7fa7f40b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.128+0000 7fa7f1e00640 1 -- 172.21.15.19:0/4214369526 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f415cbb0 con 0x7fa7f40b4090 2024-04-25T10:25:43.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.129+0000 7fa7f1e00640 1 --2- 172.21.15.19:0/4214369526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7f40b4090 0x7fa7f40b50e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40097a0 tx=0x7fa7e402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975b2b5d678dc853 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:43.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.130+0000 7fa7f0a00640 1 -- 172.21.15.19:0/4214369526 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4037070 con 0x7fa7f40b4090 2024-04-25T10:25:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.130+0000 7fa7f0a00640 1 -- 172.21.15.19:0/4214369526 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e4032440 con 0x7fa7f40b4090 2024-04-25T10:25:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.130+0000 7fa7f0a00640 1 -- 172.21.15.19:0/4214369526 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4032810 con 0x7fa7f40b4090 2024-04-25T10:25:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.131+0000 7fa7f3200640 1 -- 172.21.15.19:0/4214369526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7f40b4090 msgr2=0x7fa7f40b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.131+0000 7fa7f3200640 1 --2- 172.21.15.19:0/4214369526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7f40b4090 0x7fa7f40b50e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40097a0 tx=0x7fa7e402a230 comp rx=0 tx=0).stop 2024-04-25T10:25:43.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.131+0000 7fa7f3200640 1 -- 172.21.15.19:0/4214369526 shutdown_connections 2024-04-25T10:25:43.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.131+0000 7fa7f3200640 1 --2- 172.21.15.19:0/4214369526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7f40b4090 0x7fa7f40b50e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.131+0000 7fa7f3200640 1 -- 172.21.15.19:0/4214369526 >> 172.21.15.19:0/4214369526 conn(0x7fa7f408d940 msgr2=0x7fa7f408dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:43.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.131+0000 7fa7f3200640 1 -- 172.21.15.19:0/4214369526 shutdown_connections 2024-04-25T10:25:43.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.131+0000 7fa7f3200640 1 -- 172.21.15.19:0/4214369526 wait complete. 2024-04-25T10:25:43.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.133+0000 7fa7f3200640 1 Processor -- start 2024-04-25T10:25:43.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.133+0000 7fa7f3200640 1 -- start start 2024-04-25T10:25:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.135+0000 7fa7f3200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7f40b4090 0x7fa7f4150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.135+0000 7fa7f3200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7f40ccdc0 0x7fa7f40c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.135+0000 7fa7f3200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7f41567a0 0x7fa7f414df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.135+0000 7fa7f3200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f40b4cf0 con 0x7fa7f41567a0 2024-04-25T10:25:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.135+0000 7fa7f3200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f415d170 con 0x7fa7f40b4090 2024-04-25T10:25:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.135+0000 7fa7f3200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f40b4e70 con 0x7fa7f40ccdc0 2024-04-25T10:25:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.135+0000 7fa7f1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7f40b4090 0x7fa7f4150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.135+0000 7fa7f2800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7f41567a0 0x7fa7f414df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.135+0000 7fa7f1400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7f40ccdc0 0x7fa7f40c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.135+0000 7fa7f1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7f40b4090 0x7fa7f4150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:38862/0 (socket says 172.21.15.19:38862) 2024-04-25T10:25:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.135+0000 7fa7f1e00640 1 -- 172.21.15.19:0/446847610 learned_addr learned my addr 172.21.15.19:0/446847610 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:43.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.136+0000 7fa7f1e00640 1 -- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7f40ccdc0 msgr2=0x7fa7f40c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.136+0000 7fa7f1e00640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7f40ccdc0 0x7fa7f40c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.136+0000 7fa7f1e00640 1 -- 172.21.15.19:0/446847610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7f41567a0 msgr2=0x7fa7f414df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.136+0000 7fa7f1e00640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7f41567a0 0x7fa7f414df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.136+0000 7fa7f1e00640 1 -- 172.21.15.19:0/446847610 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f40c9d70 con 0x7fa7f40b4090 2024-04-25T10:25:43.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.136+0000 7fa7f1e00640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7f40b4090 0x7fa7f4150a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009890 tx=0x7fa7e40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:43.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.136+0000 7fa7ea000640 1 -- 172.21.15.19:0/446847610 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4040020 con 0x7fa7f40b4090 2024-04-25T10:25:43.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.136+0000 7fa7ea000640 1 -- 172.21.15.19:0/446847610 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e4038040 con 0x7fa7f40b4090 2024-04-25T10:25:43.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.136+0000 7fa7ea000640 1 -- 172.21.15.19:0/446847610 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4037070 con 0x7fa7f40b4090 2024-04-25T10:25:43.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.136+0000 7fa7f3200640 1 -- 172.21.15.19:0/446847610 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f415a410 con 0x7fa7f40b4090 2024-04-25T10:25:43.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.137+0000 7fa7f3200640 1 -- 172.21.15.19:0/446847610 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f41f3590 con 0x7fa7f40b4090 2024-04-25T10:25:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.138+0000 7fa7f3200640 1 -- 172.21.15.19:0/446847610 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f4050740 con 0x7fa7f40b4090 2024-04-25T10:25:43.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.139+0000 7fa7ea000640 1 -- 172.21.15.19:0/446847610 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa7e4043020 con 0x7fa7f40b4090 2024-04-25T10:25:43.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.140+0000 7fa7ea000640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7d00744b0 0x7fa7d00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:43.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.140+0000 7fa7ea000640 1 -- 172.21.15.19:0/446847610 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa7e40b5960 con 0x7fa7f40b4090 2024-04-25T10:25:43.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.140+0000 7fa7f1400640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7d00744b0 0x7fa7d00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:43.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.141+0000 7fa7f1400640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7d00744b0 0x7fa7d00769c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40cad70 tx=0x7fa7dc001990 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:43.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.145+0000 7fa7ea000640 1 -- 172.21.15.19:0/446847610 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa7e404a030 con 0x7fa7f40b4090 2024-04-25T10:25:43.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.356+0000 7fa7f3200640 1 -- 172.21.15.19:0/446847610 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7f40b68e0 con 0x7fa7f40b4090 2024-04-25T10:25:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.359+0000 7fa7ea000640 1 -- 172.21.15.19:0/446847610 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18518 (secure 0 0 0) 0x7fa7e4032e20 con 0x7fa7f40b4090 2024-04-25T10:25:43.360 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:43.361 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:41.790347+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:25:43.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.361+0000 7fa7f3200640 1 -- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7d00744b0 msgr2=0x7fa7d00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.361+0000 7fa7f3200640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7d00744b0 0x7fa7d00769c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40cad70 tx=0x7fa7dc001990 comp rx=0 tx=0).stop 2024-04-25T10:25:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.361+0000 7fa7f3200640 1 -- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7f40b4090 msgr2=0x7fa7f4150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.361+0000 7fa7f3200640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7f40b4090 0x7fa7f4150a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009890 tx=0x7fa7e40046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.361+0000 7fa7f3200640 1 -- 172.21.15.19:0/446847610 shutdown_connections 2024-04-25T10:25:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.362+0000 7fa7f3200640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7f41567a0 0x7fa7f414df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.362+0000 7fa7f3200640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7d00744b0 0x7fa7d00769c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.362+0000 7fa7f3200640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7f40ccdc0 0x7fa7f40c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.362+0000 7fa7f3200640 1 --2- 172.21.15.19:0/446847610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7f40b4090 0x7fa7f4150a30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.362+0000 7fa7f3200640 1 -- 172.21.15.19:0/446847610 >> 172.21.15.19:0/446847610 conn(0x7fa7f408d940 msgr2=0x7fa7f4155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.362+0000 7fa7f3200640 1 -- 172.21.15.19:0/446847610 shutdown_connections 2024-04-25T10:25:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.362+0000 7fa7f3200640 1 -- 172.21.15.19:0/446847610 wait complete. 2024-04-25T10:25:43.392 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:25:43.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.679+0000 7fba0e400640 1 Processor -- start 2024-04-25T10:25:43.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.679+0000 7fba0e400640 1 -- start start 2024-04-25T10:25:43.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.681+0000 7fba0e400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba080c2640 0x7fba080c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:43.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.681+0000 7fba0e400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba080c2a50 0x7fba080c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.681+0000 7fba0e400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba080c8340 con 0x7fba081532c0 2024-04-25T10:25:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.681+0000 7fba0e400640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fba080c9dc0 con 0x7fba080c2a50 2024-04-25T10:25:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.681+0000 7fba0e400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fba0815c680 con 0x7fba080c2640 2024-04-25T10:25:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.681+0000 7fba0da00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba080c2a50 0x7fba080c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.681+0000 7fba0d000640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fba081532c0 0x7fba08072ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52522/0 (socket says 172.21.15.19:52522) 2024-04-25T10:25:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.681+0000 7fba0d000640 1 -- 172.21.15.19:0/375720661 learned_addr learned my addr 172.21.15.19:0/375720661 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.681+0000 7fba07e00640 1 --2- 172.21.15.19:0/375720661 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba080c2640 0x7fba080c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.681+0000 7fba0da00640 1 -- 172.21.15.19:0/375720661 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba080c2640 msgr2=0x7fba080c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.681+0000 7fba0da00640 1 --2- 172.21.15.19:0/375720661 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba080c2640 0x7fba080c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.682+0000 7fba0da00640 1 -- 172.21.15.19:0/375720661 >> v1:172.21.15.19:6789/0 conn(0x7fba081532c0 legacy=0x7fba08072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.682+0000 7fba0da00640 1 -- 172.21.15.19:0/375720661 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0815c960 con 0x7fba080c2a50 2024-04-25T10:25:43.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.682+0000 7fba07400640 1 -- 172.21.15.19:0/375720661 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3122659967 0 0) 0x7fba080c8340 con 0x7fba081532c0 2024-04-25T10:25:43.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.683+0000 7fba0da00640 1 --2- 172.21.15.19:0/375720661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba080c2a50 0x7fba080c3520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba00009d90 tx=0x7fba0002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1561a5a025fb17d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:43.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.683+0000 7fba07400640 1 -- 172.21.15.19:0/375720661 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00007740 con 0x7fba080c2a50 2024-04-25T10:25:43.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.683+0000 7fba07400640 1 -- 172.21.15.19:0/375720661 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba000078e0 con 0x7fba080c2a50 2024-04-25T10:25:43.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.683+0000 7fba07400640 1 -- 172.21.15.19:0/375720661 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00007cb0 con 0x7fba080c2a50 2024-04-25T10:25:43.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.684+0000 7fba0e400640 1 -- 172.21.15.19:0/375720661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba080c2a50 msgr2=0x7fba080c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.684+0000 7fba0e400640 1 --2- 172.21.15.19:0/375720661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba080c2a50 0x7fba080c3520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba00009d90 tx=0x7fba0002a660 comp rx=0 tx=0).stop 2024-04-25T10:25:43.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.684+0000 7fba0e400640 1 -- 172.21.15.19:0/375720661 shutdown_connections 2024-04-25T10:25:43.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.684+0000 7fba0e400640 1 --2- 172.21.15.19:0/375720661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba080c2a50 0x7fba080c3520 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.684+0000 7fba0e400640 1 --2- 172.21.15.19:0/375720661 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba080c2640 0x7fba080c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.684+0000 7fba0e400640 1 -- 172.21.15.19:0/375720661 >> 172.21.15.19:0/375720661 conn(0x7fba080cdbc0 msgr2=0x7fba080ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:43.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.684+0000 7fba0e400640 1 -- 172.21.15.19:0/375720661 shutdown_connections 2024-04-25T10:25:43.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.684+0000 7fba0e400640 1 -- 172.21.15.19:0/375720661 wait complete. 2024-04-25T10:25:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.687+0000 7fba0e400640 1 Processor -- start 2024-04-25T10:25:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.687+0000 7fba0e400640 1 -- start start 2024-04-25T10:25:43.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.688+0000 7fba0e400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba080c2640 0x7fba081f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:43.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.688+0000 7fba0e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba080c2a50 0x7fba081f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:43.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.688+0000 7fba0e400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba081532c0 0x7fba0815bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:43.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.688+0000 7fba0e400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fba0815d440 con 0x7fba080c2640 2024-04-25T10:25:43.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.688+0000 7fba0e400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fba0815cf20 con 0x7fba080c2a50 2024-04-25T10:25:43.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.688+0000 7fba0e400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fba080c8620 con 0x7fba081532c0 2024-04-25T10:25:43.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba0d000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba080c2640 0x7fba081f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:43.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba0d000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba080c2640 0x7fba081f66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51034/0 (socket says 172.21.15.19:51034) 2024-04-25T10:25:43.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba0d000640 1 -- 172.21.15.19:0/1141948793 learned_addr learned my addr 172.21.15.19:0/1141948793 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:43.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba07e00640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba080c2a50 0x7fba081f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:43.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba0da00640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba081532c0 0x7fba0815bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:43.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba0d000640 1 -- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba081532c0 msgr2=0x7fba0815bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba0d000640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba081532c0 0x7fba0815bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba0d000640 1 -- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba080c2a50 msgr2=0x7fba081f2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba0d000640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba080c2a50 0x7fba081f2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba0d000640 1 -- 172.21.15.19:0/1141948793 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba081f5c30 con 0x7fba080c2640 2024-04-25T10:25:43.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba07e00640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba080c2a50 0x7fba081f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:43.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.689+0000 7fba0d000640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba080c2640 0x7fba081f66d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00c460 tx=0x7fb9fc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:43.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.690+0000 7fba04c00640 1 -- 172.21.15.19:0/1141948793 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc018070 con 0x7fba080c2640 2024-04-25T10:25:43.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.690+0000 7fba04c00640 1 -- 172.21.15.19:0/1141948793 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9fc007500 con 0x7fba080c2640 2024-04-25T10:25:43.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.690+0000 7fba0e400640 1 -- 172.21.15.19:0/1141948793 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba081f3220 con 0x7fba080c2640 2024-04-25T10:25:43.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.690+0000 7fba04c00640 1 -- 172.21.15.19:0/1141948793 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc004a20 con 0x7fba080c2640 2024-04-25T10:25:43.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.690+0000 7fba0e400640 1 -- 172.21.15.19:0/1141948793 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0815a370 con 0x7fba080c2640 2024-04-25T10:25:43.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.691+0000 7fba0e400640 1 -- 172.21.15.19:0/1141948793 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba080c8340 con 0x7fba080c2640 2024-04-25T10:25:43.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.692+0000 7fba04c00640 1 -- 172.21.15.19:0/1141948793 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb9fc01b070 con 0x7fba080c2640 2024-04-25T10:25:43.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.694+0000 7fba04c00640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9e80744b0 0x7fb9e80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:43.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.694+0000 7fba04c00640 1 -- 172.21.15.19:0/1141948793 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb9fc0946c0 con 0x7fba080c2640 2024-04-25T10:25:43.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.694+0000 7fba07e00640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9e80744b0 0x7fb9e80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:43.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.694+0000 7fba07e00640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9e80744b0 0x7fb9e80769c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba081f0250 tx=0x7fb9f4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:43.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.699+0000 7fba04c00640 1 -- 172.21.15.19:0/1141948793 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba080c8340 con 0x7fba080c2640 2024-04-25T10:25:43.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.909+0000 7fba0e400640 1 -- 172.21.15.19:0/1141948793 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba08050740 con 0x7fba080c2640 2024-04-25T10:25:43.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.910+0000 7fba04c00640 1 -- 172.21.15.19:0/1141948793 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18518 (secure 0 0 0) 0x7fb9fc05e550 con 0x7fba080c2640 2024-04-25T10:25:43.913 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:43.913 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:41.790347+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:25:43.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.913+0000 7fba0e400640 1 -- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9e80744b0 msgr2=0x7fb9e80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.913+0000 7fba0e400640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9e80744b0 0x7fb9e80769c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba081f0250 tx=0x7fb9f4009190 comp rx=0 tx=0).stop 2024-04-25T10:25:43.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.913+0000 7fba0e400640 1 -- 172.21.15.19:0/1141948793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba080c2640 msgr2=0x7fba081f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.913+0000 7fba0e400640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba080c2640 0x7fba081f66d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00c460 tx=0x7fb9fc00c920 comp rx=0 tx=0).stop 2024-04-25T10:25:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.913+0000 7fba0e400640 1 -- 172.21.15.19:0/1141948793 shutdown_connections 2024-04-25T10:25:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.913+0000 7fba0e400640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9e80744b0 0x7fb9e80769c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.913+0000 7fba0e400640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba081532c0 0x7fba0815bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.913+0000 7fba0e400640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba080c2a50 0x7fba081f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.913+0000 7fba0e400640 1 --2- 172.21.15.19:0/1141948793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba080c2640 0x7fba081f66d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.913+0000 7fba0e400640 1 -- 172.21.15.19:0/1141948793 >> 172.21.15.19:0/1141948793 conn(0x7fba080cdbc0 msgr2=0x7fba080c2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.914+0000 7fba0e400640 1 -- 172.21.15.19:0/1141948793 shutdown_connections 2024-04-25T10:25:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:43.914+0000 7fba0e400640 1 -- 172.21.15.19:0/1141948793 wait complete. 2024-04-25T10:25:43.958 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:25:44.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.245+0000 7f49fd800640 1 Processor -- start 2024-04-25T10:25:44.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.245+0000 7f49fd800640 1 -- start start 2024-04-25T10:25:44.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.247+0000 7f49fd800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f49f8159f90 0x7f49f80c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:44.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.247+0000 7f49fd800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f80b07c0 con 0x7f49f8159b80 2024-04-25T10:25:44.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.247+0000 7f49fd800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f80b2600 con 0x7f49f80c4930 2024-04-25T10:25:44.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.247+0000 7f49fd800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f49f81596f0 con 0x7f49f8159f90 2024-04-25T10:25:44.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.248+0000 7f49f6000640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f49f8159b80 0x7f49f80742c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52528/0 (socket says 172.21.15.19:52528) 2024-04-25T10:25:44.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.248+0000 7f49f6a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f49f80c4930 0x7f49f81534f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:37792/0 (socket says 172.21.15.19:37792) 2024-04-25T10:25:44.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.248+0000 7f49f6000640 1 -- 172.21.15.19:0/28626578 learned_addr learned my addr 172.21.15.19:0/28626578 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:44.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.248+0000 7f49f7400640 1 --2- 172.21.15.19:0/28626578 >> v2:172.21.15.112:3300/0 conn(0x7f49f8159f90 0x7f49f80c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.248+0000 7f49f5600640 1 -- 172.21.15.19:0/28626578 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4053441717 0 0) 0x7f49f80b2600 con 0x7f49f80c4930 2024-04-25T10:25:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.248+0000 7f49f5600640 1 -- 172.21.15.19:0/28626578 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49dc003520 con 0x7f49f80c4930 2024-04-25T10:25:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.248+0000 7f49f7400640 1 -- 172.21.15.19:0/28626578 >> v1:172.21.15.112:6789/0 conn(0x7f49f80c4930 legacy=0x7f49f81534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.248+0000 7f49f7400640 1 -- 172.21.15.19:0/28626578 >> v1:172.21.15.19:6789/0 conn(0x7f49f8159b80 legacy=0x7f49f80742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.248+0000 7f49f5600640 1 -- 172.21.15.19:0/28626578 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940732529 0 0) 0x7f49f80b07c0 con 0x7f49f8159b80 2024-04-25T10:25:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.248+0000 7f49f7400640 1 -- 172.21.15.19:0/28626578 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f80b28e0 con 0x7f49f8159f90 2024-04-25T10:25:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.249+0000 7f49f7400640 1 --2- 172.21.15.19:0/28626578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8159f90 0x7f49f80c2a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009d90 tx=0x7f49f002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36024f70cb52845d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:44.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.250+0000 7f49f5600640 1 -- 172.21.15.19:0/28626578 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0007740 con 0x7f49f8159f90 2024-04-25T10:25:44.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.250+0000 7f49f5600640 1 -- 172.21.15.19:0/28626578 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f00078e0 con 0x7f49f8159f90 2024-04-25T10:25:44.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.250+0000 7f49f5600640 1 -- 172.21.15.19:0/28626578 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0007c90 con 0x7f49f8159f90 2024-04-25T10:25:44.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.250+0000 7f49fd800640 1 -- 172.21.15.19:0/28626578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8159f90 msgr2=0x7f49f80c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.250+0000 7f49fd800640 1 --2- 172.21.15.19:0/28626578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8159f90 0x7f49f80c2a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009d90 tx=0x7f49f002a6f0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.250+0000 7f49fd800640 1 -- 172.21.15.19:0/28626578 shutdown_connections 2024-04-25T10:25:44.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.250+0000 7f49fd800640 1 --2- 172.21.15.19:0/28626578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8159f90 0x7f49f80c2a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.250+0000 7f49fd800640 1 -- 172.21.15.19:0/28626578 >> 172.21.15.19:0/28626578 conn(0x7f49f806f1f0 msgr2=0x7f49f806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:44.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.251+0000 7f49fd800640 1 -- 172.21.15.19:0/28626578 shutdown_connections 2024-04-25T10:25:44.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.251+0000 7f49fd800640 1 -- 172.21.15.19:0/28626578 wait complete. 2024-04-25T10:25:44.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.253+0000 7f49fd800640 1 Processor -- start 2024-04-25T10:25:44.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.253+0000 7f49fd800640 1 -- start start 2024-04-25T10:25:44.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.254+0000 7f49fd800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f80c4930 0x7f49f80cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:44.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.254+0000 7f49fd800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8159b80 0x7f49f8157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:44.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49fd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8159f90 0x7f49f81e2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:44.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49fd800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49f815c900 con 0x7f49f80c4930 2024-04-25T10:25:44.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49fd800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80b2ea0 con 0x7f49f8159f90 2024-04-25T10:25:44.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49fd800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f49f8159330 con 0x7f49f8159b80 2024-04-25T10:25:44.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49f6a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f80c4930 0x7f49f80cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:44.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49f6a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f80c4930 0x7f49f80cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51042/0 (socket says 172.21.15.19:51042) 2024-04-25T10:25:44.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49f6a00640 1 -- 172.21.15.19:0/4160590509 learned_addr learned my addr 172.21.15.19:0/4160590509 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:44.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49f7400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8159f90 0x7f49f81e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:44.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49f6000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8159b80 0x7f49f8157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49f6a00640 1 -- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8159b80 msgr2=0x7f49f8157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49f6a00640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8159b80 0x7f49f8157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49f6a00640 1 -- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8159f90 msgr2=0x7f49f81e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49f6a00640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8159f90 0x7f49f81e2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49f6a00640 1 -- 172.21.15.19:0/4160590509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f8159050 con 0x7f49f80c4930 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.255+0000 7f49f7400640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8159f90 0x7f49f81e2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.256+0000 7f49f6a00640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f80c4930 0x7f49f80cc470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f49e800c470 tx=0x7f49e800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.256+0000 7f49eea00640 1 -- 172.21.15.19:0/4160590509 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8018070 con 0x7f49f80c4930 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.256+0000 7f49eea00640 1 -- 172.21.15.19:0/4160590509 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e8007480 con 0x7f49f80c4930 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.256+0000 7f49fd800640 1 -- 172.21.15.19:0/4160590509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f8157d40 con 0x7f49f80c4930 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.256+0000 7f49eea00640 1 -- 172.21.15.19:0/4160590509 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e80047e0 con 0x7f49f80c4930 2024-04-25T10:25:44.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.256+0000 7f49fd800640 1 -- 172.21.15.19:0/4160590509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f8157fe0 con 0x7f49f80c4930 2024-04-25T10:25:44.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.257+0000 7f49fd800640 1 -- 172.21.15.19:0/4160590509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f8076520 con 0x7f49f80c4930 2024-04-25T10:25:44.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.258+0000 7f49eea00640 1 -- 172.21.15.19:0/4160590509 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f49e801b070 con 0x7f49f80c4930 2024-04-25T10:25:44.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.259+0000 7f49eea00640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f49d80744e0 0x7f49d80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:44.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.260+0000 7f49eea00640 1 -- 172.21.15.19:0/4160590509 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f49e8094720 con 0x7f49f80c4930 2024-04-25T10:25:44.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.260+0000 7f49f6000640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f49d80744e0 0x7f49d80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:44.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.261+0000 7f49f6000640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f49d80744e0 0x7f49d80769f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f49f80cbc60 tx=0x7f49e4007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:44.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.265+0000 7f49eea00640 1 -- 172.21.15.19:0/4160590509 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49e805e5e0 con 0x7f49f80c4930 2024-04-25T10:25:44.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.512+0000 7f49fd800640 1 -- 172.21.15.19:0/4160590509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49f81509e0 con 0x7f49f80c4930 2024-04-25T10:25:44.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.513+0000 7f49eea00640 1 -- 172.21.15.19:0/4160590509 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6834 (secure 0 0 0) 0x7f49e80628e0 con 0x7f49f80c4930 2024-04-25T10:25:44.515 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:44.515 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4288,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:25:42.205484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-25T10:25:44.516 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-04-25T10:25:44.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 -- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f49d80744e0 msgr2=0x7f49d80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f49d80744e0 0x7f49d80769f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f49f80cbc60 tx=0x7f49e4007de0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 -- 172.21.15.19:0/4160590509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f80c4930 msgr2=0x7f49f80cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f80c4930 0x7f49f80cc470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f49e800c470 tx=0x7f49e800c930 comp rx=0 tx=0).stop 2024-04-25T10:25:44.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 -- 172.21.15.19:0/4160590509 shutdown_connections 2024-04-25T10:25:44.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8159f90 0x7f49f81e2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f49d80744e0 0x7f49d80769f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8159b80 0x7f49f8157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 --2- 172.21.15.19:0/4160590509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49f80c4930 0x7f49f80cc470 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 -- 172.21.15.19:0/4160590509 >> 172.21.15.19:0/4160590509 conn(0x7f49f806f1f0 msgr2=0x7f49f81534f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:44.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 -- 172.21.15.19:0/4160590509 shutdown_connections 2024-04-25T10:25:44.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.516+0000 7f49fd800640 1 -- 172.21.15.19:0/4160590509 wait complete. 2024-04-25T10:25:44.545 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:25:44.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.829+0000 7fef11800640 1 Processor -- start 2024-04-25T10:25:44.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.829+0000 7fef11800640 1 -- start start 2024-04-25T10:25:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.831+0000 7fef11800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fef0c072ea0 0x7fef0c0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.831+0000 7fef11800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0c0c2890 con 0x7fef0c159170 2024-04-25T10:25:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.831+0000 7fef11800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0c0c2b70 con 0x7fef0c0b3280 2024-04-25T10:25:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.831+0000 7fef11800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fef0c0c8830 con 0x7fef0c072ea0 2024-04-25T10:25:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.832+0000 7fef0be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fef0c072ea0 0x7fef0c0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.832+0000 7fef10e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fef0c159170 0x7fef0c070680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52532/0 (socket says 172.21.15.19:52532) 2024-04-25T10:25:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.832+0000 7fef10e00640 1 -- 172.21.15.19:0/1359734599 learned_addr learned my addr 172.21.15.19:0/1359734599 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.832+0000 7fef0be00640 1 -- 172.21.15.19:0/1359734599 >> v1:172.21.15.112:6789/0 conn(0x7fef0c0b3280 legacy=0x7fef0c152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.832+0000 7fef0be00640 1 -- 172.21.15.19:0/1359734599 >> v1:172.21.15.19:6789/0 conn(0x7fef0c159170 legacy=0x7fef0c070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.832+0000 7fef0be00640 1 -- 172.21.15.19:0/1359734599 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0c0c2e50 con 0x7fef0c072ea0 2024-04-25T10:25:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.832+0000 7fef0b400640 1 -- 172.21.15.19:0/1359734599 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838405111 0 0) 0x7fef0c0c2890 con 0x7fef0c159170 2024-04-25T10:25:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.833+0000 7fef0be00640 1 --2- 172.21.15.19:0/1359734599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c072ea0 0x7fef0c0c82f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feefc0097a0 tx=0x7feefc02a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=569b9a4928ef952f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.834+0000 7fef0b400640 1 -- 172.21.15.19:0/1359734599 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc037070 con 0x7fef0c072ea0 2024-04-25T10:25:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.834+0000 7fef0b400640 1 -- 172.21.15.19:0/1359734599 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feefc032640 con 0x7fef0c072ea0 2024-04-25T10:25:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.834+0000 7fef0b400640 1 -- 172.21.15.19:0/1359734599 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc032a10 con 0x7fef0c072ea0 2024-04-25T10:25:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.835+0000 7fef11800640 1 -- 172.21.15.19:0/1359734599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c072ea0 msgr2=0x7fef0c0c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.835+0000 7fef11800640 1 --2- 172.21.15.19:0/1359734599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c072ea0 0x7fef0c0c82f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feefc0097a0 tx=0x7feefc02a2c0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.835+0000 7fef11800640 1 -- 172.21.15.19:0/1359734599 shutdown_connections 2024-04-25T10:25:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.835+0000 7fef11800640 1 --2- 172.21.15.19:0/1359734599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c072ea0 0x7fef0c0c82f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.835+0000 7fef11800640 1 -- 172.21.15.19:0/1359734599 >> 172.21.15.19:0/1359734599 conn(0x7fef0c0cdbc0 msgr2=0x7fef0c0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.835+0000 7fef11800640 1 -- 172.21.15.19:0/1359734599 shutdown_connections 2024-04-25T10:25:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.835+0000 7fef11800640 1 -- 172.21.15.19:0/1359734599 wait complete. 2024-04-25T10:25:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.838+0000 7fef11800640 1 Processor -- start 2024-04-25T10:25:44.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.838+0000 7fef11800640 1 -- start start 2024-04-25T10:25:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.840+0000 7fef11800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c072ea0 0x7fef0c0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.840+0000 7fef11800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef0c0b3280 0x7fef0c1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.840+0000 7fef11800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0c159170 0x7fef0c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.840+0000 7fef11800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fef0c158c50 con 0x7fef0c0b3280 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.840+0000 7fef11800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fef0c0c2640 con 0x7fef0c072ea0 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.840+0000 7fef11800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fef0c159580 con 0x7fef0c159170 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.841+0000 7fef0be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c072ea0 0x7fef0c0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.841+0000 7fef0be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c072ea0 0x7fef0c0c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:38902/0 (socket says 172.21.15.19:38902) 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.841+0000 7fef0be00640 1 -- 172.21.15.19:0/2622240930 learned_addr learned my addr 172.21.15.19:0/2622240930 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.841+0000 7fef03400640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef0c0b3280 0x7fef0c1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.841+0000 7fef10e00640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0c159170 0x7fef0c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.841+0000 7fef0be00640 1 -- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0c159170 msgr2=0x7fef0c1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.841+0000 7fef0be00640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0c159170 0x7fef0c1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.841+0000 7fef0be00640 1 -- 172.21.15.19:0/2622240930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef0c0b3280 msgr2=0x7fef0c1534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:44.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.841+0000 7fef0be00640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef0c0b3280 0x7fef0c1534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:44.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.841+0000 7fef0be00640 1 -- 172.21.15.19:0/2622240930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0c0c9500 con 0x7fef0c072ea0 2024-04-25T10:25:44.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.842+0000 7fef0be00640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c072ea0 0x7fef0c0c8fc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feefc000c00 tx=0x7feefc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:44.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.842+0000 7fef08c00640 1 -- 172.21.15.19:0/2622240930 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc041020 con 0x7fef0c072ea0 2024-04-25T10:25:44.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.842+0000 7fef08c00640 1 -- 172.21.15.19:0/2622240930 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feefc030970 con 0x7fef0c072ea0 2024-04-25T10:25:44.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.842+0000 7fef08c00640 1 -- 172.21.15.19:0/2622240930 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc037040 con 0x7fef0c072ea0 2024-04-25T10:25:44.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.842+0000 7fef11800640 1 -- 172.21.15.19:0/2622240930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0c1edd70 con 0x7fef0c072ea0 2024-04-25T10:25:44.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.842+0000 7fef11800640 1 -- 172.21.15.19:0/2622240930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef0c1ee310 con 0x7fef0c072ea0 2024-04-25T10:25:44.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.843+0000 7fef11800640 1 -- 172.21.15.19:0/2622240930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef0c050740 con 0x7fef0c072ea0 2024-04-25T10:25:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.844+0000 7fef08c00640 1 -- 172.21.15.19:0/2622240930 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feefc044020 con 0x7fef0c072ea0 2024-04-25T10:25:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.845+0000 7fef08c00640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feee80744e0 0x7feee80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.846+0000 7fef08c00640 1 -- 172.21.15.19:0/2622240930 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feefc0b5e90 con 0x7fef0c072ea0 2024-04-25T10:25:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.846+0000 7fef03400640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feee80744e0 0x7feee80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:44.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.847+0000 7fef03400640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feee80744e0 0x7feee80769f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feef4007fd0 tx=0x7feef4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:44.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:44.851+0000 7fef08c00640 1 -- 172.21.15.19:0/2622240930 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feefc04b030 con 0x7fef0c072ea0 2024-04-25T10:25:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.059+0000 7fef11800640 1 -- 172.21.15.19:0/2622240930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef0c1560f0 con 0x7fef0c072ea0 2024-04-25T10:25:45.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.061+0000 7fef08c00640 1 -- 172.21.15.19:0/2622240930 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18518 (secure 0 0 0) 0x7feefc0b7090 con 0x7fef0c072ea0 2024-04-25T10:25:45.064 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:45.064 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:41.790347+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:25:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.064+0000 7fef11800640 1 -- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feee80744e0 msgr2=0x7feee80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.064+0000 7fef11800640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feee80744e0 0x7feee80769f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feef4007fd0 tx=0x7feef4009040 comp rx=0 tx=0).stop 2024-04-25T10:25:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.064+0000 7fef11800640 1 -- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c072ea0 msgr2=0x7fef0c0c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.064+0000 7fef11800640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c072ea0 0x7fef0c0c8fc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feefc000c00 tx=0x7feefc0046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.064+0000 7fef11800640 1 -- 172.21.15.19:0/2622240930 shutdown_connections 2024-04-25T10:25:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.064+0000 7fef11800640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feee80744e0 0x7feee80769f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.064+0000 7fef11800640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0c159170 0x7fef0c1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.064+0000 7fef11800640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef0c0b3280 0x7fef0c1534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.064+0000 7fef11800640 1 --2- 172.21.15.19:0/2622240930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c072ea0 0x7fef0c0c8fc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.064+0000 7fef11800640 1 -- 172.21.15.19:0/2622240930 >> 172.21.15.19:0/2622240930 conn(0x7fef0c0cdbc0 msgr2=0x7fef0c14cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.065+0000 7fef11800640 1 -- 172.21.15.19:0/2622240930 shutdown_connections 2024-04-25T10:25:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.065+0000 7fef11800640 1 -- 172.21.15.19:0/2622240930 wait complete. 2024-04-25T10:25:45.695 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:25:36.724799+0000', 'modified': '2024-04-25T10:25:42.205484+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4309': {'gid': 4309, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.19:6835/1037719859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6834', 'nonce': 1037719859}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 1037719859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4309, 'qdb_cluster': [4309]} 2024-04-25T10:25:45.695 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:25:45.696 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:25:45.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.996+0000 7f2516400640 1 Processor -- start 2024-04-25T10:25:45.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.996+0000 7f2516400640 1 -- start start 2024-04-25T10:25:46.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.999+0000 7f2516400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f25100c4930 0x7f25101534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.999+0000 7f2516400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25100b07c0 con 0x7f2510159b80 2024-04-25T10:25:46.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.999+0000 7f2516400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25100b2600 con 0x7f2510159f90 2024-04-25T10:25:46.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.999+0000 7f2516400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f25101596f0 con 0x7f25100c4930 2024-04-25T10:25:46.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.999+0000 7f2506a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2510159b80 0x7f25100742c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52536/0 (socket says 172.21.15.19:52536) 2024-04-25T10:25:46.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.999+0000 7f2506a00640 1 -- 172.21.15.19:0/1235438764 learned_addr learned my addr 172.21.15.19:0/1235438764 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:46.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:45.999+0000 7f250f400640 1 --2- 172.21.15.19:0/1235438764 >> v2:172.21.15.112:3300/0 conn(0x7f25100c4930 0x7f25101534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.000+0000 7f250ea00640 1 -- 172.21.15.19:0/1235438764 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484382910 0 0) 0x7f25100b07c0 con 0x7f2510159b80 2024-04-25T10:25:46.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.000+0000 7f250ea00640 1 -- 172.21.15.19:0/1235438764 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24f4003520 con 0x7f2510159b80 2024-04-25T10:25:46.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.000+0000 7f250f400640 1 -- 172.21.15.19:0/1235438764 >> v1:172.21.15.112:6789/0 conn(0x7f2510159f90 legacy=0x7f25100c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:46.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.000+0000 7f250ea00640 1 -- 172.21.15.19:0/1235438764 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365317663 0 0) 0x7f25100b2600 con 0x7f2510159f90 2024-04-25T10:25:46.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.000+0000 7f250f400640 1 -- 172.21.15.19:0/1235438764 >> v1:172.21.15.19:6789/0 conn(0x7f2510159b80 legacy=0x7f25100742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:46.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.000+0000 7f250f400640 1 -- 172.21.15.19:0/1235438764 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25100b28e0 con 0x7f25100c4930 2024-04-25T10:25:46.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.001+0000 7f250f400640 1 --2- 172.21.15.19:0/1235438764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25100c4930 0x7f25101534f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25000097a0 tx=0x7f250002c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48888da6d7f676a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:46.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.001+0000 7f250ea00640 1 -- 172.21.15.19:0/1235438764 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500038070 con 0x7f25100c4930 2024-04-25T10:25:46.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.001+0000 7f250ea00640 1 -- 172.21.15.19:0/1235438764 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2500031710 con 0x7f25100c4930 2024-04-25T10:25:46.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.001+0000 7f250ea00640 1 -- 172.21.15.19:0/1235438764 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500031ac0 con 0x7f25100c4930 2024-04-25T10:25:46.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.002+0000 7f2516400640 1 -- 172.21.15.19:0/1235438764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25100c4930 msgr2=0x7f25101534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:46.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.002+0000 7f2516400640 1 --2- 172.21.15.19:0/1235438764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25100c4930 0x7f25101534f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25000097a0 tx=0x7f250002c440 comp rx=0 tx=0).stop 2024-04-25T10:25:46.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.002+0000 7f2516400640 1 -- 172.21.15.19:0/1235438764 shutdown_connections 2024-04-25T10:25:46.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.002+0000 7f2516400640 1 --2- 172.21.15.19:0/1235438764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25100c4930 0x7f25101534f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:46.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.002+0000 7f2516400640 1 -- 172.21.15.19:0/1235438764 >> 172.21.15.19:0/1235438764 conn(0x7f251006f1f0 msgr2=0x7f251006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:46.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.002+0000 7f2516400640 1 -- 172.21.15.19:0/1235438764 shutdown_connections 2024-04-25T10:25:46.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.002+0000 7f2516400640 1 -- 172.21.15.19:0/1235438764 wait complete. 2024-04-25T10:25:46.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.005+0000 7f2516400640 1 Processor -- start 2024-04-25T10:25:46.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.005+0000 7f2516400640 1 -- start start 2024-04-25T10:25:46.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.006+0000 7f2516400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25100c4930 0x7f2510154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.006+0000 7f2516400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2510159b80 0x7f25101f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.006+0000 7f2516400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2510159f90 0x7f2510155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.006+0000 7f2516400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f251015c900 con 0x7f2510159b80 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.006+0000 7f2516400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f25100b2ea0 con 0x7f25100c4930 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.006+0000 7f2516400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2510153a30 con 0x7f2510159f90 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.007+0000 7f250f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25100c4930 0x7f2510154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.007+0000 7f250fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2510159f90 0x7f2510155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.007+0000 7f250f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25100c4930 0x7f2510154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:38914/0 (socket says 172.21.15.19:38914) 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.007+0000 7f250f400640 1 -- 172.21.15.19:0/1746425987 learned_addr learned my addr 172.21.15.19:0/1746425987 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.007+0000 7f2506a00640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2510159b80 0x7f25101f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.007+0000 7f250f400640 1 -- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2510159f90 msgr2=0x7f2510155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.007+0000 7f250f400640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2510159f90 0x7f2510155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:46.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.007+0000 7f250f400640 1 -- 172.21.15.19:0/1746425987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2510159b80 msgr2=0x7f25101f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:46.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.007+0000 7f250f400640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2510159b80 0x7f25101f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:46.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.007+0000 7f250f400640 1 -- 172.21.15.19:0/1746425987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25101f2d20 con 0x7f25100c4930 2024-04-25T10:25:46.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.007+0000 7f250f400640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25100c4930 0x7f2510154f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2500000c00 tx=0x7f25000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:46.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.008+0000 7f2507e00640 1 -- 172.21.15.19:0/1746425987 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500038040 con 0x7f25100c4930 2024-04-25T10:25:46.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.008+0000 7f2507e00640 1 -- 172.21.15.19:0/1746425987 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2500033830 con 0x7f25100c4930 2024-04-25T10:25:46.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.008+0000 7f2507e00640 1 -- 172.21.15.19:0/1746425987 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500006e10 con 0x7f25100c4930 2024-04-25T10:25:46.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.008+0000 7f2516400640 1 -- 172.21.15.19:0/1746425987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25100c6a60 con 0x7f25100c4930 2024-04-25T10:25:46.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.008+0000 7f2516400640 1 -- 172.21.15.19:0/1746425987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25100c7020 con 0x7f25100c4930 2024-04-25T10:25:46.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.010+0000 7f2507e00640 1 -- 172.21.15.19:0/1746425987 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2500033c20 con 0x7f25100c4930 2024-04-25T10:25:46.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.011+0000 7f2507e00640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f24ec0744b0 0x7f24ec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.012+0000 7f2507e00640 1 -- 172.21.15.19:0/1746425987 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f25000b5f50 con 0x7f25100c4930 2024-04-25T10:25:46.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.012+0000 7f2506a00640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f24ec0744b0 0x7f24ec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.012+0000 7f251d3a6740 1 Processor -- start 2024-04-25T10:25:46.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.013+0000 7f2506a00640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f24ec0744b0 0x7f24ec0769c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f25101f3530 tx=0x7f24f8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:46.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.013+0000 7f251d3a6740 1 -- start start 2024-04-25T10:25:46.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e8b270 0x5639a626ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e623b0 0x5639a6252430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6252970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f251d3a6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5639a6191600 con 0x5639a5e623b0 2024-04-25T10:25:46.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f251d3a6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5639a612e100 con 0x5639a5e6a590 2024-04-25T10:25:46.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f251d3a6740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5639a618d5c0 con 0x5639a5e8b270 2024-04-25T10:25:46.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f2506a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e623b0 0x5639a6252430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f250f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e8b270 0x5639a626ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f250fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6252970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f2506a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e623b0 0x5639a6252430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51062/0 (socket says 172.21.15.19:51062) 2024-04-25T10:25:46.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f2506a00640 1 -- 172.21.15.19:0/3202266979 learned_addr learned my addr 172.21.15.19:0/3202266979 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:46.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.014+0000 7f250f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e8b270 0x5639a626ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:38902/0 (socket says 172.21.15.19:38902) 2024-04-25T10:25:46.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.015+0000 7f250f400640 1 -- 172.21.15.19:0/3202266979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 msgr2=0x5639a6252970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:46.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.015+0000 7f250f400640 1 --2- 172.21.15.19:0/3202266979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6252970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:46.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.015+0000 7f250f400640 1 -- 172.21.15.19:0/3202266979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e623b0 msgr2=0x5639a6252430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:46.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.015+0000 7f250f400640 1 --2- 172.21.15.19:0/3202266979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e623b0 0x5639a6252430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:46.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.015+0000 7f250f400640 1 -- 172.21.15.19:0/3202266979 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639a5ea32d0 con 0x5639a5e8b270 2024-04-25T10:25:46.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.015+0000 7f250f400640 1 --2- 172.21.15.19:0/3202266979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e8b270 0x5639a626ee10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25000b4070 tx=0x7f250007f750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dfc3c35ddb9bc14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:46.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.015+0000 7f24ffe00640 1 -- 172.21.15.19:0/3202266979 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250007fd40 con 0x5639a5e8b270 2024-04-25T10:25:46.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.015+0000 7f24ffe00640 1 -- 172.21.15.19:0/3202266979 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2500084040 con 0x5639a5e8b270 2024-04-25T10:25:46.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.015+0000 7f24ffe00640 1 -- 172.21.15.19:0/3202266979 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500088a60 con 0x5639a5e8b270 2024-04-25T10:25:46.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.016+0000 7f251d3a6740 1 -- 172.21.15.19:0/3202266979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e8b270 msgr2=0x5639a626ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:46.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.016+0000 7f251d3a6740 1 --2- 172.21.15.19:0/3202266979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e8b270 0x5639a626ee10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25000b4070 tx=0x7f250007f750 comp rx=0 tx=0).stop 2024-04-25T10:25:46.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.016+0000 7f251d3a6740 1 -- 172.21.15.19:0/3202266979 shutdown_connections 2024-04-25T10:25:46.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.016+0000 7f251d3a6740 1 --2- 172.21.15.19:0/3202266979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6252970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:46.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.016+0000 7f251d3a6740 1 --2- 172.21.15.19:0/3202266979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e623b0 0x5639a6252430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:46.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.016+0000 7f251d3a6740 1 --2- 172.21.15.19:0/3202266979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e8b270 0x5639a626ee10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:46.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.016+0000 7f251d3a6740 1 -- 172.21.15.19:0/3202266979 >> 172.21.15.19:0/3202266979 conn(0x5639a5e7f3c0 msgr2=0x5639a622ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:46.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.016+0000 7f251d3a6740 1 -- 172.21.15.19:0/3202266979 shutdown_connections 2024-04-25T10:25:46.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.016+0000 7f251d3a6740 1 -- 172.21.15.19:0/3202266979 wait complete. 2024-04-25T10:25:46.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.017+0000 7f251d3a6740 1 -- start start 2024-04-25T10:25:46.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.018+0000 7f251d3a6740 1 Processor -- start 2024-04-25T10:25:46.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.019+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e623b0 0x5639a6271db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.019+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6266560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.019+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a6267dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.019+0000 7f251d3a6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5639a622c890 con 0x5639a5e8b270 2024-04-25T10:25:46.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.019+0000 7f251d3a6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5639a6118f70 con 0x5639a5e6a590 2024-04-25T10:25:46.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.019+0000 7f251d3a6740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5639a618d5c0 con 0x5639a5e623b0 2024-04-25T10:25:46.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.019+0000 7f251d3a6740 10 client.0 _ll_register_callbacks cb 0x5639a6187480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:25:46.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.019+0000 7f250fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a6267dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.019+0000 7f250fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a6267dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51066/0 (socket says 172.21.15.19:51066) 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.019+0000 7f250fe00640 1 -- 172.21.15.19:0/3286445707 learned_addr learned my addr 172.21.15.19:0/3286445707 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.020+0000 7f250f400640 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e623b0 0x5639a6271db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.020+0000 7f2506a00640 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6266560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.020+0000 7f250fe00640 1 -- 172.21.15.19:0/3286445707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e623b0 msgr2=0x5639a6271db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.020+0000 7f250fe00640 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e623b0 0x5639a6271db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.020+0000 7f250fe00640 1 -- 172.21.15.19:0/3286445707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 msgr2=0x5639a6266560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.020+0000 7f250fe00640 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6266560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.020+0000 7f250fe00640 1 -- 172.21.15.19:0/3286445707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639a5f6d6b0 con 0x5639a5e8b270 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.020+0000 7f250fe00640 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a6267dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f25080126e0 tx=0x7f2508012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832d35610d646323 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.020+0000 7f24fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.020+0000 7f24fcc00640 1 -- 172.21.15.19:0/3286445707 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508019020 con 0x5639a5e8b270 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f24fcc00640 1 -- 172.21.15.19:0/3286445707 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2508003970 con 0x5639a5e8b270 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f251d3a6740 1 -- 172.21.15.19:0/3286445707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2500084040 con 0x5639a5e8b270 2024-04-25T10:25:46.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f24fcc00640 1 -- 172.21.15.19:0/3286445707 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f2508023050 con 0x5639a5e8b270 2024-04-25T10:25:46.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f251d3a6740 10 client.4356 fetch_fsmap learned FSMap version 6 2024-04-25T10:25:46.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f251d3a6740 1 -- 172.21.15.19:0/3286445707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5639a6266cb0 con 0x5639a5e8b270 2024-04-25T10:25:46.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f24fcc00640 1 -- 172.21.15.19:0/3286445707 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2500084040 con 0x5639a5e8b270 2024-04-25T10:25:46.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f24fcc00640 1 -- 172.21.15.19:0/3286445707 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f2508026020 con 0x5639a5e8b270 2024-04-25T10:25:46.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f251d3a6740 10 client.4356 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T10:25:46.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f251d3a6740 10 client.4356 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:25:46.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f251d3a6740 20 client.4356 populate_metadata read hostname 'smithi019' 2024-04-25T10:25:46.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f251d3a6740 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5639a5e49e40 0x5639a628ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:46.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f251d3a6740 4 client.4356 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:25:46.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.021+0000 7f251d3a6740 1 -- 172.21.15.19:0/3286445707 --> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639a619f210 con 0x5639a5e49e40 2024-04-25T10:25:46.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.022+0000 7f250f400640 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5639a5e49e40 0x5639a628ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:46.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.022+0000 7f250f400640 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5639a5e49e40 0x5639a628ca90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5506653c59a896cd server_cookie=cefb060dc8ac4ed9 in_seq=0 out_seq=0 2024-04-25T10:25:46.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:46.022+0000 7f24fcc00640 10 client.4356 ms_handle_connect on v2:172.21.15.19:6834/1037719859 2024-04-25T10:25:47.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.225+0000 7f24fcc00640 1 -- 172.21.15.19:0/3286445707 <== mds.0 v2:172.21.15.19:6834/1037719859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5639a619f210 con 0x5639a5e49e40 2024-04-25T10:25:47.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.225+0000 7f24fcc00640 10 client.4356 handle_command_reply: tid=0 2024-04-25T10:25:47.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.225+0000 7f251d3a6740 1 client.4356 shutdown 2024-04-25T10:25:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.225+0000 7f251d3a6740 1 -- 172.21.15.19:0/3286445707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 msgr2=0x5639a6267dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.226+0000 7f251d3a6740 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a6267dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f25080126e0 tx=0x7f2508012ba0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.226+0000 7f251d3a6740 1 -- 172.21.15.19:0/3286445707 shutdown_connections 2024-04-25T10:25:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.226+0000 7f251d3a6740 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5639a5e49e40 0x5639a628ca90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.226+0000 7f251d3a6740 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a6267dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.226+0000 7f251d3a6740 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6266560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.226+0000 7f251d3a6740 1 --2- 172.21.15.19:0/3286445707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e623b0 0x5639a6271db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.226+0000 7f24fcc00640 0 client.4356 ms_handle_reset on v2:172.21.15.19:6834/1037719859 2024-04-25T10:25:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.226+0000 7f251d3a6740 1 -- 172.21.15.19:0/3286445707 >> 172.21.15.19:0/3286445707 conn(0x5639a5e7f3c0 msgr2=0x5639a6228530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.226+0000 7f251d3a6740 1 -- 172.21.15.19:0/3286445707 shutdown_connections 2024-04-25T10:25:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.226+0000 7f251d3a6740 1 -- 172.21.15.19:0/3286445707 wait complete. 2024-04-25T10:25:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.227+0000 7f251d3a6740 20 client.4356 trim_cache size 0 max 16384 2024-04-25T10:25:47.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.267+0000 7f251d3a6740 1 Processor -- start 2024-04-25T10:25:47.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.268+0000 7f251d3a6740 1 -- start start 2024-04-25T10:25:47.289 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:25:47.289 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "03c2053f-8374-429e-9fda-d77b86219935", 2024-04-25T10:25:47.289 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-04-25T10:25:47.289 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4309, 2024-04-25T10:25:47.289 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-04-25T10:25:47.289 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-04-25T10:25:47.289 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-04-25T10:25:47.290 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 10.135443819000001, 2024-04-25T10:25:47.290 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 5, 2024-04-25T10:25:47.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 24, 2024-04-25T10:25:47.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 24, 2024-04-25T10:25:47.290 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 16.041325243999999 2024-04-25T10:25:47.290 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:25:47.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.270+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e623b0 0x5639a6267dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.271+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6268300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.271+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a622d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.271+0000 7f251d3a6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f25101ff0c0 con 0x5639a5e8b270 2024-04-25T10:25:47.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.271+0000 7f251d3a6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5639a6268ac0 con 0x5639a5e6a590 2024-04-25T10:25:47.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.271+0000 7f251d3a6740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5639a626bd70 con 0x5639a5e623b0 2024-04-25T10:25:47.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.271+0000 7f2506a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6268300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.271+0000 7f250f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e623b0 0x5639a6267dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.271+0000 7f2506a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6268300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:38944/0 (socket says 172.21.15.19:38944) 2024-04-25T10:25:47.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.271+0000 7f2506a00640 1 -- 172.21.15.19:0/2677815270 learned_addr learned my addr 172.21.15.19:0/2677815270 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:47.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.271+0000 7f250fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a622d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.272+0000 7f2506a00640 1 -- 172.21.15.19:0/2677815270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e623b0 msgr2=0x5639a6267dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:47.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.272+0000 7f2506a00640 1 --2- 172.21.15.19:0/2677815270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e623b0 0x5639a6267dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.272+0000 7f2506a00640 1 -- 172.21.15.19:0/2677815270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 msgr2=0x5639a622d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:47.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.272+0000 7f2506a00640 1 --2- 172.21.15.19:0/2677815270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a622d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.272+0000 7f2506a00640 1 -- 172.21.15.19:0/2677815270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639a618d780 con 0x5639a5e6a590 2024-04-25T10:25:47.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.272+0000 7f250fe00640 1 --2- 172.21.15.19:0/2677815270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a622d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:25:47.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.272+0000 7f2506a00640 1 --2- 172.21.15.19:0/2677815270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6268300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5639a62654f0 tx=0x7f24f8000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bcd9d724104095 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:47.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.273+0000 7f24ff400640 1 -- 172.21.15.19:0/2677815270 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8038070 con 0x5639a5e6a590 2024-04-25T10:25:47.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.273+0000 7f24ff400640 1 -- 172.21.15.19:0/2677815270 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f8015e30 con 0x5639a5e6a590 2024-04-25T10:25:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.273+0000 7f24ff400640 1 -- 172.21.15.19:0/2677815270 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8034450 con 0x5639a5e6a590 2024-04-25T10:25:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.274+0000 7f251d3a6740 1 -- 172.21.15.19:0/2677815270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 msgr2=0x5639a6268300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.274+0000 7f251d3a6740 1 --2- 172.21.15.19:0/2677815270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6268300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5639a62654f0 tx=0x7f24f8000ed0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.275+0000 7f251d3a6740 1 -- 172.21.15.19:0/2677815270 shutdown_connections 2024-04-25T10:25:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.275+0000 7f251d3a6740 1 --2- 172.21.15.19:0/2677815270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a622d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.275+0000 7f251d3a6740 1 --2- 172.21.15.19:0/2677815270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e6a590 0x5639a6268300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.275+0000 7f251d3a6740 1 --2- 172.21.15.19:0/2677815270 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e623b0 0x5639a6267dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.275+0000 7f251d3a6740 1 -- 172.21.15.19:0/2677815270 >> 172.21.15.19:0/2677815270 conn(0x5639a5e7f3c0 msgr2=0x5639a6255b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.275+0000 7f251d3a6740 1 -- 172.21.15.19:0/2677815270 shutdown_connections 2024-04-25T10:25:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.275+0000 7f251d3a6740 1 -- 172.21.15.19:0/2677815270 wait complete. 2024-04-25T10:25:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.277+0000 7f251d3a6740 1 -- start start 2024-04-25T10:25:47.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.277+0000 7f251d3a6740 1 Processor -- start 2024-04-25T10:25:47.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.281+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e623b0 0x5639a6264180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.281+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e6a590 0x5639a6277f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.281+0000 7f251d3a6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a6277300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.281+0000 7f250f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e623b0 0x5639a6264180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.281+0000 7f251d3a6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5639a626b1a0 con 0x5639a5e8b270 2024-04-25T10:25:47.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.281+0000 7f2506a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e6a590 0x5639a6277f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.281+0000 7f251d3a6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5639a626ab10 con 0x5639a5e623b0 2024-04-25T10:25:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.281+0000 7f250f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e623b0 0x5639a6264180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:38948/0 (socket says 172.21.15.19:38948) 2024-04-25T10:25:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.281+0000 7f251d3a6740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5639a62816f0 con 0x5639a5e6a590 2024-04-25T10:25:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.281+0000 7f250f400640 1 -- 172.21.15.19:0/619882721 learned_addr learned my addr 172.21.15.19:0/619882721 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.281+0000 7f250fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a6277300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f251d3a6740 10 client.0 _ll_register_callbacks cb 0x7f25080019d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:25:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f250f400640 1 -- 172.21.15.19:0/619882721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e6a590 msgr2=0x5639a6277f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:47.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f250f400640 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e6a590 0x5639a6277f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f250f400640 1 -- 172.21.15.19:0/619882721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 msgr2=0x5639a6277300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:47.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f250f400640 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a6277300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f250f400640 1 -- 172.21.15.19:0/619882721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639a6278450 con 0x5639a5e623b0 2024-04-25T10:25:47.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f2506a00640 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e6a590 0x5639a6277f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:47.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f250fe00640 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a6277300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:25:47.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f250f400640 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e623b0 0x5639a6264180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2500032040 tx=0x7f250000e2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80584e66c9a76c52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:47.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f24fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-04-25T10:25:47.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f24fcc00640 1 -- 172.21.15.19:0/619882721 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500084040 con 0x5639a5e623b0 2024-04-25T10:25:47.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.282+0000 7f24fcc00640 1 -- 172.21.15.19:0/619882721 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f25000885d0 con 0x5639a5e623b0 2024-04-25T10:25:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f251d3a6740 1 -- 172.21.15.19:0/619882721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24f8015e30 con 0x5639a5e623b0 2024-04-25T10:25:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f24fcc00640 1 -- 172.21.15.19:0/619882721 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f2500009130 con 0x5639a5e623b0 2024-04-25T10:25:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f251d3a6740 10 client.4435 fetch_fsmap learned FSMap version 6 2024-04-25T10:25:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f251d3a6740 1 -- 172.21.15.19:0/619882721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5639a6277840 con 0x5639a5e623b0 2024-04-25T10:25:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f24fcc00640 1 -- 172.21.15.19:0/619882721 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f8015e30 con 0x5639a5e623b0 2024-04-25T10:25:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f24fcc00640 1 -- 172.21.15.19:0/619882721 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f25000a10b0 con 0x5639a5e623b0 2024-04-25T10:25:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f251d3a6740 10 client.4435 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T10:25:47.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f251d3a6740 10 client.4435 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:25:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f251d3a6740 20 client.4435 populate_metadata read hostname 'smithi019' 2024-04-25T10:25:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f251d3a6740 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5639a627dfe0 0x5639a6270ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f251d3a6740 4 client.4435 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:25:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.283+0000 7f251d3a6740 1 -- 172.21.15.19:0/619882721 --> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] -- command(tid 0: {"prefix": "status"}) -- 0x5639a6199080 con 0x5639a627dfe0 2024-04-25T10:25:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.284+0000 7f2506a00640 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5639a627dfe0 0x5639a6270ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.284+0000 7f2506a00640 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5639a627dfe0 0x5639a6270ed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7562b05a6ec70a50 server_cookie=6ed7310a284e04d4 in_seq=0 out_seq=0 2024-04-25T10:25:47.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.284+0000 7f24fcc00640 10 client.4435 ms_handle_connect on v2:172.21.15.19:6834/1037719859 2024-04-25T10:25:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f24fcc00640 1 -- 172.21.15.19:0/619882721 <== mds.0 v2:172.21.15.19:6834/1037719859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5639a6199080 con 0x5639a627dfe0 2024-04-25T10:25:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f24fcc00640 10 client.4435 handle_command_reply: tid=0 2024-04-25T10:25:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f251d3a6740 1 client.4435 shutdown 2024-04-25T10:25:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f251d3a6740 1 -- 172.21.15.19:0/619882721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e623b0 msgr2=0x5639a6264180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f251d3a6740 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e623b0 0x5639a6264180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2500032040 tx=0x7f250000e2f0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f251d3a6740 1 -- 172.21.15.19:0/619882721 shutdown_connections 2024-04-25T10:25:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f251d3a6740 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5639a627dfe0 0x5639a6270ed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f251d3a6740 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5639a5e8b270 0x5639a6277300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f251d3a6740 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5639a5e6a590 0x5639a6277f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f251d3a6740 1 --2- 172.21.15.19:0/619882721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5639a5e623b0 0x5639a6264180 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f24fcc00640 0 client.4435 ms_handle_reset on v2:172.21.15.19:6834/1037719859 2024-04-25T10:25:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.285+0000 7f251d3a6740 1 -- 172.21.15.19:0/619882721 >> 172.21.15.19:0/619882721 conn(0x5639a5e7f3c0 msgr2=0x5639a6266ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.286+0000 7f251d3a6740 1 -- 172.21.15.19:0/619882721 shutdown_connections 2024-04-25T10:25:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.286+0000 7f251d3a6740 1 -- 172.21.15.19:0/619882721 wait complete. 2024-04-25T10:25:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.286+0000 7f251d3a6740 20 client.4435 trim_cache size 0 max 16384 2024-04-25T10:25:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 -- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f24ec0744b0 msgr2=0x7f24ec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:47.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f24ec0744b0 0x7f24ec0769c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f25101f3530 tx=0x7f24f8009040 comp rx=0 tx=0).stop 2024-04-25T10:25:47.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 -- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25100c4930 msgr2=0x7f2510154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:47.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25100c4930 0x7f2510154f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2500000c00 tx=0x7f25000046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 -- 172.21.15.19:0/1746425987 shutdown_connections 2024-04-25T10:25:47.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f24ec0744b0 0x7f24ec0769c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2510159f90 0x7f2510155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2510159b80 0x7f25101f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 --2- 172.21.15.19:0/1746425987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25100c4930 0x7f2510154f40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 -- 172.21.15.19:0/1746425987 >> 172.21.15.19:0/1746425987 conn(0x7f251006f1f0 msgr2=0x7f25100af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:47.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 -- 172.21.15.19:0/1746425987 shutdown_connections 2024-04-25T10:25:47.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.287+0000 7f2516400640 1 -- 172.21.15.19:0/1746425987 wait complete. 2024-04-25T10:25:47.520 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T10:25:47.521 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:25:47.521 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:25:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.811+0000 7f5222800640 1 Processor -- start 2024-04-25T10:25:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.811+0000 7f5222800640 1 -- start start 2024-04-25T10:25:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.813+0000 7f5222800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f521c0b4360 0x7f521c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.813+0000 7f5222800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f521c0cdb40 0x7f521c15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.814+0000 7f5222800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f521c160230 con 0x7f521c0cdf50 2024-04-25T10:25:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.814+0000 7f5222800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f521c15ffe0 con 0x7f521c0b4360 2024-04-25T10:25:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.814+0000 7f5222800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f521c160510 con 0x7f521c0cdb40 2024-04-25T10:25:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.814+0000 7f521b400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f521c0b4360 0x7f521c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.814+0000 7f521be00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f521c0cdf50 0x7f521c159d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52548/0 (socket says 172.21.15.19:52548) 2024-04-25T10:25:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.814+0000 7f521be00640 1 -- 172.21.15.19:0/3170098302 learned_addr learned my addr 172.21.15.19:0/3170098302 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.814+0000 7f5212a00640 1 --2- 172.21.15.19:0/3170098302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f521c0cdb40 0x7f521c15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.815+0000 7f521b400640 1 -- 172.21.15.19:0/3170098302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f521c0cdb40 msgr2=0x7f521c15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.815+0000 7f521b400640 1 --2- 172.21.15.19:0/3170098302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f521c0cdb40 0x7f521c15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.815+0000 7f521b400640 1 -- 172.21.15.19:0/3170098302 >> v1:172.21.15.19:6789/0 conn(0x7f521c0cdf50 legacy=0x7f521c159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.815+0000 7f521aa00640 1 -- 172.21.15.19:0/3170098302 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211886233 0 0) 0x7f521c160230 con 0x7f521c0cdf50 2024-04-25T10:25:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.815+0000 7f521b400640 1 -- 172.21.15.19:0/3170098302 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c1607f0 con 0x7f521c0b4360 2024-04-25T10:25:47.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.816+0000 7f521b400640 1 --2- 172.21.15.19:0/3170098302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f521c0b4360 0x7f521c0cd1b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f521c160160 tx=0x7f520c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd05272ac68c291a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:47.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.816+0000 7f521aa00640 1 -- 172.21.15.19:0/3170098302 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c037070 con 0x7f521c0b4360 2024-04-25T10:25:47.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.816+0000 7f521aa00640 1 -- 172.21.15.19:0/3170098302 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f520c032440 con 0x7f521c0b4360 2024-04-25T10:25:47.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.816+0000 7f521aa00640 1 -- 172.21.15.19:0/3170098302 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c032810 con 0x7f521c0b4360 2024-04-25T10:25:47.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.817+0000 7f5222800640 1 -- 172.21.15.19:0/3170098302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f521c0b4360 msgr2=0x7f521c0cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:47.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.817+0000 7f5222800640 1 --2- 172.21.15.19:0/3170098302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f521c0b4360 0x7f521c0cd1b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f521c160160 tx=0x7f520c02a180 comp rx=0 tx=0).stop 2024-04-25T10:25:47.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.817+0000 7f5222800640 1 -- 172.21.15.19:0/3170098302 shutdown_connections 2024-04-25T10:25:47.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.817+0000 7f5222800640 1 --2- 172.21.15.19:0/3170098302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f521c0cdb40 0x7f521c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.817+0000 7f5222800640 1 --2- 172.21.15.19:0/3170098302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f521c0b4360 0x7f521c0cd1b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.817+0000 7f5222800640 1 -- 172.21.15.19:0/3170098302 >> 172.21.15.19:0/3170098302 conn(0x7f521c06ed60 msgr2=0x7f521c06f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:47.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.817+0000 7f5222800640 1 -- 172.21.15.19:0/3170098302 shutdown_connections 2024-04-25T10:25:47.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.817+0000 7f5222800640 1 -- 172.21.15.19:0/3170098302 wait complete. 2024-04-25T10:25:47.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.819+0000 7f5222800640 1 Processor -- start 2024-04-25T10:25:47.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.820+0000 7f5222800640 1 -- start start 2024-04-25T10:25:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.821+0000 7f5222800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f521c0b4360 0x7f521c0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.821+0000 7f5222800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f521c0cdb40 0x7f521c152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.821+0000 7f5222800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f521c0cdf50 0x7f521c1f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.821+0000 7f5222800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f521c0cd6f0 con 0x7f521c0cdf50 2024-04-25T10:25:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.821+0000 7f5222800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f521c160db0 con 0x7f521c0b4360 2024-04-25T10:25:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.821+0000 7f5222800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f521c0b78f0 con 0x7f521c0cdb40 2024-04-25T10:25:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.821+0000 7f521be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f521c0cdf50 0x7f521c1f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.821+0000 7f521be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f521c0cdf50 0x7f521c1f2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36032/0 (socket says 172.21.15.19:36032) 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.821+0000 7f521be00640 1 -- 172.21.15.19:0/3304027961 learned_addr learned my addr 172.21.15.19:0/3304027961 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.822+0000 7f5212a00640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f521c0cdb40 0x7f521c152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.822+0000 7f521b400640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f521c0b4360 0x7f521c0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.822+0000 7f521be00640 1 -- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f521c0cdb40 msgr2=0x7f521c152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.822+0000 7f521be00640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f521c0cdb40 0x7f521c152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.822+0000 7f521be00640 1 -- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f521c0b4360 msgr2=0x7f521c0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.822+0000 7f521be00640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f521c0b4360 0x7f521c0b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.822+0000 7f521be00640 1 -- 172.21.15.19:0/3304027961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c14fe40 con 0x7f521c0cdf50 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.822+0000 7f5212a00640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f521c0cdb40 0x7f521c152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.822+0000 7f521be00640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f521c0cdf50 0x7f521c1f2e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f521400c7b0 tx=0x7f521400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:47.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.823+0000 7f5213e00640 1 -- 172.21.15.19:0/3304027961 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214018070 con 0x7f521c0cdf50 2024-04-25T10:25:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.823+0000 7f5213e00640 1 -- 172.21.15.19:0/3304027961 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521400a640 con 0x7f521c0cdf50 2024-04-25T10:25:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.823+0000 7f5222800640 1 -- 172.21.15.19:0/3304027961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521c0b6990 con 0x7f521c0cdf50 2024-04-25T10:25:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.823+0000 7f5213e00640 1 -- 172.21.15.19:0/3304027961 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521400ce60 con 0x7f521c0cdf50 2024-04-25T10:25:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.823+0000 7f5222800640 1 -- 172.21.15.19:0/3304027961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521c152600 con 0x7f521c0cdf50 2024-04-25T10:25:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.824+0000 7f5222800640 1 -- 172.21.15.19:0/3304027961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f521c076520 con 0x7f521c0cdf50 2024-04-25T10:25:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.826+0000 7f5213e00640 1 -- 172.21.15.19:0/3304027961 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f521401b070 con 0x7f521c0cdf50 2024-04-25T10:25:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.827+0000 7f5213e00640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f51f80744e0 0x7f51f80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.827+0000 7f5213e00640 1 -- 172.21.15.19:0/3304027961 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f52140949a0 con 0x7f521c0cdf50 2024-04-25T10:25:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.827+0000 7f521b400640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f51f80744e0 0x7f51f80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:47.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.828+0000 7f521b400640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f51f80744e0 0x7f51f80769f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f520c034000 tx=0x7f520c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:47.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:47.833+0000 7f5213e00640 1 -- 172.21.15.19:0/3304027961 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f521405e790 con 0x7f521c0cdf50 2024-04-25T10:25:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.080+0000 7f5222800640 1 -- 172.21.15.19:0/3304027961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f521c150290 con 0x7f521c0cdf50 2024-04-25T10:25:48.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.081+0000 7f5213e00640 1 -- 172.21.15.19:0/3304027961 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f5214062a90 con 0x7f521c0cdf50 2024-04-25T10:25:48.084 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T10:25:48.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.083+0000 7f5222800640 1 -- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f51f80744e0 msgr2=0x7f51f80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.083+0000 7f5222800640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f51f80744e0 0x7f51f80769f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f520c034000 tx=0x7f520c02e000 comp rx=0 tx=0).stop 2024-04-25T10:25:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.084+0000 7f5222800640 1 -- 172.21.15.19:0/3304027961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f521c0cdf50 msgr2=0x7f521c1f2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.084+0000 7f5222800640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f521c0cdf50 0x7f521c1f2e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f521400c7b0 tx=0x7f521400cc70 comp rx=0 tx=0).stop 2024-04-25T10:25:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.084+0000 7f5222800640 1 -- 172.21.15.19:0/3304027961 shutdown_connections 2024-04-25T10:25:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.084+0000 7f5222800640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f521c0cdf50 0x7f521c1f2e10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.084+0000 7f5222800640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f51f80744e0 0x7f51f80769f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.084+0000 7f5222800640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f521c0cdb40 0x7f521c152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.084+0000 7f5222800640 1 --2- 172.21.15.19:0/3304027961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f521c0b4360 0x7f521c0b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.084+0000 7f5222800640 1 -- 172.21.15.19:0/3304027961 >> 172.21.15.19:0/3304027961 conn(0x7f521c06ed60 msgr2=0x7f521c0c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.084+0000 7f5222800640 1 -- 172.21.15.19:0/3304027961 shutdown_connections 2024-04-25T10:25:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48.084+0000 7f5222800640 1 -- 172.21.15.19:0/3304027961 wait complete. 2024-04-25T10:25:48.113 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:25:48.113 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:25:48.113 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-04-25T10:25:48.113 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T10:25:48.113 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:25:48.113 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:25:48.113 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T10:25:48.113 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:25:48.113 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T10:25:48.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:48.114 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-04-25T10:25:48.165 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:25:48.165 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:25:48.165 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:25:48.165 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:25:48.165 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-04-25T10:25:48.165 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:25:48.165 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:25:48.165 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:25:48.165 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-04-25T10:25:48.165 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:25:48.166 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:25:48.166 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-04-25T10:25:48.166 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:25:48.166 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-04-25T10:25:48.166 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-04-25T10:25:48.166 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:25:48.166 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42668sec preferred_lft 42668sec 2024-04-25T10:25:48.166 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-04-25T10:25:48.166 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:25:48.166 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:25:48.167 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-04-25T10:25:48.167 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-04-25T10:25:48.168 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T10:25:48.168 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:25:48.168 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-04-25T10:25:48.168 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-04-25T10:25:48.168 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-04-25T10:25:48.168 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-04-25T10:25:48.169 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T10:25:48.169 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-04-25T10:25:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:25:48.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:25:48.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:48.680 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:25:48.751 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-04-25T10:25:48.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:48.755 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-04-25T10:25:48.818 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-04-25T10:25:48.818 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:25:48.818 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:25:48.818 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:25:48.818 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:25:48.819 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:25:48.819 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-04-25T10:25:48.819 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:25:48.819 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:25:48.819 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:25:48.819 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-04-25T10:25:48.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:25:49.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:25:49.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:49.588 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-04-25T10:25:49.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:49.645 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-04-25T10:25:49.702 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:25:49.702 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-04-25T10:25:49.702 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:25:49.703 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T10:25:49.703 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-04-25T10:25:49.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:25:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:25:49.900 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T10:25:49.901 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:25:49.901 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-04-25T10:25:49.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T10:25:49.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T10:25:49.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T10:25:49.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T10:25:49.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T10:25:49.901 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-04-25T10:25:50.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:25:50.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:25:50.207 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:25:50.207 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-04-25T10:25:50.207 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-04-25T10:25:50.207 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T10:25:50.208 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-04-25T10:25:50.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:25:50.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:25:50.428 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T10:25:50.428 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:25:50.428 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:25:50.477 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T10:25:50.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:25:50.478 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:25:50.530 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-04-25T10:25:50.619 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T10:25:50.675 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-04-25T10:25:50.675 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-04-25T10:25:50.675 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-04-25T10:25:50.675 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-04-25T10:25:50.676 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:25:50.677 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:25:50.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:50.679 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-04-25T10:25:50.731 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T10:25:50.731 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T10:25:50.738 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-04-25T10:25:50.808 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T10:25:50.851 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-04-25T10:25:50.851 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-04-25T10:25:50.851 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-04-25T10:25:50.851 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-04-25T10:25:50.851 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-04-25T10:25:50.851 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-04-25T10:25:50.851 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-04-25T10:25:50.851 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-04-25T10:25:50.851 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T10:25:50.852 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T10:25:50.853 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-04-25T10:25:50.853 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-04-25T10:25:50.853 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T10:25:50.853 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T10:25:50.853 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T10:25:50.853 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T10:25:50.853 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-04-25T10:25:50.853 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:25:50.853 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:25:50.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:50.854 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-04-25T10:25:50.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:2024-04-25T10:25:50.996+0000 7fa283ddc480 -1 init, newargv = 0x55b476838a20 newargc=15 2024-04-25T10:25:50.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:ceph-fuse[39859]: starting ceph client 2024-04-25T10:25:51.011 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:ceph-fuse[39859]: starting fuse 2024-04-25T10:25:52.046 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-04-25T10:25:52.124 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-04-25T10:25:52.121+0000 7fb28c600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:25:52.149 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T10:25:52.207 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-04-25T10:25:52.207 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-04-25T10:25:52.207 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-04-25T10:25:52.207 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-04-25T10:25:52.207 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-04-25T10:25:52.208 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:25:52.209 INFO:teuthology.orchestra.run.smithi019.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-25T10:25:52.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:52.210 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-04-25T10:25:52.262 INFO:teuthology.orchestra.run.smithi019.stdout:40 2024-04-25T10:25:52.263 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-04-25T10:25:52.263 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-04-25T10:25:52.263 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-04-25T10:25:52.263 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-04-25T10:25:52.263 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-04-25T10:25:52.263 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-04-25T10:25:52.263 DEBUG:teuthology.orchestra.run.smithi019:> 2024-04-25T10:25:52.263 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-04-25T10:25:52.264 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T10:25:52.265 DEBUG:teuthology.orchestra.run.smithi019:> 2024-04-25T10:25:52.265 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.admin")) 2024-04-25T10:25:52.265 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-04-25T10:25:52.441 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.admin.39859.asok 2024-04-25T10:25:52.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:25:52.461 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.39859.asok 2024-04-25T10:25:52.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:52.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.39859.asok status 2024-04-25T10:25:52.770 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:25:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-04-25T10:25:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T10:25:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T10:25:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "admin", 2024-04-25T10:25:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-04-25T10:25:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T10:25:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "39859", 2024-04-25T10:25:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-04-25T10:25:52.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4380, 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 4380 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1857498445 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-04-25T10:25:52.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1857498445 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.4380 192.168.0.1:0/1857498445", 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/1857498445", 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 5, 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 24, 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-04-25T10:25:52.772 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:25:52.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:52.791 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-04-25T10:25:52.791 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:25:52.848 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-04-25T10:25:52.849 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:25:52.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:52.849 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:25:52.939 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T10:25:53.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T10:25:53.098 INFO:teuthology.orchestra.run.smithi019.stdout:# file: . 2024-04-25T10:25:53.098 INFO:teuthology.orchestra.run.smithi019.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T10:25:53.098 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:53.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:25:53.109 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:53.109 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:25:53.160 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:25:53.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.435+0000 7f20a4e00640 1 Processor -- start 2024-04-25T10:25:53.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.435+0000 7f20a4e00640 1 -- start start 2024-04-25T10:25:53.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.437+0000 7f20a4e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f20a00b50e0 0x7f20a01567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:53.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.437+0000 7f20a4e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a015c5f0 con 0x7f20a00b4090 2024-04-25T10:25:53.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.438+0000 7f20a4e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a015c8d0 con 0x7f20a00ccdc0 2024-04-25T10:25:53.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.438+0000 7f20a4e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f20a00cd1d0 con 0x7f20a00b50e0 2024-04-25T10:25:53.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.438+0000 7f2097e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f20a00b50e0 0x7f20a01567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:53.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.438+0000 7f2097e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f20a00b50e0 0x7f20a01567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36036/0 (socket says 172.21.15.19:36036) 2024-04-25T10:25:53.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.438+0000 7f2097e00640 1 -- 172.21.15.19:0/3355253980 learned_addr learned my addr 172.21.15.19:0/3355253980 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:53.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.438+0000 7f2097e00640 1 -- 172.21.15.19:0/3355253980 >> v1:172.21.15.112:6789/0 conn(0x7f20a00ccdc0 legacy=0x7f20a00cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:53.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.438+0000 7f2097e00640 1 -- 172.21.15.19:0/3355253980 >> v1:172.21.15.19:6789/0 conn(0x7f20a00b4090 legacy=0x7f20a00b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:53.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.438+0000 7f209ea00640 1 -- 172.21.15.19:0/3355253980 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834689803 0 0) 0x7f20a015c8d0 con 0x7f20a00ccdc0 2024-04-25T10:25:53.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.439+0000 7f2097e00640 1 -- 172.21.15.19:0/3355253980 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a015cbb0 con 0x7f20a00b50e0 2024-04-25T10:25:53.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.440+0000 7f2097e00640 1 --2- 172.21.15.19:0/3355253980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a00b50e0 0x7f20a01567a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2088009870 tx=0x7f208802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f32adaf53beb89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:53.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.440+0000 7f209ea00640 1 -- 172.21.15.19:0/3355253980 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2088037070 con 0x7f20a00b50e0 2024-04-25T10:25:53.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.440+0000 7f209ea00640 1 -- 172.21.15.19:0/3355253980 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2088032440 con 0x7f20a00b50e0 2024-04-25T10:25:53.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.440+0000 7f209ea00640 1 -- 172.21.15.19:0/3355253980 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2088032810 con 0x7f20a00b50e0 2024-04-25T10:25:53.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.441+0000 7f20a4e00640 1 -- 172.21.15.19:0/3355253980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a00b50e0 msgr2=0x7f20a01567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:53.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.441+0000 7f20a4e00640 1 --2- 172.21.15.19:0/3355253980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a00b50e0 0x7f20a01567a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2088009870 tx=0x7f208802a200 comp rx=0 tx=0).stop 2024-04-25T10:25:53.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.441+0000 7f20a4e00640 1 -- 172.21.15.19:0/3355253980 shutdown_connections 2024-04-25T10:25:53.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.441+0000 7f20a4e00640 1 --2- 172.21.15.19:0/3355253980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a00b50e0 0x7f20a01567a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:53.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.441+0000 7f20a4e00640 1 -- 172.21.15.19:0/3355253980 >> 172.21.15.19:0/3355253980 conn(0x7f20a008d940 msgr2=0x7f20a008dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:53.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.441+0000 7f20a4e00640 1 -- 172.21.15.19:0/3355253980 shutdown_connections 2024-04-25T10:25:53.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.441+0000 7f20a4e00640 1 -- 172.21.15.19:0/3355253980 wait complete. 2024-04-25T10:25:53.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.443+0000 7f20a4e00640 1 Processor -- start 2024-04-25T10:25:53.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.444+0000 7f20a4e00640 1 -- start start 2024-04-25T10:25:53.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.445+0000 7f20a4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20a00b4090 0x7f20a01f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:53.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.445+0000 7f20a4e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a00b50e0 0x7f20a00c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:53.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.445+0000 7f20a4e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20a00ccdc0 0x7f20a00ce130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:53.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.445+0000 7f20a4e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f20a00b4cf0 con 0x7f20a00b50e0 2024-04-25T10:25:53.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.445+0000 7f20a4e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f20a015d170 con 0x7f20a00b4090 2024-04-25T10:25:53.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.445+0000 7f20a4e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f20a00b4e70 con 0x7f20a00ccdc0 2024-04-25T10:25:53.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.445+0000 7f209f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20a00b4090 0x7f20a01f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:53.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.445+0000 7f2097e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a00b50e0 0x7f20a00c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:53.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.446+0000 7f2097e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a00b50e0 0x7f20a00c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36042/0 (socket says 172.21.15.19:36042) 2024-04-25T10:25:53.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.446+0000 7f2097e00640 1 -- 172.21.15.19:0/3300260832 learned_addr learned my addr 172.21.15.19:0/3300260832 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:53.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.446+0000 7f209fe00640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20a00ccdc0 0x7f20a00ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:53.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.446+0000 7f2097e00640 1 -- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20a00ccdc0 msgr2=0x7f20a00ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.446+0000 7f2097e00640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20a00ccdc0 0x7f20a00ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.446+0000 7f2097e00640 1 -- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20a00b4090 msgr2=0x7f20a01f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.446+0000 7f2097e00640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20a00b4090 0x7f20a01f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.446+0000 7f2097e00640 1 -- 172.21.15.19:0/3300260832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a01f67c0 con 0x7f20a00b50e0 2024-04-25T10:25:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.446+0000 7f2097e00640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a00b50e0 0x7f20a00c6ef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20880090b0 tx=0x7f20880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.447+0000 7f2097400640 1 -- 172.21.15.19:0/3300260832 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2088041070 con 0x7f20a00b50e0 2024-04-25T10:25:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.447+0000 7f2097400640 1 -- 172.21.15.19:0/3300260832 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208803c950 con 0x7f20a00b50e0 2024-04-25T10:25:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.447+0000 7f2097400640 1 -- 172.21.15.19:0/3300260832 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2088037040 con 0x7f20a00b50e0 2024-04-25T10:25:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.447+0000 7f20a4e00640 1 -- 172.21.15.19:0/3300260832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a00c6410 con 0x7f20a00b50e0 2024-04-25T10:25:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.447+0000 7f20a4e00640 1 -- 172.21.15.19:0/3300260832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a00c8100 con 0x7f20a00b50e0 2024-04-25T10:25:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.448+0000 7f20a4e00640 1 -- 172.21.15.19:0/3300260832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a0050740 con 0x7f20a00b50e0 2024-04-25T10:25:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.449+0000 7f2097400640 1 -- 172.21.15.19:0/3300260832 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2088044070 con 0x7f20a00b50e0 2024-04-25T10:25:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.450+0000 7f2097400640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f207c0744e0 0x7f207c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.451+0000 7f2097400640 1 -- 172.21.15.19:0/3300260832 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f20880b5ff0 con 0x7f20a00b50e0 2024-04-25T10:25:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.451+0000 7f209f400640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f207c0744e0 0x7f207c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.452+0000 7f209f400640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f207c0744e0 0x7f207c0769f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f20900018c0 tx=0x7f2090009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:53.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.456+0000 7f2097400640 1 -- 172.21.15.19:0/3300260832 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f208807fe40 con 0x7f20a00b50e0 2024-04-25T10:25:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.668+0000 7f20a4e00640 1 -- 172.21.15.19:0/3300260832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20a00b68e0 con 0x7f20a00b50e0 2024-04-25T10:25:53.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.670+0000 7f2097400640 1 -- 172.21.15.19:0/3300260832 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18518 (secure 0 0 0) 0x7f2088084140 con 0x7f20a00b50e0 2024-04-25T10:25:53.673 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:53.674 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:41.790347+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:25:53.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.673+0000 7f20a4e00640 1 -- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f207c0744e0 msgr2=0x7f207c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.673+0000 7f20a4e00640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f207c0744e0 0x7f207c0769f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f20900018c0 tx=0x7f2090009040 comp rx=0 tx=0).stop 2024-04-25T10:25:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.673+0000 7f20a4e00640 1 -- 172.21.15.19:0/3300260832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a00b50e0 msgr2=0x7f20a00c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.673+0000 7f20a4e00640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a00b50e0 0x7f20a00c6ef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20880090b0 tx=0x7f20880046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.673+0000 7f20a4e00640 1 -- 172.21.15.19:0/3300260832 shutdown_connections 2024-04-25T10:25:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.673+0000 7f20a4e00640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f207c0744e0 0x7f207c0769f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.674+0000 7f20a4e00640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f20a00ccdc0 0x7f20a00ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.674+0000 7f20a4e00640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a00b50e0 0x7f20a00c6ef0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.674+0000 7f20a4e00640 1 --2- 172.21.15.19:0/3300260832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20a00b4090 0x7f20a01f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.674+0000 7f20a4e00640 1 -- 172.21.15.19:0/3300260832 >> 172.21.15.19:0/3300260832 conn(0x7f20a008d940 msgr2=0x7f20a0155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.674+0000 7f20a4e00640 1 -- 172.21.15.19:0/3300260832 shutdown_connections 2024-04-25T10:25:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.674+0000 7f20a4e00640 1 -- 172.21.15.19:0/3300260832 wait complete. 2024-04-25T10:25:53.704 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:25:24.611615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:25:34.760347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:25:35.692430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:25:39.212157+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:25:53.705 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:25:54.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.997+0000 7fb98e200640 1 Processor -- start 2024-04-25T10:25:54.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:53.998+0000 7fb98e200640 1 -- start start 2024-04-25T10:25:54.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.000+0000 7fb98e200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb9880b36d0 0x7fb9880cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.000+0000 7fb98e200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9880cbd60 0x7fb988166f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.000+0000 7fb98e200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9880c4870 con 0x7fb988156c00 2024-04-25T10:25:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.001+0000 7fb98e200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb98806ff70 con 0x7fb9880b36d0 2024-04-25T10:25:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.001+0000 7fb98e200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb98815d140 con 0x7fb9880cbd60 2024-04-25T10:25:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.001+0000 7fb987e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9880cbd60 0x7fb988166f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.001+0000 7fb97ea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb9880b36d0 0x7fb9880cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.001+0000 7fb987400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb988156c00 0x7fb9880706e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:33856/0 (socket says 172.21.15.19:33856) 2024-04-25T10:25:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.001+0000 7fb987400640 1 -- 172.21.15.19:0/2070018797 learned_addr learned my addr 172.21.15.19:0/2070018797 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.001+0000 7fb97ea00640 1 -- 172.21.15.19:0/2070018797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9880cbd60 msgr2=0x7fb988166f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.001+0000 7fb97ea00640 1 --2- 172.21.15.19:0/2070018797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9880cbd60 0x7fb988166f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.001+0000 7fb97ea00640 1 -- 172.21.15.19:0/2070018797 >> v1:172.21.15.112:6789/0 conn(0x7fb988156c00 legacy=0x7fb9880706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.001+0000 7fb97ea00640 1 -- 172.21.15.19:0/2070018797 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98815d400 con 0x7fb9880b36d0 2024-04-25T10:25:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.001+0000 7fb986a00640 1 -- 172.21.15.19:0/2070018797 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369452729 0 0) 0x7fb9880c4870 con 0x7fb988156c00 2024-04-25T10:25:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.002+0000 7fb97ea00640 1 --2- 172.21.15.19:0/2070018797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9880b36d0 0x7fb9880cb820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9700097a0 tx=0x7fb97002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82ba72e432b2338b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.003+0000 7fb986a00640 1 -- 172.21.15.19:0/2070018797 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970037070 con 0x7fb9880b36d0 2024-04-25T10:25:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.003+0000 7fb986a00640 1 -- 172.21.15.19:0/2070018797 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb970032440 con 0x7fb9880b36d0 2024-04-25T10:25:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.003+0000 7fb986a00640 1 -- 172.21.15.19:0/2070018797 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970032810 con 0x7fb9880b36d0 2024-04-25T10:25:54.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.003+0000 7fb98e200640 1 -- 172.21.15.19:0/2070018797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9880b36d0 msgr2=0x7fb9880cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.003+0000 7fb98e200640 1 --2- 172.21.15.19:0/2070018797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9880b36d0 0x7fb9880cb820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9700097a0 tx=0x7fb97002a210 comp rx=0 tx=0).stop 2024-04-25T10:25:54.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.003+0000 7fb98e200640 1 -- 172.21.15.19:0/2070018797 shutdown_connections 2024-04-25T10:25:54.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.003+0000 7fb98e200640 1 --2- 172.21.15.19:0/2070018797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9880cbd60 0x7fb988166f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.003+0000 7fb98e200640 1 --2- 172.21.15.19:0/2070018797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9880b36d0 0x7fb9880cb820 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.003+0000 7fb98e200640 1 -- 172.21.15.19:0/2070018797 >> 172.21.15.19:0/2070018797 conn(0x7fb988072200 msgr2=0x7fb988072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.004+0000 7fb98e200640 1 -- 172.21.15.19:0/2070018797 shutdown_connections 2024-04-25T10:25:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.004+0000 7fb98e200640 1 -- 172.21.15.19:0/2070018797 wait complete. 2024-04-25T10:25:54.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.006+0000 7fb98e200640 1 Processor -- start 2024-04-25T10:25:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.006+0000 7fb98e200640 1 -- start start 2024-04-25T10:25:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.008+0000 7fb98e200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9880b36d0 0x7fb9881f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.008+0000 7fb98e200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9880cbd60 0x7fb98814d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.008+0000 7fb98e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb988156c00 0x7fb98814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.008+0000 7fb98e200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb9880701c0 con 0x7fb9880cbd60 2024-04-25T10:25:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.008+0000 7fb98e200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb9880c9dc0 con 0x7fb988156c00 2024-04-25T10:25:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.008+0000 7fb98e200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb98806c650 con 0x7fb9880b36d0 2024-04-25T10:25:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.008+0000 7fb97ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9880cbd60 0x7fb98814d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.008+0000 7fb97ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9880cbd60 0x7fb98814d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36056/0 (socket says 172.21.15.19:36056) 2024-04-25T10:25:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.008+0000 7fb97ea00640 1 -- 172.21.15.19:0/1075689290 learned_addr learned my addr 172.21.15.19:0/1075689290 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.008+0000 7fb987e00640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb988156c00 0x7fb98814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.008+0000 7fb987400640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9880b36d0 0x7fb9881f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.009+0000 7fb97ea00640 1 -- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9880b36d0 msgr2=0x7fb9881f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.009+0000 7fb97ea00640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9880b36d0 0x7fb9881f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.009+0000 7fb97ea00640 1 -- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb988156c00 msgr2=0x7fb98814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.009+0000 7fb97ea00640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb988156c00 0x7fb98814de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.009+0000 7fb97ea00640 1 -- 172.21.15.19:0/1075689290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9881f64e0 con 0x7fb9880cbd60 2024-04-25T10:25:54.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.009+0000 7fb987e00640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb988156c00 0x7fb98814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:54.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.009+0000 7fb987400640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9880b36d0 0x7fb9881f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:54.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.009+0000 7fb97ea00640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9880cbd60 0x7fb98814d900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9700098c0 tx=0x7fb9700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:54.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.009+0000 7fb97fe00640 1 -- 172.21.15.19:0/1075689290 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970037040 con 0x7fb9880cbd60 2024-04-25T10:25:54.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.009+0000 7fb97fe00640 1 -- 172.21.15.19:0/1075689290 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb970042070 con 0x7fb9880cbd60 2024-04-25T10:25:54.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.009+0000 7fb98e200640 1 -- 172.21.15.19:0/1075689290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb988159720 con 0x7fb9880cbd60 2024-04-25T10:25:54.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.010+0000 7fb97fe00640 1 -- 172.21.15.19:0/1075689290 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970030940 con 0x7fb9880cbd60 2024-04-25T10:25:54.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.010+0000 7fb98e200640 1 -- 172.21.15.19:0/1075689290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb988159ce0 con 0x7fb9880cbd60 2024-04-25T10:25:54.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.011+0000 7fb98e200640 1 -- 172.21.15.19:0/1075689290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb988076520 con 0x7fb9880cbd60 2024-04-25T10:25:54.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.012+0000 7fb97fe00640 1 -- 172.21.15.19:0/1075689290 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb970030ae0 con 0x7fb9880cbd60 2024-04-25T10:25:54.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.013+0000 7fb97fe00640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9640744e0 0x7fb9640769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.013+0000 7fb97fe00640 1 -- 172.21.15.19:0/1075689290 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb9700b5ce0 con 0x7fb9880cbd60 2024-04-25T10:25:54.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.014+0000 7fb987400640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9640744e0 0x7fb9640769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.014+0000 7fb987400640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9640744e0 0x7fb9640769f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb978000f60 tx=0x7fb978009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:54.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.018+0000 7fb97fe00640 1 -- 172.21.15.19:0/1075689290 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb97004c020 con 0x7fb9880cbd60 2024-04-25T10:25:54.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.220+0000 7fb98e200640 1 -- 172.21.15.19:0/1075689290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb9880ca510 con 0x7fb9880cbd60 2024-04-25T10:25:54.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.221+0000 7fb97fe00640 1 -- 172.21.15.19:0/1075689290 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fb970088110 con 0x7fb9880cbd60 2024-04-25T10:25:54.224 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-04-25T10:25:54.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.224+0000 7fb98e200640 1 -- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9640744e0 msgr2=0x7fb9640769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.224+0000 7fb98e200640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9640744e0 0x7fb9640769f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb978000f60 tx=0x7fb978009040 comp rx=0 tx=0).stop 2024-04-25T10:25:54.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.224+0000 7fb98e200640 1 -- 172.21.15.19:0/1075689290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9880cbd60 msgr2=0x7fb98814d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.224+0000 7fb98e200640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9880cbd60 0x7fb98814d900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9700098c0 tx=0x7fb9700046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.224+0000 7fb98e200640 1 -- 172.21.15.19:0/1075689290 shutdown_connections 2024-04-25T10:25:54.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.224+0000 7fb98e200640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb988156c00 0x7fb98814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.224+0000 7fb98e200640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9880cbd60 0x7fb98814d900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.224+0000 7fb98e200640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9640744e0 0x7fb9640769f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.224+0000 7fb98e200640 1 --2- 172.21.15.19:0/1075689290 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9880b36d0 0x7fb9881f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.224+0000 7fb98e200640 1 -- 172.21.15.19:0/1075689290 >> 172.21.15.19:0/1075689290 conn(0x7fb988072200 msgr2=0x7fb98806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:54.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.225+0000 7fb98e200640 1 -- 172.21.15.19:0/1075689290 shutdown_connections 2024-04-25T10:25:54.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.225+0000 7fb98e200640 1 -- 172.21.15.19:0/1075689290 wait complete. 2024-04-25T10:25:54.255 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:25:54.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.543+0000 7ff40fa00640 1 Processor -- start 2024-04-25T10:25:54.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.543+0000 7ff40fa00640 1 -- start start 2024-04-25T10:25:54.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.546+0000 7ff40fa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff40815ccd0 0x7ff4080cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.546+0000 7ff40fa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff4080ce360 0x7ff4080ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.546+0000 7ff40fa00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4080cd340 con 0x7ff4080c7c50 2024-04-25T10:25:54.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.546+0000 7ff40fa00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff4080b49e0 con 0x7ff40815ccd0 2024-04-25T10:25:54.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.546+0000 7ff40fa00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff4080cd5e0 con 0x7ff4080ce360 2024-04-25T10:25:54.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.546+0000 7ff407e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff40815ccd0 0x7ff4080cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.546+0000 7ff407e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff40815ccd0 0x7ff4080cc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36062/0 (socket says 172.21.15.19:36062) 2024-04-25T10:25:54.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.546+0000 7ff407e00640 1 -- 172.21.15.19:0/4178960162 learned_addr learned my addr 172.21.15.19:0/4178960162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:54.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.546+0000 7ff40da00640 1 --2- 172.21.15.19:0/4178960162 >> v2:172.21.15.112:3300/0 conn(0x7ff4080ce360 0x7ff4080ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.547+0000 7ff407400640 1 -- 172.21.15.19:0/4178960162 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614238534 0 0) 0x7ff4080cd340 con 0x7ff4080c7c50 2024-04-25T10:25:54.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.547+0000 7ff407e00640 1 -- 172.21.15.19:0/4178960162 >> v2:172.21.15.112:3300/0 conn(0x7ff4080ce360 msgr2=0x7ff4080ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:54.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.547+0000 7ff407e00640 1 --2- 172.21.15.19:0/4178960162 >> v2:172.21.15.112:3300/0 conn(0x7ff4080ce360 0x7ff4080ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.547+0000 7ff407e00640 1 -- 172.21.15.19:0/4178960162 >> v1:172.21.15.112:6789/0 conn(0x7ff4080c7c50 legacy=0x7ff40815c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.547+0000 7ff407e00640 1 -- 172.21.15.19:0/4178960162 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4080cd8c0 con 0x7ff40815ccd0 2024-04-25T10:25:54.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.548+0000 7ff407e00640 1 --2- 172.21.15.19:0/4178960162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40815ccd0 0x7ff4080cc540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff40815d110 tx=0x7ff3f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73c9a9b5aa5c121 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:54.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.548+0000 7ff407400640 1 -- 172.21.15.19:0/4178960162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4037070 con 0x7ff40815ccd0 2024-04-25T10:25:54.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.548+0000 7ff407400640 1 -- 172.21.15.19:0/4178960162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f4032440 con 0x7ff40815ccd0 2024-04-25T10:25:54.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.548+0000 7ff407400640 1 -- 172.21.15.19:0/4178960162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4032810 con 0x7ff40815ccd0 2024-04-25T10:25:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.549+0000 7ff40fa00640 1 -- 172.21.15.19:0/4178960162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40815ccd0 msgr2=0x7ff4080cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.549+0000 7ff40fa00640 1 --2- 172.21.15.19:0/4178960162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40815ccd0 0x7ff4080cc540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff40815d110 tx=0x7ff3f402a270 comp rx=0 tx=0).stop 2024-04-25T10:25:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.549+0000 7ff40fa00640 1 -- 172.21.15.19:0/4178960162 shutdown_connections 2024-04-25T10:25:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.549+0000 7ff40fa00640 1 --2- 172.21.15.19:0/4178960162 >> v2:172.21.15.112:3300/0 conn(0x7ff4080ce360 0x7ff4080ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.549+0000 7ff40fa00640 1 --2- 172.21.15.19:0/4178960162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40815ccd0 0x7ff4080cc540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.549+0000 7ff40fa00640 1 -- 172.21.15.19:0/4178960162 >> 172.21.15.19:0/4178960162 conn(0x7ff40806f2c0 msgr2=0x7ff408068460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:54.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.549+0000 7ff40fa00640 1 -- 172.21.15.19:0/4178960162 shutdown_connections 2024-04-25T10:25:54.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.549+0000 7ff40fa00640 1 -- 172.21.15.19:0/4178960162 wait complete. 2024-04-25T10:25:54.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.552+0000 7ff40fa00640 1 Processor -- start 2024-04-25T10:25:54.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.552+0000 7ff40fa00640 1 -- start start 2024-04-25T10:25:54.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.553+0000 7ff40fa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4080c7c50 0x7ff4081e8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.553+0000 7ff40fa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4080ce360 0x7ff4081f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.553+0000 7ff40fa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40815ccd0 0x7ff40808d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.553+0000 7ff40fa00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff4080ccbf0 con 0x7ff40815ccd0 2024-04-25T10:25:54.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.553+0000 7ff40fa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4080cde80 con 0x7ff4080c7c50 2024-04-25T10:25:54.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.553+0000 7ff40fa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff4081531c0 con 0x7ff4080ce360 2024-04-25T10:25:54.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.553+0000 7ff40da00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40815ccd0 0x7ff40808d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.554+0000 7ff40da00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40815ccd0 0x7ff40808d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36068/0 (socket says 172.21.15.19:36068) 2024-04-25T10:25:54.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.554+0000 7ff40da00640 1 -- 172.21.15.19:0/2918389479 learned_addr learned my addr 172.21.15.19:0/2918389479 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:54.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.554+0000 7ff407e00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4080ce360 0x7ff4081f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.554+0000 7ff40d000640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4080c7c50 0x7ff4081e8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.554+0000 7ff40da00640 1 -- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4080ce360 msgr2=0x7ff4081f29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.554+0000 7ff40da00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4080ce360 0x7ff4081f29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.554+0000 7ff40da00640 1 -- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4080c7c50 msgr2=0x7ff4081e8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.554+0000 7ff40da00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4080c7c50 0x7ff4081e8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.554+0000 7ff40da00640 1 -- 172.21.15.19:0/2918389479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4081f2f20 con 0x7ff40815ccd0 2024-04-25T10:25:54.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.554+0000 7ff40d000640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4080c7c50 0x7ff4081e8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:54.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.554+0000 7ff407e00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4080ce360 0x7ff4081f29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:54.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.555+0000 7ff40da00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40815ccd0 0x7ff40808d940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff40000efc0 tx=0x7ff40000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:54.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.555+0000 7ff404c00640 1 -- 172.21.15.19:0/2918389479 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400018020 con 0x7ff40815ccd0 2024-04-25T10:25:54.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.555+0000 7ff404c00640 1 -- 172.21.15.19:0/2918389479 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff400014480 con 0x7ff40815ccd0 2024-04-25T10:25:54.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.555+0000 7ff404c00640 1 -- 172.21.15.19:0/2918389479 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400009e60 con 0x7ff40815ccd0 2024-04-25T10:25:54.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.555+0000 7ff40fa00640 1 -- 172.21.15.19:0/2918389479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4081f5f40 con 0x7ff40815ccd0 2024-04-25T10:25:54.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.555+0000 7ff40fa00640 1 -- 172.21.15.19:0/2918389479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4081f6500 con 0x7ff40815ccd0 2024-04-25T10:25:54.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.556+0000 7ff40fa00640 1 -- 172.21.15.19:0/2918389479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff408076520 con 0x7ff40815ccd0 2024-04-25T10:25:54.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.558+0000 7ff404c00640 1 -- 172.21.15.19:0/2918389479 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff400005d10 con 0x7ff40815ccd0 2024-04-25T10:25:54.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.559+0000 7ff404c00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff3e80744e0 0x7ff3e80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:54.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.560+0000 7ff404c00640 1 -- 172.21.15.19:0/2918389479 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff400096100 con 0x7ff40815ccd0 2024-04-25T10:25:54.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.560+0000 7ff40d000640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff3e80744e0 0x7ff3e80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:54.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.561+0000 7ff40d000640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff3e80744e0 0x7ff3e80769f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc000f60 tx=0x7ff3fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:54.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.565+0000 7ff404c00640 1 -- 172.21.15.19:0/2918389479 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff400022030 con 0x7ff40815ccd0 2024-04-25T10:25:54.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.771+0000 7ff40fa00640 1 -- 172.21.15.19:0/2918389479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff4081f5cd0 con 0x7ff40815ccd0 2024-04-25T10:25:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.772+0000 7ff404c00640 1 -- 172.21.15.19:0/2918389479 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7ff400010040 con 0x7ff40815ccd0 2024-04-25T10:25:54.775 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:25:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 -- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff3e80744e0 msgr2=0x7ff3e80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff3e80744e0 0x7ff3e80769f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc000f60 tx=0x7ff3fc009040 comp rx=0 tx=0).stop 2024-04-25T10:25:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 -- 172.21.15.19:0/2918389479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40815ccd0 msgr2=0x7ff40808d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40815ccd0 0x7ff40808d940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff40000efc0 tx=0x7ff40000c490 comp rx=0 tx=0).stop 2024-04-25T10:25:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 -- 172.21.15.19:0/2918389479 shutdown_connections 2024-04-25T10:25:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff40815ccd0 0x7ff40808d940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff3e80744e0 0x7ff3e80769f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4080ce360 0x7ff4081f29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 --2- 172.21.15.19:0/2918389479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4080c7c50 0x7ff4081e8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 -- 172.21.15.19:0/2918389479 >> 172.21.15.19:0/2918389479 conn(0x7ff40806f2c0 msgr2=0x7ff40815b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 -- 172.21.15.19:0/2918389479 shutdown_connections 2024-04-25T10:25:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:54.775+0000 7ff40fa00640 1 -- 172.21.15.19:0/2918389479 wait complete. 2024-04-25T10:25:54.806 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:25:55.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.092+0000 7f1933e00640 1 Processor -- start 2024-04-25T10:25:55.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.092+0000 7f1933e00640 1 -- start start 2024-04-25T10:25:55.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.094+0000 7f1933e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340cdb00 0x7f19341563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.094+0000 7f1933e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f193415ff50 0x7f1934160360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.094+0000 7f1933e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f193415c750 con 0x7f19340c6760 2024-04-25T10:25:55.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.094+0000 7f1933e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f193415fac0 con 0x7f193415ff50 2024-04-25T10:25:55.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.094+0000 7f1933e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f19340b59d0 con 0x7f19340cdb00 2024-04-25T10:25:55.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.095+0000 7f1933400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f193415ff50 0x7f1934160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.095+0000 7f192be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340cdb00 0x7f19341563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.095+0000 7f1933400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f193415ff50 0x7f1934160360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36080/0 (socket says 172.21.15.19:36080) 2024-04-25T10:25:55.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.095+0000 7f1933400640 1 -- 172.21.15.19:0/2568536763 learned_addr learned my addr 172.21.15.19:0/2568536763 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:55.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.095+0000 7f1932a00640 1 --1- 172.21.15.19:0/2568536763 >> v1:172.21.15.19:6789/0 conn(0x7f19340c6760 0x7f19340ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41502/0 (socket says 172.21.15.19:41502) 2024-04-25T10:25:55.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.095+0000 7f192be00640 1 -- 172.21.15.19:0/2568536763 >> v2:172.21.15.19:3300/0 conn(0x7f193415ff50 msgr2=0x7f1934160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:55.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.095+0000 7f192be00640 1 --2- 172.21.15.19:0/2568536763 >> v2:172.21.15.19:3300/0 conn(0x7f193415ff50 0x7f1934160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.095+0000 7f192be00640 1 -- 172.21.15.19:0/2568536763 >> v1:172.21.15.19:6789/0 conn(0x7f19340c6760 legacy=0x7f19340ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.095+0000 7f192be00640 1 -- 172.21.15.19:0/2568536763 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193415ca30 con 0x7f19340cdb00 2024-04-25T10:25:55.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.096+0000 7f192be00640 1 --2- 172.21.15.19:0/2568536763 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340cdb00 0x7f19341563b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f191c0097a0 tx=0x7f191c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dca335204b606fb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:55.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.097+0000 7f1932000640 1 -- 172.21.15.19:0/2568536763 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c037070 con 0x7f19340cdb00 2024-04-25T10:25:55.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.097+0000 7f1932000640 1 -- 172.21.15.19:0/2568536763 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c032440 con 0x7f19340cdb00 2024-04-25T10:25:55.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.097+0000 7f1932000640 1 -- 172.21.15.19:0/2568536763 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c032810 con 0x7f19340cdb00 2024-04-25T10:25:55.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.097+0000 7f1933e00640 1 -- 172.21.15.19:0/2568536763 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340cdb00 msgr2=0x7f19341563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.097+0000 7f1933e00640 1 --2- 172.21.15.19:0/2568536763 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340cdb00 0x7f19341563b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f191c0097a0 tx=0x7f191c02a210 comp rx=0 tx=0).stop 2024-04-25T10:25:55.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.097+0000 7f1933e00640 1 -- 172.21.15.19:0/2568536763 shutdown_connections 2024-04-25T10:25:55.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.098+0000 7f1933e00640 1 --2- 172.21.15.19:0/2568536763 >> v2:172.21.15.19:3300/0 conn(0x7f193415ff50 0x7f1934160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.098+0000 7f1933e00640 1 --2- 172.21.15.19:0/2568536763 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340cdb00 0x7f19341563b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.098+0000 7f1933e00640 1 -- 172.21.15.19:0/2568536763 >> 172.21.15.19:0/2568536763 conn(0x7f193408db80 msgr2=0x7f193408df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:55.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.098+0000 7f1933e00640 1 -- 172.21.15.19:0/2568536763 shutdown_connections 2024-04-25T10:25:55.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.098+0000 7f1933e00640 1 -- 172.21.15.19:0/2568536763 wait complete. 2024-04-25T10:25:55.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.100+0000 7f1933e00640 1 Processor -- start 2024-04-25T10:25:55.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.100+0000 7f1933e00640 1 -- start start 2024-04-25T10:25:55.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f1933e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19340cdb00 0x7f1934156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f1933e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f193415ff50 0x7f19341520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f1933e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340c9b20 0x7f1934154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f1933e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f193415d2d0 con 0x7f193415ff50 2024-04-25T10:25:55.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f1933e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f193415cff0 con 0x7f19340cdb00 2024-04-25T10:25:55.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f1933e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f19341608a0 con 0x7f19340c9b20 2024-04-25T10:25:55.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f1932a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19340cdb00 0x7f1934156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f1933400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340c9b20 0x7f1934154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f192be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f193415ff50 0x7f19341520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f1933400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340c9b20 0x7f1934154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:51174/0 (socket says 172.21.15.19:51174) 2024-04-25T10:25:55.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f1932a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19340cdb00 0x7f1934156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:54292/0 (socket says 172.21.15.19:54292) 2024-04-25T10:25:55.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.102+0000 7f1933400640 1 -- 172.21.15.19:0/139037030 learned_addr learned my addr 172.21.15.19:0/139037030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:55.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.103+0000 7f192be00640 1 -- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340c9b20 msgr2=0x7f1934154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.103+0000 7f192be00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340c9b20 0x7f1934154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.103+0000 7f192be00640 1 -- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19340cdb00 msgr2=0x7f1934156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.103+0000 7f192be00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19340cdb00 0x7f1934156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.103+0000 7f192be00640 1 -- 172.21.15.19:0/139037030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19341574f0 con 0x7f193415ff50 2024-04-25T10:25:55.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.103+0000 7f192be00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f193415ff50 0x7f19341520e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f191c031000 tx=0x7f191c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:55.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.103+0000 7f192aa00640 1 -- 172.21.15.19:0/139037030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c041030 con 0x7f193415ff50 2024-04-25T10:25:55.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.103+0000 7f192aa00640 1 -- 172.21.15.19:0/139037030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c030500 con 0x7f193415ff50 2024-04-25T10:25:55.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.103+0000 7f192aa00640 1 -- 172.21.15.19:0/139037030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c037040 con 0x7f193415ff50 2024-04-25T10:25:55.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.103+0000 7f1933e00640 1 -- 172.21.15.19:0/139037030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19341f2250 con 0x7f193415ff50 2024-04-25T10:25:55.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.104+0000 7f1933e00640 1 -- 172.21.15.19:0/139037030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19341f27f0 con 0x7f193415ff50 2024-04-25T10:25:55.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.105+0000 7f1933e00640 1 -- 172.21.15.19:0/139037030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1934156db0 con 0x7f193415ff50 2024-04-25T10:25:55.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.106+0000 7f192aa00640 1 -- 172.21.15.19:0/139037030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f191c044070 con 0x7f193415ff50 2024-04-25T10:25:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.107+0000 7f192aa00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f19100744b0 0x7f19100769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.107+0000 7f192aa00640 1 -- 172.21.15.19:0/139037030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f191c0b5680 con 0x7f193415ff50 2024-04-25T10:25:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.108+0000 7f1932a00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f19100744b0 0x7f19100769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.108+0000 7f1932a00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f19100744b0 0x7f19100769c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1924007fd0 tx=0x7f1924007e80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:55.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.112+0000 7f192aa00640 1 -- 172.21.15.19:0/139037030 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1934156db0 con 0x7f193415ff50 2024-04-25T10:25:55.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.319+0000 7f1933e00640 1 -- 172.21.15.19:0/139037030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f19341f3190 con 0x7f193415ff50 2024-04-25T10:25:55.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.320+0000 7f192aa00640 1 -- 172.21.15.19:0/139037030 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f191c07f480 con 0x7f193415ff50 2024-04-25T10:25:55.323 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-04-25T10:25:55.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 -- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f19100744b0 msgr2=0x7f19100769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f19100744b0 0x7f19100769c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1924007fd0 tx=0x7f1924007e80 comp rx=0 tx=0).stop 2024-04-25T10:25:55.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 -- 172.21.15.19:0/139037030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f193415ff50 msgr2=0x7f19341520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f193415ff50 0x7f19341520e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f191c031000 tx=0x7f191c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 -- 172.21.15.19:0/139037030 shutdown_connections 2024-04-25T10:25:55.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f19100744b0 0x7f19100769c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19340c9b20 0x7f1934154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f193415ff50 0x7f19341520e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 --2- 172.21.15.19:0/139037030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19340cdb00 0x7f1934156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 -- 172.21.15.19:0/139037030 >> 172.21.15.19:0/139037030 conn(0x7f193408db80 msgr2=0x7f19340b6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:55.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 -- 172.21.15.19:0/139037030 shutdown_connections 2024-04-25T10:25:55.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.323+0000 7f1933e00640 1 -- 172.21.15.19:0/139037030 wait complete. 2024-04-25T10:25:55.352 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:25:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.636+0000 7fc251600640 1 Processor -- start 2024-04-25T10:25:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.636+0000 7fc251600640 1 -- start start 2024-04-25T10:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.639+0000 7fc251600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c153450 0x7fc24c1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.639+0000 7fc251600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc24c1595f0 0x7fc24c074120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.639+0000 7fc251600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c0c9730 con 0x7fc24c0c74c0 2024-04-25T10:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.639+0000 7fc251600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc24c0c2d50 con 0x7fc24c1595f0 2024-04-25T10:25:55.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.639+0000 7fc251600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc24c0703c0 con 0x7fc24c153450 2024-04-25T10:25:55.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.639+0000 7fc250c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc24c1595f0 0x7fc24c074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.639+0000 7fc24b400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c153450 0x7fc24c1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.639+0000 7fc24b400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c153450 0x7fc24c1590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:51180/0 (socket says 172.21.15.19:51180) 2024-04-25T10:25:55.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.639+0000 7fc250c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc24c1595f0 0x7fc24c074120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:54296/0 (socket says 172.21.15.19:54296) 2024-04-25T10:25:55.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.639+0000 7fc24b400640 1 -- 172.21.15.19:0/1043901312 learned_addr learned my addr 172.21.15.19:0/1043901312 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:55.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.640+0000 7fc250c00640 1 -- 172.21.15.19:0/1043901312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c153450 msgr2=0x7fc24c1590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:55.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.640+0000 7fc250c00640 1 --2- 172.21.15.19:0/1043901312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c153450 0x7fc24c1590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.640+0000 7fc250c00640 1 -- 172.21.15.19:0/1043901312 >> v1:172.21.15.112:6789/0 conn(0x7fc24c0c74c0 legacy=0x7fc24c0c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.640+0000 7fc250c00640 1 -- 172.21.15.19:0/1043901312 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c153860 con 0x7fc24c1595f0 2024-04-25T10:25:55.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.640+0000 7fc24aa00640 1 -- 172.21.15.19:0/1043901312 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3176259438 0 0) 0x7fc24c0c9730 con 0x7fc24c0c74c0 2024-04-25T10:25:55.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.641+0000 7fc250c00640 1 --2- 172.21.15.19:0/1043901312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c1595f0 0x7fc24c074120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc244009d90 tx=0x7fc24402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=228724d122e83e21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:55.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.641+0000 7fc24aa00640 1 -- 172.21.15.19:0/1043901312 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244007740 con 0x7fc24c1595f0 2024-04-25T10:25:55.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.641+0000 7fc24aa00640 1 -- 172.21.15.19:0/1043901312 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2440078e0 con 0x7fc24c1595f0 2024-04-25T10:25:55.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.641+0000 7fc24aa00640 1 -- 172.21.15.19:0/1043901312 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244007cb0 con 0x7fc24c1595f0 2024-04-25T10:25:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.642+0000 7fc251600640 1 -- 172.21.15.19:0/1043901312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c1595f0 msgr2=0x7fc24c074120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.642+0000 7fc251600640 1 --2- 172.21.15.19:0/1043901312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c1595f0 0x7fc24c074120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc244009d90 tx=0x7fc24402a660 comp rx=0 tx=0).stop 2024-04-25T10:25:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.642+0000 7fc251600640 1 -- 172.21.15.19:0/1043901312 shutdown_connections 2024-04-25T10:25:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.642+0000 7fc251600640 1 --2- 172.21.15.19:0/1043901312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c1595f0 0x7fc24c074120 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.642+0000 7fc251600640 1 --2- 172.21.15.19:0/1043901312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c153450 0x7fc24c1590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.642+0000 7fc251600640 1 -- 172.21.15.19:0/1043901312 >> 172.21.15.19:0/1043901312 conn(0x7fc24c0ca120 msgr2=0x7fc24c0ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.642+0000 7fc251600640 1 -- 172.21.15.19:0/1043901312 shutdown_connections 2024-04-25T10:25:55.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.642+0000 7fc251600640 1 -- 172.21.15.19:0/1043901312 wait complete. 2024-04-25T10:25:55.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.646+0000 7fc251600640 1 Processor -- start 2024-04-25T10:25:55.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.646+0000 7fc251600640 1 -- start start 2024-04-25T10:25:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.648+0000 7fc251600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c0c74c0 0x7fc24c14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.648+0000 7fc251600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc24c153450 0x7fc24c1f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.648+0000 7fc251600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c1595f0 0x7fc24c0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.648+0000 7fc251600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c0c9cb0 con 0x7fc24c153450 2024-04-25T10:25:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.648+0000 7fc251600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c0c99d0 con 0x7fc24c1595f0 2024-04-25T10:25:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.648+0000 7fc251600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc24c0c32a0 con 0x7fc24c0c74c0 2024-04-25T10:25:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.648+0000 7fc24be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c0c74c0 0x7fc24c14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.648+0000 7fc24b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc24c153450 0x7fc24c1f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.648+0000 7fc24be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c0c74c0 0x7fc24c14f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:51186/0 (socket says 172.21.15.19:51186) 2024-04-25T10:25:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.648+0000 7fc24be00640 1 -- 172.21.15.19:0/796090909 learned_addr learned my addr 172.21.15.19:0/796090909 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.648+0000 7fc250c00640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c1595f0 0x7fc24c0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.649+0000 7fc24be00640 1 -- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c1595f0 msgr2=0x7fc24c0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.649+0000 7fc24be00640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c1595f0 0x7fc24c0cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.649+0000 7fc24be00640 1 -- 172.21.15.19:0/796090909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc24c153450 msgr2=0x7fc24c1f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.649+0000 7fc24be00640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc24c153450 0x7fc24c1f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.649+0000 7fc24be00640 1 -- 172.21.15.19:0/796090909 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c1e4600 con 0x7fc24c0c74c0 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.649+0000 7fc250c00640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c1595f0 0x7fc24c0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.649+0000 7fc24be00640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c0c74c0 0x7fc24c14f4a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00c3c0 tx=0x7fc23c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.649+0000 7fc243e00640 1 -- 172.21.15.19:0/796090909 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c017070 con 0x7fc24c0c74c0 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.649+0000 7fc243e00640 1 -- 172.21.15.19:0/796090909 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23c0052d0 con 0x7fc24c0c74c0 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.649+0000 7fc251600640 1 -- 172.21.15.19:0/796090909 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24c1e48e0 con 0x7fc24c0c74c0 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.650+0000 7fc243e00640 1 -- 172.21.15.19:0/796090909 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c003850 con 0x7fc24c0c74c0 2024-04-25T10:25:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.650+0000 7fc251600640 1 -- 172.21.15.19:0/796090909 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24c1f2a20 con 0x7fc24c0c74c0 2024-04-25T10:25:55.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.651+0000 7fc251600640 1 -- 172.21.15.19:0/796090909 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc24c06a240 con 0x7fc24c0c74c0 2024-04-25T10:25:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.652+0000 7fc243e00640 1 -- 172.21.15.19:0/796090909 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc23c01a070 con 0x7fc24c0c74c0 2024-04-25T10:25:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.654+0000 7fc243e00640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc22c0744e0 0x7fc22c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.654+0000 7fc243e00640 1 -- 172.21.15.19:0/796090909 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc23c0948f0 con 0x7fc24c0c74c0 2024-04-25T10:25:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.654+0000 7fc24b400640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc22c0744e0 0x7fc22c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.655+0000 7fc24b400640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc22c0744e0 0x7fc22c0769f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc24c152ef0 tx=0x7fc238009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.658+0000 7fc243e00640 1 -- 172.21.15.19:0/796090909 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc24c06a240 con 0x7fc24c0c74c0 2024-04-25T10:25:55.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.863+0000 7fc251600640 1 -- 172.21.15.19:0/796090909 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc24c1f2c80 con 0x7fc24c0c74c0 2024-04-25T10:25:55.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.864+0000 7fc243e00640 1 -- 172.21.15.19:0/796090909 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7fc23c05e650 con 0x7fc24c0c74c0 2024-04-25T10:25:55.867 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:25:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.866+0000 7fc251600640 1 -- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc22c0744e0 msgr2=0x7fc22c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.866+0000 7fc251600640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc22c0744e0 0x7fc22c0769f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc24c152ef0 tx=0x7fc238009240 comp rx=0 tx=0).stop 2024-04-25T10:25:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.866+0000 7fc251600640 1 -- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c0c74c0 msgr2=0x7fc24c14f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:55.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.866+0000 7fc251600640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c0c74c0 0x7fc24c14f4a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00c3c0 tx=0x7fc23c00c880 comp rx=0 tx=0).stop 2024-04-25T10:25:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.867+0000 7fc251600640 1 -- 172.21.15.19:0/796090909 shutdown_connections 2024-04-25T10:25:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.867+0000 7fc251600640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc24c1595f0 0x7fc24c0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.867+0000 7fc251600640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc24c153450 0x7fc24c1f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.867+0000 7fc251600640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc22c0744e0 0x7fc22c0769f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.867+0000 7fc251600640 1 --2- 172.21.15.19:0/796090909 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc24c0c74c0 0x7fc24c14f4a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.867+0000 7fc251600640 1 -- 172.21.15.19:0/796090909 >> 172.21.15.19:0/796090909 conn(0x7fc24c0ca120 msgr2=0x7fc24c073010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.867+0000 7fc251600640 1 -- 172.21.15.19:0/796090909 shutdown_connections 2024-04-25T10:25:55.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:55.867+0000 7fc251600640 1 -- 172.21.15.19:0/796090909 wait complete. 2024-04-25T10:25:55.899 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:25:56.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.182+0000 7f38ea400640 1 Processor -- start 2024-04-25T10:25:56.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.182+0000 7f38ea400640 1 -- start start 2024-04-25T10:25:56.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.184+0000 7f38ea400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38e40c8100 0x7f38e415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.184+0000 7f38ea400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38e40c8510 0x7f38e4073b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.184+0000 7f38ea400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e4073770 con 0x7f38e4074780 2024-04-25T10:25:56.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.184+0000 7f38ea400640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f38e40c9200 con 0x7f38e40c8100 2024-04-25T10:25:56.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.184+0000 7f38ea400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f38e4071450 con 0x7f38e40c8510 2024-04-25T10:25:56.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.185+0000 7f38e9000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f38e4074780 0x7f38e4154340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:33870/0 (socket says 172.21.15.19:33870) 2024-04-25T10:25:56.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.185+0000 7f38e9000640 1 -- 172.21.15.19:0/1995852882 learned_addr learned my addr 172.21.15.19:0/1995852882 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:56.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.185+0000 7f38e9a00640 1 --2- 172.21.15.19:0/1995852882 >> v2:172.21.15.112:3300/0 conn(0x7f38e40c8510 0x7f38e4073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.185+0000 7f38e3e00640 1 --2- 172.21.15.19:0/1995852882 >> v2:172.21.15.19:3300/0 conn(0x7f38e40c8100 0x7f38e415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.185+0000 7f38e3400640 1 -- 172.21.15.19:0/1995852882 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315603345 0 0) 0x7f38e4073770 con 0x7f38e4074780 2024-04-25T10:25:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.185+0000 7f38e3400640 1 -- 172.21.15.19:0/1995852882 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38cc003520 con 0x7f38e4074780 2024-04-25T10:25:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.185+0000 7f38e9a00640 1 -- 172.21.15.19:0/1995852882 >> v2:172.21.15.19:3300/0 conn(0x7f38e40c8100 msgr2=0x7f38e415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.185+0000 7f38e9a00640 1 --2- 172.21.15.19:0/1995852882 >> v2:172.21.15.19:3300/0 conn(0x7f38e40c8100 0x7f38e415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.185+0000 7f38e9a00640 1 -- 172.21.15.19:0/1995852882 >> v1:172.21.15.112:6789/0 conn(0x7f38e4074780 legacy=0x7f38e4154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.185+0000 7f38e9a00640 1 -- 172.21.15.19:0/1995852882 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e40731b0 con 0x7f38e40c8510 2024-04-25T10:25:56.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.187+0000 7f38e9a00640 1 --2- 172.21.15.19:0/1995852882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e40c8510 0x7f38e4073b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38e40ce3b0 tx=0x7f38dc02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b1db45ea9e434ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:56.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.187+0000 7f38e3400640 1 -- 172.21.15.19:0/1995852882 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc007740 con 0x7f38e40c8510 2024-04-25T10:25:56.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.187+0000 7f38e3400640 1 -- 172.21.15.19:0/1995852882 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38dc0078e0 con 0x7f38e40c8510 2024-04-25T10:25:56.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.187+0000 7f38e3400640 1 -- 172.21.15.19:0/1995852882 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc007cb0 con 0x7f38e40c8510 2024-04-25T10:25:56.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.188+0000 7f38ea400640 1 -- 172.21.15.19:0/1995852882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e40c8510 msgr2=0x7f38e4073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:56.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.188+0000 7f38ea400640 1 --2- 172.21.15.19:0/1995852882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e40c8510 0x7f38e4073b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38e40ce3b0 tx=0x7f38dc02a5f0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.188+0000 7f38ea400640 1 -- 172.21.15.19:0/1995852882 shutdown_connections 2024-04-25T10:25:56.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.188+0000 7f38ea400640 1 --2- 172.21.15.19:0/1995852882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e40c8510 0x7f38e4073b60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.188+0000 7f38ea400640 1 --2- 172.21.15.19:0/1995852882 >> v2:172.21.15.19:3300/0 conn(0x7f38e40c8100 0x7f38e415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.188+0000 7f38ea400640 1 -- 172.21.15.19:0/1995852882 >> 172.21.15.19:0/1995852882 conn(0x7f38e406d120 msgr2=0x7f38e40cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:56.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.188+0000 7f38ea400640 1 -- 172.21.15.19:0/1995852882 shutdown_connections 2024-04-25T10:25:56.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.188+0000 7f38ea400640 1 -- 172.21.15.19:0/1995852882 wait complete. 2024-04-25T10:25:56.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.190+0000 7f38ea400640 1 Processor -- start 2024-04-25T10:25:56.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.190+0000 7f38ea400640 1 -- start start 2024-04-25T10:25:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.192+0000 7f38ea400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e4074780 0x7f38e4158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.192+0000 7f38ea400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e40c8100 0x7f38e41f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.192+0000 7f38ea400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38e4154ae0 0x7f38e40c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.192+0000 7f38ea400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f38e40c8e90 con 0x7f38e40c8100 2024-04-25T10:25:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.192+0000 7f38ea400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38e40c8bb0 con 0x7f38e4074780 2024-04-25T10:25:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.192+0000 7f38ea400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f38e40c9690 con 0x7f38e4154ae0 2024-04-25T10:25:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.192+0000 7f38e3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e40c8100 0x7f38e41f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.192+0000 7f38e9000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e4074780 0x7f38e4158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.192+0000 7f38e9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38e4154ae0 0x7f38e40c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.192+0000 7f38e3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e40c8100 0x7f38e41f1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36128/0 (socket says 172.21.15.19:36128) 2024-04-25T10:25:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.192+0000 7f38e3e00640 1 -- 172.21.15.19:0/910240374 learned_addr learned my addr 172.21.15.19:0/910240374 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:56.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38e3e00640 1 -- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38e4154ae0 msgr2=0x7f38e40c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:56.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38e3e00640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38e4154ae0 0x7f38e40c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38e3e00640 1 -- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e4074780 msgr2=0x7f38e4158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:56.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38e3e00640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e4074780 0x7f38e4158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38e3e00640 1 -- 172.21.15.19:0/910240374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e4157570 con 0x7f38e40c8100 2024-04-25T10:25:56.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38e9000640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e4074780 0x7f38e4158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:56.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38e3e00640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e40c8100 0x7f38e41f1c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f38d000e870 tx=0x7f38d000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:56.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38e0c00640 1 -- 172.21.15.19:0/910240374 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0017070 con 0x7f38e40c8100 2024-04-25T10:25:56.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38e0c00640 1 -- 172.21.15.19:0/910240374 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d000c940 con 0x7f38e40c8100 2024-04-25T10:25:56.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38e0c00640 1 -- 172.21.15.19:0/910240374 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d000cd30 con 0x7f38e40c8100 2024-04-25T10:25:56.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38ea400640 1 -- 172.21.15.19:0/910240374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e4159810 con 0x7f38e40c8100 2024-04-25T10:25:56.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.193+0000 7f38ea400640 1 -- 172.21.15.19:0/910240374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e4156a90 con 0x7f38e40c8100 2024-04-25T10:25:56.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.194+0000 7f38ea400640 1 -- 172.21.15.19:0/910240374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e4076520 con 0x7f38e40c8100 2024-04-25T10:25:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.196+0000 7f38e0c00640 1 -- 172.21.15.19:0/910240374 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f38d001a070 con 0x7f38e40c8100 2024-04-25T10:25:56.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.197+0000 7f38e0c00640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f38c40744b0 0x7f38c40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.197+0000 7f38e0c00640 1 -- 172.21.15.19:0/910240374 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f38d0095790 con 0x7f38e40c8100 2024-04-25T10:25:56.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.197+0000 7f38e9000640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f38c40744b0 0x7f38c40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.198+0000 7f38e9000640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f38c40744b0 0x7f38c40769c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f38d8005880 tx=0x7f38d8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:56.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.202+0000 7f38e0c00640 1 -- 172.21.15.19:0/910240374 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f38e4157570 con 0x7f38e40c8100 2024-04-25T10:25:56.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.422+0000 7f38ea400640 1 -- 172.21.15.19:0/910240374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f38e4157c10 con 0x7f38e40c8100 2024-04-25T10:25:56.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.423+0000 7f38e0c00640 1 -- 172.21.15.19:0/910240374 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f38d005f580 con 0x7f38e40c8100 2024-04-25T10:25:56.426 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-04-25T10:25:56.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 -- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f38c40744b0 msgr2=0x7f38c40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:56.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f38c40744b0 0x7f38c40769c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f38d8005880 tx=0x7f38d8009040 comp rx=0 tx=0).stop 2024-04-25T10:25:56.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 -- 172.21.15.19:0/910240374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e40c8100 msgr2=0x7f38e41f1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:56.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e40c8100 0x7f38e41f1c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f38d000e870 tx=0x7f38d000ed30 comp rx=0 tx=0).stop 2024-04-25T10:25:56.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 -- 172.21.15.19:0/910240374 shutdown_connections 2024-04-25T10:25:56.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f38c40744b0 0x7f38c40769c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38e4154ae0 0x7f38e40c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e40c8100 0x7f38e41f1c40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 --2- 172.21.15.19:0/910240374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38e4074780 0x7f38e4158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 -- 172.21.15.19:0/910240374 >> 172.21.15.19:0/910240374 conn(0x7f38e406d120 msgr2=0x7f38e4154340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:56.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 -- 172.21.15.19:0/910240374 shutdown_connections 2024-04-25T10:25:56.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.426+0000 7f38ea400640 1 -- 172.21.15.19:0/910240374 wait complete. 2024-04-25T10:25:56.452 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:25:56.453 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:25:56.502 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:25:56.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.785+0000 7fd343200640 1 Processor -- start 2024-04-25T10:25:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.785+0000 7fd343200640 1 -- start start 2024-04-25T10:25:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.787+0000 7fd343200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd34415a370 0x7fd344070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.787+0000 7fd343200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd3440c7f90 0x7fd344073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.787+0000 7fd343200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd34415a8b0 con 0x7fd3440cac80 2024-04-25T10:25:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.787+0000 7fd343200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd344072ea0 con 0x7fd3440c7f90 2024-04-25T10:25:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.787+0000 7fd343200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd344073180 con 0x7fd34415a370 2024-04-25T10:25:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.788+0000 7fd341400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd3440c7f90 0x7fd344073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.788+0000 7fd342800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd3440cac80 0x7fd344154060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41518/0 (socket says 172.21.15.19:41518) 2024-04-25T10:25:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.788+0000 7fd342800640 1 -- 172.21.15.19:0/1989859716 learned_addr learned my addr 172.21.15.19:0/1989859716 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.788+0000 7fd341e00640 1 --2- 172.21.15.19:0/1989859716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd34415a370 0x7fd344070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.788+0000 7fd341400640 1 -- 172.21.15.19:0/1989859716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd34415a370 msgr2=0x7fd344070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:56.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.788+0000 7fd341400640 1 --2- 172.21.15.19:0/1989859716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd34415a370 0x7fd344070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.788+0000 7fd341400640 1 -- 172.21.15.19:0/1989859716 >> v1:172.21.15.19:6789/0 conn(0x7fd3440cac80 legacy=0x7fd344154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:56.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.788+0000 7fd341400640 1 -- 172.21.15.19:0/1989859716 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34415ab70 con 0x7fd3440c7f90 2024-04-25T10:25:56.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.790+0000 7fd341400640 1 --2- 172.21.15.19:0/1989859716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3440c7f90 0x7fd344073610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd344073020 tx=0x7fd33002a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fc56a8834ca5e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:56.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.790+0000 7fd340a00640 1 -- 172.21.15.19:0/1989859716 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330037070 con 0x7fd3440c7f90 2024-04-25T10:25:56.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.790+0000 7fd340a00640 1 -- 172.21.15.19:0/1989859716 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33002ae40 con 0x7fd3440c7f90 2024-04-25T10:25:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.790+0000 7fd340a00640 1 -- 172.21.15.19:0/1989859716 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330032660 con 0x7fd3440c7f90 2024-04-25T10:25:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.791+0000 7fd343200640 1 -- 172.21.15.19:0/1989859716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3440c7f90 msgr2=0x7fd344073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.791+0000 7fd343200640 1 --2- 172.21.15.19:0/1989859716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3440c7f90 0x7fd344073610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd344073020 tx=0x7fd33002a0f0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.791+0000 7fd343200640 1 -- 172.21.15.19:0/1989859716 shutdown_connections 2024-04-25T10:25:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.791+0000 7fd343200640 1 --2- 172.21.15.19:0/1989859716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3440c7f90 0x7fd344073610 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.791+0000 7fd343200640 1 --2- 172.21.15.19:0/1989859716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd34415a370 0x7fd344070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.791+0000 7fd343200640 1 -- 172.21.15.19:0/1989859716 >> 172.21.15.19:0/1989859716 conn(0x7fd3440cdbc0 msgr2=0x7fd3440ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.791+0000 7fd343200640 1 -- 172.21.15.19:0/1989859716 shutdown_connections 2024-04-25T10:25:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.791+0000 7fd343200640 1 -- 172.21.15.19:0/1989859716 wait complete. 2024-04-25T10:25:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.794+0000 7fd343200640 1 Processor -- start 2024-04-25T10:25:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.794+0000 7fd343200640 1 -- start start 2024-04-25T10:25:56.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.796+0000 7fd343200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3440c7f90 0x7fd3441515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.796+0000 7fd343200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3440cac80 0x7fd34406c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.796+0000 7fd343200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd34415a370 0x7fd344156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.796+0000 7fd343200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd3440c4b20 con 0x7fd3440c7f90 2024-04-25T10:25:56.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.796+0000 7fd343200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd34415b130 con 0x7fd34415a370 2024-04-25T10:25:56.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.796+0000 7fd343200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd344070da0 con 0x7fd3440cac80 2024-04-25T10:25:56.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.796+0000 7fd341e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3440c7f90 0x7fd3441515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.796+0000 7fd342800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd34415a370 0x7fd344156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.797+0000 7fd341400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3440cac80 0x7fd34406c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.796+0000 7fd341e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3440c7f90 0x7fd3441515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36142/0 (socket says 172.21.15.19:36142) 2024-04-25T10:25:56.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.797+0000 7fd341e00640 1 -- 172.21.15.19:0/2432630626 learned_addr learned my addr 172.21.15.19:0/2432630626 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:56.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.797+0000 7fd341400640 1 -- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd34415a370 msgr2=0x7fd344156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:56.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.797+0000 7fd341400640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd34415a370 0x7fd344156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.797+0000 7fd341400640 1 -- 172.21.15.19:0/2432630626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3440c7f90 msgr2=0x7fd3441515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:56.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.797+0000 7fd341400640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3440c7f90 0x7fd3441515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:56.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.797+0000 7fd341400640 1 -- 172.21.15.19:0/2432630626 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3441e68a0 con 0x7fd3440cac80 2024-04-25T10:25:56.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.797+0000 7fd341e00640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3440c7f90 0x7fd3441515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:56.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.797+0000 7fd341400640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3440cac80 0x7fd34406c7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd34415aaa0 tx=0x7fd3300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:56.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.798+0000 7fd33a000640 1 -- 172.21.15.19:0/2432630626 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330041030 con 0x7fd3440cac80 2024-04-25T10:25:56.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.798+0000 7fd33a000640 1 -- 172.21.15.19:0/2432630626 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33002ac40 con 0x7fd3440cac80 2024-04-25T10:25:56.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.798+0000 7fd33a000640 1 -- 172.21.15.19:0/2432630626 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330037040 con 0x7fd3440cac80 2024-04-25T10:25:56.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.798+0000 7fd343200640 1 -- 172.21.15.19:0/2432630626 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd344150500 con 0x7fd3440cac80 2024-04-25T10:25:56.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.798+0000 7fd343200640 1 -- 172.21.15.19:0/2432630626 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3441507a0 con 0x7fd3440cac80 2024-04-25T10:25:56.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.799+0000 7fd343200640 1 -- 172.21.15.19:0/2432630626 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd344050740 con 0x7fd3440cac80 2024-04-25T10:25:56.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.800+0000 7fd33a000640 1 -- 172.21.15.19:0/2432630626 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd330044070 con 0x7fd3440cac80 2024-04-25T10:25:56.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.801+0000 7fd33a000640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3240744e0 0x7fd3240769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:56.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.802+0000 7fd33a000640 1 -- 172.21.15.19:0/2432630626 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd3300b57e0 con 0x7fd3440cac80 2024-04-25T10:25:56.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.802+0000 7fd341e00640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3240744e0 0x7fd3240769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:56.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.803+0000 7fd341e00640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3240744e0 0x7fd3240769f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd334009f50 tx=0x7fd334009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:56.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:56.807+0000 7fd33a000640 1 -- 172.21.15.19:0/2432630626 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd344150500 con 0x7fd3440cac80 2024-04-25T10:25:57.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.012+0000 7fd343200640 1 -- 172.21.15.19:0/2432630626 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd344070460 con 0x7fd3440cac80 2024-04-25T10:25:57.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.014+0000 7fd33a000640 1 -- 172.21.15.19:0/2432630626 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18518 (secure 0 0 0) 0x7fd330032e20 con 0x7fd3440cac80 2024-04-25T10:25:57.017 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:25:57.017 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:41.790347+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:25:57.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.016+0000 7fd343200640 1 -- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3240744e0 msgr2=0x7fd3240769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.016+0000 7fd343200640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3240744e0 0x7fd3240769f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd334009f50 tx=0x7fd334009190 comp rx=0 tx=0).stop 2024-04-25T10:25:57.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.016+0000 7fd343200640 1 -- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3440cac80 msgr2=0x7fd34406c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.016+0000 7fd343200640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3440cac80 0x7fd34406c7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd34415aaa0 tx=0x7fd3300046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.017+0000 7fd343200640 1 -- 172.21.15.19:0/2432630626 shutdown_connections 2024-04-25T10:25:57.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.017+0000 7fd343200640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd34415a370 0x7fd344156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.017+0000 7fd343200640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3240744e0 0x7fd3240769f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.017+0000 7fd343200640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3440cac80 0x7fd34406c7a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.017+0000 7fd343200640 1 --2- 172.21.15.19:0/2432630626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3440c7f90 0x7fd3441515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.017+0000 7fd343200640 1 -- 172.21.15.19:0/2432630626 >> 172.21.15.19:0/2432630626 conn(0x7fd3440cdbc0 msgr2=0x7fd3440c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:57.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.017+0000 7fd343200640 1 -- 172.21.15.19:0/2432630626 shutdown_connections 2024-04-25T10:25:57.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.017+0000 7fd343200640 1 -- 172.21.15.19:0/2432630626 wait complete. 2024-04-25T10:25:57.048 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:25:24.611615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:25:34.760347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:25:35.692430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:25:39.212157+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:25:57.049 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:25:57.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.339+0000 7ff4b9a00640 1 Processor -- start 2024-04-25T10:25:57.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.339+0000 7ff4b9a00640 1 -- start start 2024-04-25T10:25:57.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.341+0000 7ff4b9a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff4b415b2c0 0x7ff4b40c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.341+0000 7ff4b9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4b4073160 0x7ff4b415e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.341+0000 7ff4b9a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b4158010 con 0x7ff4b415e760 2024-04-25T10:25:57.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.341+0000 7ff4b9a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff4b4074970 con 0x7ff4b415b2c0 2024-04-25T10:25:57.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.341+0000 7ff4b9a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b40c8600 con 0x7ff4b4073160 2024-04-25T10:25:57.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.341+0000 7ff4b2000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4b4073160 0x7ff4b415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.341+0000 7ff4b2a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff4b415b2c0 0x7ff4b40c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.341+0000 7ff4b3400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff4b415e760 0x7ff4b40cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:33874/0 (socket says 172.21.15.19:33874) 2024-04-25T10:25:57.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.341+0000 7ff4b3400640 1 -- 172.21.15.19:0/910137854 learned_addr learned my addr 172.21.15.19:0/910137854 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:57.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.342+0000 7ff4b2a00640 1 -- 172.21.15.19:0/910137854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4b4073160 msgr2=0x7ff4b415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:57.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.342+0000 7ff4b2a00640 1 --2- 172.21.15.19:0/910137854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4b4073160 0x7ff4b415e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.342+0000 7ff4b2a00640 1 -- 172.21.15.19:0/910137854 >> v1:172.21.15.112:6789/0 conn(0x7ff4b415e760 legacy=0x7ff4b40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.342+0000 7ff4b2a00640 1 -- 172.21.15.19:0/910137854 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b40c88e0 con 0x7ff4b415b2c0 2024-04-25T10:25:57.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.342+0000 7ff4b2000640 1 --2- 172.21.15.19:0/910137854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4b4073160 0x7ff4b415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:57.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.342+0000 7ff4b1600640 1 -- 172.21.15.19:0/910137854 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 711779392 0 0) 0x7ff4b4158010 con 0x7ff4b415e760 2024-04-25T10:25:57.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.343+0000 7ff4b2a00640 1 --2- 172.21.15.19:0/910137854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4b415b2c0 0x7ff4b40c9810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40097a0 tx=0x7ff4a402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73d9408da8d6d07a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.343+0000 7ff4b1600640 1 -- 172.21.15.19:0/910137854 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4037070 con 0x7ff4b415b2c0 2024-04-25T10:25:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.343+0000 7ff4b1600640 1 -- 172.21.15.19:0/910137854 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a4032440 con 0x7ff4b415b2c0 2024-04-25T10:25:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.343+0000 7ff4b1600640 1 -- 172.21.15.19:0/910137854 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4032810 con 0x7ff4b415b2c0 2024-04-25T10:25:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.344+0000 7ff4b9a00640 1 -- 172.21.15.19:0/910137854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4b415b2c0 msgr2=0x7ff4b40c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.344+0000 7ff4b9a00640 1 --2- 172.21.15.19:0/910137854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4b415b2c0 0x7ff4b40c9810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40097a0 tx=0x7ff4a402a250 comp rx=0 tx=0).stop 2024-04-25T10:25:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.344+0000 7ff4b9a00640 1 -- 172.21.15.19:0/910137854 shutdown_connections 2024-04-25T10:25:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.344+0000 7ff4b9a00640 1 --2- 172.21.15.19:0/910137854 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4b4073160 0x7ff4b415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.344+0000 7ff4b9a00640 1 --2- 172.21.15.19:0/910137854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4b415b2c0 0x7ff4b40c9810 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.344+0000 7ff4b9a00640 1 -- 172.21.15.19:0/910137854 >> 172.21.15.19:0/910137854 conn(0x7ff4b406f1f0 msgr2=0x7ff4b406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.344+0000 7ff4b9a00640 1 -- 172.21.15.19:0/910137854 shutdown_connections 2024-04-25T10:25:57.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.344+0000 7ff4b9a00640 1 -- 172.21.15.19:0/910137854 wait complete. 2024-04-25T10:25:57.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.346+0000 7ff4b9a00640 1 Processor -- start 2024-04-25T10:25:57.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.346+0000 7ff4b9a00640 1 -- start start 2024-04-25T10:25:57.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b9a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4b4073160 0x7ff4b40c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4b415e760 0x7ff4b4153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b9a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b415b6e0 0x7ff4b414d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b9a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b406d4c0 con 0x7ff4b415b6e0 2024-04-25T10:25:57.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b9a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b415a580 con 0x7ff4b4073160 2024-04-25T10:25:57.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b9a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b40ce4f0 con 0x7ff4b415e760 2024-04-25T10:25:57.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b3400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b415b6e0 0x7ff4b414d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4b4073160 0x7ff4b40c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b2000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4b415e760 0x7ff4b4153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4b4073160 0x7ff4b40c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:54346/0 (socket says 172.21.15.19:54346) 2024-04-25T10:25:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b3400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b415b6e0 0x7ff4b414d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36150/0 (socket says 172.21.15.19:36150) 2024-04-25T10:25:57.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b2a00640 1 -- 172.21.15.19:0/4037127920 learned_addr learned my addr 172.21.15.19:0/4037127920 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b2a00640 1 -- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4b415e760 msgr2=0x7ff4b4153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b2a00640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4b415e760 0x7ff4b4153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b2a00640 1 -- 172.21.15.19:0/4037127920 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b415b6e0 msgr2=0x7ff4b414d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b2a00640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b415b6e0 0x7ff4b414d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.348+0000 7ff4b2a00640 1 -- 172.21.15.19:0/4037127920 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b415d420 con 0x7ff4b4073160 2024-04-25T10:25:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.349+0000 7ff4b2a00640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4b4073160 0x7ff4b40c4df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff4a402a840 tx=0x7ff4a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.349+0000 7ff4aaa00640 1 -- 172.21.15.19:0/4037127920 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4037040 con 0x7ff4b4073160 2024-04-25T10:25:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.349+0000 7ff4aaa00640 1 -- 172.21.15.19:0/4037127920 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a4042070 con 0x7ff4b4073160 2024-04-25T10:25:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.349+0000 7ff4aaa00640 1 -- 172.21.15.19:0/4037127920 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4030940 con 0x7ff4b4073160 2024-04-25T10:25:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.349+0000 7ff4b9a00640 1 -- 172.21.15.19:0/4037127920 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b415d700 con 0x7ff4b4073160 2024-04-25T10:25:57.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.349+0000 7ff4b9a00640 1 -- 172.21.15.19:0/4037127920 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b4152d30 con 0x7ff4b4073160 2024-04-25T10:25:57.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.350+0000 7ff4b9a00640 1 -- 172.21.15.19:0/4037127920 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b4076520 con 0x7ff4b4073160 2024-04-25T10:25:57.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.352+0000 7ff4aaa00640 1 -- 172.21.15.19:0/4037127920 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff4a4030ae0 con 0x7ff4b4073160 2024-04-25T10:25:57.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.353+0000 7ff4aaa00640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff4940744e0 0x7ff4940769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.353+0000 7ff4aaa00640 1 -- 172.21.15.19:0/4037127920 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff4a40b5d60 con 0x7ff4b4073160 2024-04-25T10:25:57.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.353+0000 7ff4b2000640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff4940744e0 0x7ff4940769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.354+0000 7ff4b2000640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff4940744e0 0x7ff4940769f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40c7e60 tx=0x7ff4a0009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:57.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.358+0000 7ff4aaa00640 1 -- 172.21.15.19:0/4037127920 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff4a407fb50 con 0x7ff4b4073160 2024-04-25T10:25:57.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.558+0000 7ff4b9a00640 1 -- 172.21.15.19:0/4037127920 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff4b415d8d0 con 0x7ff4b4073160 2024-04-25T10:25:57.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.559+0000 7ff4aaa00640 1 -- 172.21.15.19:0/4037127920 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7ff4a4083e50 con 0x7ff4b4073160 2024-04-25T10:25:57.562 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 -- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff4940744e0 msgr2=0x7ff4940769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff4940744e0 0x7ff4940769f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40c7e60 tx=0x7ff4a0009190 comp rx=0 tx=0).stop 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 -- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4b4073160 msgr2=0x7ff4b40c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4b4073160 0x7ff4b40c4df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff4a402a840 tx=0x7ff4a40046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 -- 172.21.15.19:0/4037127920 shutdown_connections 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b415b6e0 0x7ff4b414d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff4940744e0 0x7ff4940769f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4b415e760 0x7ff4b4153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 --2- 172.21.15.19:0/4037127920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4b4073160 0x7ff4b40c4df0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 -- 172.21.15.19:0/4037127920 >> 172.21.15.19:0/4037127920 conn(0x7ff4b406f1f0 msgr2=0x7ff4b40b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 -- 172.21.15.19:0/4037127920 shutdown_connections 2024-04-25T10:25:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.563+0000 7ff4b9a00640 1 -- 172.21.15.19:0/4037127920 wait complete. 2024-04-25T10:25:57.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:25:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.858+0000 7f13ff000640 1 Processor -- start 2024-04-25T10:25:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.858+0000 7f13ff000640 1 -- start start 2024-04-25T10:25:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.860+0000 7f13ff000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f13f80c4940 0x7f13f80cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.861+0000 7f13ff000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 0x7f13f80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.861+0000 7f13ff000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13f80cbcf0 con 0x7f13f8154730 2024-04-25T10:25:57.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.861+0000 7f13ff000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f13f815df70 con 0x7f13f80c4940 2024-04-25T10:25:57.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.861+0000 7f13ff000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f13f815afb0 con 0x7f13f80cc7b0 2024-04-25T10:25:57.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.861+0000 7f13f7e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f13f80c4940 0x7f13f80cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.861+0000 7f13f7400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f13f8154730 0x7f13f815e400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38572/0 (socket says 172.21.15.19:38572) 2024-04-25T10:25:57.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.861+0000 7f13f7400640 1 -- 172.21.15.19:0/2583314200 learned_addr learned my addr 172.21.15.19:0/2583314200 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:57.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.861+0000 7f13fd000640 1 --2- 172.21.15.19:0/2583314200 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 0x7f13f80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.861+0000 7f13fd000640 1 -- 172.21.15.19:0/2583314200 >> v2:172.21.15.19:3300/0 conn(0x7f13f80c4940 msgr2=0x7f13f80cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:57.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.861+0000 7f13fd000640 1 --2- 172.21.15.19:0/2583314200 >> v2:172.21.15.19:3300/0 conn(0x7f13f80c4940 0x7f13f80cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.862+0000 7f13fd000640 1 -- 172.21.15.19:0/2583314200 >> v1:172.21.15.19:6789/0 conn(0x7f13f8154730 legacy=0x7f13f815e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.862+0000 7f13fd000640 1 -- 172.21.15.19:0/2583314200 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f815b290 con 0x7f13f80cc7b0 2024-04-25T10:25:57.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.862+0000 7f13f7e00640 1 --2- 172.21.15.19:0/2583314200 >> v2:172.21.15.19:3300/0 conn(0x7f13f80c4940 0x7f13f80cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:57.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.862+0000 7f13f6a00640 1 -- 172.21.15.19:0/2583314200 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639106917 0 0) 0x7f13f80cbcf0 con 0x7f13f8154730 2024-04-25T10:25:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.863+0000 7f13fd000640 1 --2- 172.21.15.19:0/2583314200 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 0x7f13f80ccbc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009d90 tx=0x7f13e802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f4c69a106264a12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.863+0000 7f13f6a00640 1 -- 172.21.15.19:0/2583314200 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8007740 con 0x7f13f80cc7b0 2024-04-25T10:25:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.863+0000 7f13f6a00640 1 -- 172.21.15.19:0/2583314200 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e80078e0 con 0x7f13f80cc7b0 2024-04-25T10:25:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.863+0000 7f13f6a00640 1 -- 172.21.15.19:0/2583314200 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8007cb0 con 0x7f13f80cc7b0 2024-04-25T10:25:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.863+0000 7f13ff000640 1 -- 172.21.15.19:0/2583314200 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 msgr2=0x7f13f80ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.863+0000 7f13ff000640 1 --2- 172.21.15.19:0/2583314200 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 0x7f13f80ccbc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009d90 tx=0x7f13e802a660 comp rx=0 tx=0).stop 2024-04-25T10:25:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.864+0000 7f13ff000640 1 -- 172.21.15.19:0/2583314200 shutdown_connections 2024-04-25T10:25:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.864+0000 7f13ff000640 1 --2- 172.21.15.19:0/2583314200 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 0x7f13f80ccbc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.864+0000 7f13ff000640 1 --2- 172.21.15.19:0/2583314200 >> v2:172.21.15.19:3300/0 conn(0x7f13f80c4940 0x7f13f80cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.864+0000 7f13ff000640 1 -- 172.21.15.19:0/2583314200 >> 172.21.15.19:0/2583314200 conn(0x7f13f8073120 msgr2=0x7f13f8073530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.864+0000 7f13ff000640 1 -- 172.21.15.19:0/2583314200 shutdown_connections 2024-04-25T10:25:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.864+0000 7f13ff000640 1 -- 172.21.15.19:0/2583314200 wait complete. 2024-04-25T10:25:57.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.866+0000 7f13ff000640 1 Processor -- start 2024-04-25T10:25:57.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.866+0000 7f13ff000640 1 -- start start 2024-04-25T10:25:57.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.867+0000 7f13ff000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13f80c4940 0x7f13f80aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.867+0000 7f13ff000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 0x7f13f81f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.867+0000 7f13ff000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13f8154730 0x7f13f81516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13ff000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f13f80cbfb0 con 0x7f13f80c4940 2024-04-25T10:25:57.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13ff000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f13f8154b40 con 0x7f13f8154730 2024-04-25T10:25:57.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13ff000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f13f80cb7c0 con 0x7f13f80cc7b0 2024-04-25T10:25:57.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13f7e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13f80c4940 0x7f13f80aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13f7e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13f80c4940 0x7f13f80aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50626/0 (socket says 172.21.15.19:50626) 2024-04-25T10:25:57.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13f7e00640 1 -- 172.21.15.19:0/1859616221 learned_addr learned my addr 172.21.15.19:0/1859616221 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:57.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13f7400640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 0x7f13f81f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13fd000640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13f8154730 0x7f13f81516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13f7e00640 1 -- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 msgr2=0x7f13f81f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13f7e00640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 0x7f13f81f5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13f7e00640 1 -- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13f8154730 msgr2=0x7f13f81516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:57.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13f7e00640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13f8154730 0x7f13f81516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:57.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13f7e00640 1 -- 172.21.15.19:0/1859616221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f8151c20 con 0x7f13f80c4940 2024-04-25T10:25:57.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.868+0000 7f13f7400640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 0x7f13f81f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:25:57.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.869+0000 7f13f7e00640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13f80c4940 0x7f13f80aff10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f13f000e960 tx=0x7f13f000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:57.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.869+0000 7f13efe00640 1 -- 172.21.15.19:0/1859616221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0017070 con 0x7f13f80c4940 2024-04-25T10:25:57.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.869+0000 7f13efe00640 1 -- 172.21.15.19:0/1859616221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f000c9a0 con 0x7f13f80c4940 2024-04-25T10:25:57.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.869+0000 7f13efe00640 1 -- 172.21.15.19:0/1859616221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f000cd70 con 0x7f13f80c4940 2024-04-25T10:25:57.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.869+0000 7f13ff000640 1 -- 172.21.15.19:0/1859616221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f81f27c0 con 0x7f13f80c4940 2024-04-25T10:25:57.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.869+0000 7f13ff000640 1 -- 172.21.15.19:0/1859616221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f81f2d60 con 0x7f13f80c4940 2024-04-25T10:25:57.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.870+0000 7f13ff000640 1 -- 172.21.15.19:0/1859616221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f8076520 con 0x7f13f80c4940 2024-04-25T10:25:57.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.871+0000 7f13efe00640 1 -- 172.21.15.19:0/1859616221 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f13f001a070 con 0x7f13f80c4940 2024-04-25T10:25:57.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.872+0000 7f13efe00640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f13d80744b0 0x7f13d80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:57.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.872+0000 7f13efe00640 1 -- 172.21.15.19:0/1859616221 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f13f00953a0 con 0x7f13f80c4940 2024-04-25T10:25:57.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.872+0000 7f13f7400640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f13d80744b0 0x7f13d80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:57.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.873+0000 7f13f7400640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f13d80744b0 0x7f13d80769c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f13f80c6d20 tx=0x7f13e4007cc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:57.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:57.877+0000 7f13efe00640 1 -- 172.21.15.19:0/1859616221 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f13f005f190 con 0x7f13f80c4940 2024-04-25T10:25:58.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.077+0000 7f13ff000640 1 -- 172.21.15.19:0/1859616221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f13f80cbad0 con 0x7f13f80c4940 2024-04-25T10:25:58.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.078+0000 7f13efe00640 1 -- 172.21.15.19:0/1859616221 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f13f0063490 con 0x7f13f80c4940 2024-04-25T10:25:58.168 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 -- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f13d80744b0 msgr2=0x7f13d80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f13d80744b0 0x7f13d80769c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f13f80c6d20 tx=0x7f13e4007cc0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 -- 172.21.15.19:0/1859616221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13f80c4940 msgr2=0x7f13f80aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13f80c4940 0x7f13f80aff10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f13f000e960 tx=0x7f13f000ee20 comp rx=0 tx=0).stop 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 -- 172.21.15.19:0/1859616221 shutdown_connections 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13f8154730 0x7f13f81516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f13d80744b0 0x7f13d80769c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13f80cc7b0 0x7f13f81f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 --2- 172.21.15.19:0/1859616221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13f80c4940 0x7f13f80aff10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 -- 172.21.15.19:0/1859616221 >> 172.21.15.19:0/1859616221 conn(0x7f13f8073120 msgr2=0x7f13f815b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 -- 172.21.15.19:0/1859616221 shutdown_connections 2024-04-25T10:25:58.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.081+0000 7f13ff000640 1 -- 172.21.15.19:0/1859616221 wait complete. 2024-04-25T10:25:58.171 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:25:58.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.458+0000 7f9c70a00640 1 Processor -- start 2024-04-25T10:25:58.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.459+0000 7f9c70a00640 1 -- start start 2024-04-25T10:25:58.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.461+0000 7f9c70a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c6c074780 0x7f9c6c154340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:58.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.461+0000 7f9c70a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c6c0c8100 0x7f9c6c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:58.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.461+0000 7f9c70a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c6c073770 con 0x7f9c6c0c8510 2024-04-25T10:25:58.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.461+0000 7f9c70a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f9c6c0c9200 con 0x7f9c6c0c8100 2024-04-25T10:25:58.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.461+0000 7f9c70a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9c6c071450 con 0x7f9c6c074780 2024-04-25T10:25:58.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.462+0000 7f9c6aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c6c0c8100 0x7f9c6c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:58.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.462+0000 7f9c6aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c6c0c8100 0x7f9c6c15a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50628/0 (socket says 172.21.15.19:50628) 2024-04-25T10:25:58.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.462+0000 7f9c6aa00640 1 -- 172.21.15.19:0/2241037422 learned_addr learned my addr 172.21.15.19:0/2241037422 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:58.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.462+0000 7f9c6b400640 1 --2- 172.21.15.19:0/2241037422 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c6c074780 0x7f9c6c154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:58.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.462+0000 7f9c6aa00640 1 -- 172.21.15.19:0/2241037422 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c6c074780 msgr2=0x7f9c6c154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:58.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.462+0000 7f9c6aa00640 1 --2- 172.21.15.19:0/2241037422 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c6c074780 0x7f9c6c154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.462+0000 7f9c6aa00640 1 -- 172.21.15.19:0/2241037422 >> v1:172.21.15.112:6789/0 conn(0x7f9c6c0c8510 legacy=0x7f9c6c073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:58.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.462+0000 7f9c6aa00640 1 -- 172.21.15.19:0/2241037422 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6c0731b0 con 0x7f9c6c0c8100 2024-04-25T10:25:58.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.462+0000 7f9c6a000640 1 -- 172.21.15.19:0/2241037422 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886154369 0 0) 0x7f9c6c073770 con 0x7f9c6c0c8510 2024-04-25T10:25:58.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.464+0000 7f9c6aa00640 1 --2- 172.21.15.19:0/2241037422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c6c0c8100 0x7f9c6c15a1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009870 tx=0x7f9c5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad354aa4569c7fe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:58.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.464+0000 7f9c6a000640 1 -- 172.21.15.19:0/2241037422 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58037070 con 0x7f9c6c0c8100 2024-04-25T10:25:58.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.464+0000 7f9c6a000640 1 -- 172.21.15.19:0/2241037422 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c58032440 con 0x7f9c6c0c8100 2024-04-25T10:25:58.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.464+0000 7f9c6a000640 1 -- 172.21.15.19:0/2241037422 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58032810 con 0x7f9c6c0c8100 2024-04-25T10:25:58.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.465+0000 7f9c70a00640 1 -- 172.21.15.19:0/2241037422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c6c0c8100 msgr2=0x7f9c6c15a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:58.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.465+0000 7f9c70a00640 1 --2- 172.21.15.19:0/2241037422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c6c0c8100 0x7f9c6c15a1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009870 tx=0x7f9c5802a270 comp rx=0 tx=0).stop 2024-04-25T10:25:58.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.465+0000 7f9c70a00640 1 -- 172.21.15.19:0/2241037422 shutdown_connections 2024-04-25T10:25:58.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.465+0000 7f9c70a00640 1 --2- 172.21.15.19:0/2241037422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c6c0c8100 0x7f9c6c15a1f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.465+0000 7f9c70a00640 1 --2- 172.21.15.19:0/2241037422 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c6c074780 0x7f9c6c154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.465+0000 7f9c70a00640 1 -- 172.21.15.19:0/2241037422 >> 172.21.15.19:0/2241037422 conn(0x7f9c6c06d120 msgr2=0x7f9c6c0cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:58.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.465+0000 7f9c70a00640 1 -- 172.21.15.19:0/2241037422 shutdown_connections 2024-04-25T10:25:58.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.465+0000 7f9c70a00640 1 -- 172.21.15.19:0/2241037422 wait complete. 2024-04-25T10:25:58.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.467+0000 7f9c70a00640 1 Processor -- start 2024-04-25T10:25:58.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.467+0000 7f9c70a00640 1 -- start start 2024-04-25T10:25:58.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.469+0000 7f9c70a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c6c074780 0x7f9c6c1f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:58.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.469+0000 7f9c70a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c6c0c8100 0x7f9c6c15d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:58.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.469+0000 7f9c70a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c6c0af040 0x7f9c6c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:58.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.469+0000 7f9c70a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c0c8e90 con 0x7f9c6c0c8100 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.469+0000 7f9c70a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c0c8bb0 con 0x7f9c6c074780 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.469+0000 7f9c70a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9c6c154880 con 0x7f9c6c0af040 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.469+0000 7f9c6aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c6c0c8100 0x7f9c6c15d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.469+0000 7f9c6b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c6c074780 0x7f9c6c1f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.469+0000 7f9c6aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c6c0c8100 0x7f9c6c15d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50644/0 (socket says 172.21.15.19:50644) 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.469+0000 7f9c6aa00640 1 -- 172.21.15.19:0/1648848076 learned_addr learned my addr 172.21.15.19:0/1648848076 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.469+0000 7f9c6be00640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c6c0af040 0x7f9c6c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c6b400640 1 -- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c6c0af040 msgr2=0x7f9c6c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c6b400640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c6c0af040 0x7f9c6c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c6b400640 1 -- 172.21.15.19:0/1648848076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c6c0c8100 msgr2=0x7f9c6c15d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c6b400640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c6c0c8100 0x7f9c6c15d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c6b400640 1 -- 172.21.15.19:0/1648848076 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6c1f4240 con 0x7f9c6c074780 2024-04-25T10:25:58.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c6aa00640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c6c0c8100 0x7f9c6c15d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:58.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c6b400640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c6c074780 0x7f9c6c1f3d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00ebc0 tx=0x7f9c5c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:58.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c63400640 1 -- 172.21.15.19:0/1648848076 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c018020 con 0x7f9c6c074780 2024-04-25T10:25:58.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c63400640 1 -- 172.21.15.19:0/1648848076 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5c00cda0 con 0x7f9c6c074780 2024-04-25T10:25:58.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c63400640 1 -- 172.21.15.19:0/1648848076 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0146c0 con 0x7f9c6c074780 2024-04-25T10:25:58.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c70a00640 1 -- 172.21.15.19:0/1648848076 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c6c0b0790 con 0x7f9c6c074780 2024-04-25T10:25:58.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.470+0000 7f9c70a00640 1 -- 172.21.15.19:0/1648848076 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c6c0b0d50 con 0x7f9c6c074780 2024-04-25T10:25:58.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.471+0000 7f9c70a00640 1 -- 172.21.15.19:0/1648848076 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c6c0b0f90 con 0x7f9c6c074780 2024-04-25T10:25:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.473+0000 7f9c63400640 1 -- 172.21.15.19:0/1648848076 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9c5c005d10 con 0x7f9c6c074780 2024-04-25T10:25:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.474+0000 7f9c63400640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c4c0744b0 0x7f9c4c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.474+0000 7f9c63400640 1 -- 172.21.15.19:0/1648848076 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9c5c096110 con 0x7f9c6c074780 2024-04-25T10:25:58.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.474+0000 7f9c6aa00640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c4c0744b0 0x7f9c4c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:58.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.475+0000 7f9c6aa00640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c4c0744b0 0x7f9c4c0769c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c58000c00 tx=0x7f9c5802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:58.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.479+0000 7f9c63400640 1 -- 172.21.15.19:0/1648848076 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c6c0b0f90 con 0x7f9c6c074780 2024-04-25T10:25:58.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.688+0000 7f9c70a00640 1 -- 172.21.15.19:0/1648848076 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9c6c076520 con 0x7f9c6c074780 2024-04-25T10:25:58.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.689+0000 7f9c63400640 1 -- 172.21.15.19:0/1648848076 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f9c5c022030 con 0x7f9c6c074780 2024-04-25T10:25:58.692 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 -- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c4c0744b0 msgr2=0x7f9c4c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c4c0744b0 0x7f9c4c0769c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c58000c00 tx=0x7f9c5802e000 comp rx=0 tx=0).stop 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 -- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c6c074780 msgr2=0x7f9c6c1f3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c6c074780 0x7f9c6c1f3d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00ebc0 tx=0x7f9c5c00c490 comp rx=0 tx=0).stop 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 -- 172.21.15.19:0/1648848076 shutdown_connections 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c4c0744b0 0x7f9c4c0769c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c6c0af040 0x7f9c6c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c6c0c8100 0x7f9c6c15d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 --2- 172.21.15.19:0/1648848076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c6c074780 0x7f9c6c1f3d00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 -- 172.21.15.19:0/1648848076 >> 172.21.15.19:0/1648848076 conn(0x7f9c6c06d120 msgr2=0x7f9c6c073b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 -- 172.21.15.19:0/1648848076 shutdown_connections 2024-04-25T10:25:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:58.692+0000 7f9c70a00640 1 -- 172.21.15.19:0/1648848076 wait complete. 2024-04-25T10:25:58.721 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:25:59.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.005+0000 7effba600640 1 Processor -- start 2024-04-25T10:25:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.006+0000 7effba600640 1 -- start start 2024-04-25T10:25:59.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.008+0000 7effba600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7effb4154480 0x7effb40c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.008+0000 7effba600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effb40ca9a0 0x7effb4164af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.008+0000 7effba600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb415e6e0 con 0x7effb40ca590 2024-04-25T10:25:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.008+0000 7effba600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7effb415a380 con 0x7effb40ca9a0 2024-04-25T10:25:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.008+0000 7effba600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7effb4154890 con 0x7effb4154480 2024-04-25T10:25:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.009+0000 7effb9200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7effb4154480 0x7effb40c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.009+0000 7effb3e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7effb40ca590 0x7effb415a810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:54002/0 (socket says 172.21.15.19:54002) 2024-04-25T10:25:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.009+0000 7effb9200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7effb4154480 0x7effb40c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:35594/0 (socket says 172.21.15.19:35594) 2024-04-25T10:25:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.009+0000 7effb3e00640 1 -- 172.21.15.19:0/1522302325 learned_addr learned my addr 172.21.15.19:0/1522302325 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.009+0000 7effb9c00640 1 --2- 172.21.15.19:0/1522302325 >> v2:172.21.15.19:3300/0 conn(0x7effb40ca9a0 0x7effb4164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.009+0000 7effb9200640 1 -- 172.21.15.19:0/1522302325 >> v2:172.21.15.19:3300/0 conn(0x7effb40ca9a0 msgr2=0x7effb4164af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.009+0000 7effb9200640 1 --2- 172.21.15.19:0/1522302325 >> v2:172.21.15.19:3300/0 conn(0x7effb40ca9a0 0x7effb4164af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.009+0000 7effb9200640 1 -- 172.21.15.19:0/1522302325 >> v1:172.21.15.112:6789/0 conn(0x7effb40ca590 legacy=0x7effb415a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.009+0000 7effb9200640 1 -- 172.21.15.19:0/1522302325 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb415db80 con 0x7effb4154480 2024-04-25T10:25:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.010+0000 7effb9200640 1 --2- 172.21.15.19:0/1522302325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb4154480 0x7effb40c47c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7effb40ccfb0 tx=0x7effa802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a036e37c665e71e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:59.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.011+0000 7effb3400640 1 -- 172.21.15.19:0/1522302325 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8037070 con 0x7effb4154480 2024-04-25T10:25:59.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.011+0000 7effb3400640 1 -- 172.21.15.19:0/1522302325 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa8032440 con 0x7effb4154480 2024-04-25T10:25:59.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.011+0000 7effb3400640 1 -- 172.21.15.19:0/1522302325 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8032810 con 0x7effb4154480 2024-04-25T10:25:59.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.011+0000 7effba600640 1 -- 172.21.15.19:0/1522302325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb4154480 msgr2=0x7effb40c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.011+0000 7effba600640 1 --2- 172.21.15.19:0/1522302325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb4154480 0x7effb40c47c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7effb40ccfb0 tx=0x7effa802a230 comp rx=0 tx=0).stop 2024-04-25T10:25:59.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.012+0000 7effba600640 1 -- 172.21.15.19:0/1522302325 shutdown_connections 2024-04-25T10:25:59.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.012+0000 7effba600640 1 --2- 172.21.15.19:0/1522302325 >> v2:172.21.15.19:3300/0 conn(0x7effb40ca9a0 0x7effb4164af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.012+0000 7effba600640 1 --2- 172.21.15.19:0/1522302325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb4154480 0x7effb40c47c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.012+0000 7effba600640 1 -- 172.21.15.19:0/1522302325 >> 172.21.15.19:0/1522302325 conn(0x7effb40719c0 msgr2=0x7effb4068460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:59.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.012+0000 7effba600640 1 -- 172.21.15.19:0/1522302325 shutdown_connections 2024-04-25T10:25:59.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.012+0000 7effba600640 1 -- 172.21.15.19:0/1522302325 wait complete. 2024-04-25T10:25:59.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.014+0000 7effba600640 1 Processor -- start 2024-04-25T10:25:59.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.014+0000 7effba600640 1 -- start start 2024-04-25T10:25:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effba600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb40ca590 0x7effb41f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effba600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effb40ca9a0 0x7effb41581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effba600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effb4154480 0x7effb4149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effba600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7effb415e400 con 0x7effb40ca9a0 2024-04-25T10:25:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effba600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7effb415e120 con 0x7effb40ca590 2024-04-25T10:25:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effba600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7effb40cadb0 con 0x7effb4154480 2024-04-25T10:25:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effb9200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb40ca590 0x7effb41f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effb3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effb40ca9a0 0x7effb41581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effb9200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb40ca590 0x7effb41f0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:35600/0 (socket says 172.21.15.19:35600) 2024-04-25T10:25:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effb9200640 1 -- 172.21.15.19:0/533998750 learned_addr learned my addr 172.21.15.19:0/533998750 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effb9c00640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effb4154480 0x7effb4149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effb9200640 1 -- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effb4154480 msgr2=0x7effb4149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.016+0000 7effb9200640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effb4154480 0x7effb4149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.017+0000 7effb9200640 1 -- 172.21.15.19:0/533998750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effb40ca9a0 msgr2=0x7effb41581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.017+0000 7effb9200640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effb40ca9a0 0x7effb41581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.017+0000 7effb9200640 1 -- 172.21.15.19:0/533998750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb41f1200 con 0x7effb40ca590 2024-04-25T10:25:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.017+0000 7effb9200640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb40ca590 0x7effb41f0cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7effa8000c00 tx=0x7effa80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.017+0000 7effb0c00640 1 -- 172.21.15.19:0/533998750 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8037040 con 0x7effb40ca590 2024-04-25T10:25:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.017+0000 7effb0c00640 1 -- 172.21.15.19:0/533998750 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa8042070 con 0x7effb40ca590 2024-04-25T10:25:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.017+0000 7effba600640 1 -- 172.21.15.19:0/533998750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb41e5c60 con 0x7effb40ca590 2024-04-25T10:25:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.017+0000 7effb0c00640 1 -- 172.21.15.19:0/533998750 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8030bd0 con 0x7effb40ca590 2024-04-25T10:25:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.017+0000 7effba600640 1 -- 172.21.15.19:0/533998750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb41e6220 con 0x7effb40ca590 2024-04-25T10:25:59.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.018+0000 7effba600640 1 -- 172.21.15.19:0/533998750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb4076520 con 0x7effb40ca590 2024-04-25T10:25:59.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.020+0000 7effb0c00640 1 -- 172.21.15.19:0/533998750 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7effa8047460 con 0x7effb40ca590 2024-04-25T10:25:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.021+0000 7effb0c00640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff940744b0 0x7eff940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.021+0000 7effb0c00640 1 -- 172.21.15.19:0/533998750 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7effa80b64b0 con 0x7effb40ca590 2024-04-25T10:25:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.021+0000 7effb3e00640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff940744b0 0x7eff940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.022+0000 7effb3e00640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff940744b0 0x7eff940769c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7effb40b5230 tx=0x7effa0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:59.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.024+0000 7effb0c00640 1 -- 172.21.15.19:0/533998750 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7effa8032e20 con 0x7effb40ca590 2024-04-25T10:25:59.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.230+0000 7effba600640 1 -- 172.21.15.19:0/533998750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7effb4150ad0 con 0x7effb40ca590 2024-04-25T10:25:59.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.231+0000 7effb0c00640 1 -- 172.21.15.19:0/533998750 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7effa8080320 con 0x7effb40ca590 2024-04-25T10:25:59.234 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:25:59.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 -- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff940744b0 msgr2=0x7eff940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff940744b0 0x7eff940769c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7effb40b5230 tx=0x7effa0009040 comp rx=0 tx=0).stop 2024-04-25T10:25:59.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 -- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb40ca590 msgr2=0x7effb41f0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb40ca590 0x7effb41f0cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7effa8000c00 tx=0x7effa80046c0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 -- 172.21.15.19:0/533998750 shutdown_connections 2024-04-25T10:25:59.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7eff940744b0 0x7eff940769c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effb4154480 0x7effb4149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effb40ca9a0 0x7effb41581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 --2- 172.21.15.19:0/533998750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb40ca590 0x7effb41f0cc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 -- 172.21.15.19:0/533998750 >> 172.21.15.19:0/533998750 conn(0x7effb40719c0 msgr2=0x7effb40c4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 -- 172.21.15.19:0/533998750 shutdown_connections 2024-04-25T10:25:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.234+0000 7effba600640 1 -- 172.21.15.19:0/533998750 wait complete. 2024-04-25T10:25:59.266 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:25:59.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:25:59.478 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:25:59.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.540+0000 7f3f07600640 1 Processor -- start 2024-04-25T10:25:59.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.541+0000 7f3f07600640 1 -- start start 2024-04-25T10:25:59.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.543+0000 7f3f07600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f000c7c50 0x7f3f000cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.543+0000 7f3f07600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3f000ce360 0x7f3f000ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.543+0000 7f3f07600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f000cd340 con 0x7f3f0015c5c0 2024-04-25T10:25:59.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.543+0000 7f3f07600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3f000b49e0 con 0x7f3f000ce360 2024-04-25T10:25:59.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.543+0000 7f3f07600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3f000cd5e0 con 0x7f3f000c7c50 2024-04-25T10:25:59.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.543+0000 7f3f04c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f000c7c50 0x7f3f000cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.543+0000 7f3f05600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3f000ce360 0x7f3f000ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.543+0000 7f3effe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3f0015c5c0 0x7f3f0015c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:54012/0 (socket says 172.21.15.19:54012) 2024-04-25T10:25:59.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.543+0000 7f3effe00640 1 -- 172.21.15.19:0/1374347084 learned_addr learned my addr 172.21.15.19:0/1374347084 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:25:59.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.544+0000 7f3f05600640 1 -- 172.21.15.19:0/1374347084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f000c7c50 msgr2=0x7f3f000cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:25:59.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.544+0000 7f3f05600640 1 --2- 172.21.15.19:0/1374347084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f000c7c50 0x7f3f000cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.544+0000 7f3f05600640 1 -- 172.21.15.19:0/1374347084 >> v1:172.21.15.112:6789/0 conn(0x7f3f0015c5c0 legacy=0x7f3f0015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.544+0000 7f3f05600640 1 -- 172.21.15.19:0/1374347084 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f000cd8c0 con 0x7f3f000ce360 2024-04-25T10:25:59.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.544+0000 7f3f04c00640 1 --2- 172.21.15.19:0/1374347084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f000c7c50 0x7f3f000cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:25:59.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.544+0000 7f3eff400640 1 -- 172.21.15.19:0/1374347084 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785646402 0 0) 0x7f3f000cd340 con 0x7f3f0015c5c0 2024-04-25T10:25:59.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.545+0000 7f3f05600640 1 --2- 172.21.15.19:0/1374347084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f000ce360 0x7f3f000ce770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009d90 tx=0x7f3ef802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45061a2f132aebfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:59.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.545+0000 7f3eff400640 1 -- 172.21.15.19:0/1374347084 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8007740 con 0x7f3f000ce360 2024-04-25T10:25:59.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.545+0000 7f3eff400640 1 -- 172.21.15.19:0/1374347084 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef80078e0 con 0x7f3f000ce360 2024-04-25T10:25:59.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.545+0000 7f3eff400640 1 -- 172.21.15.19:0/1374347084 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8007cb0 con 0x7f3f000ce360 2024-04-25T10:25:59.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.546+0000 7f3f07600640 1 -- 172.21.15.19:0/1374347084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f000ce360 msgr2=0x7f3f000ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.546+0000 7f3f07600640 1 --2- 172.21.15.19:0/1374347084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f000ce360 0x7f3f000ce770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009d90 tx=0x7f3ef802a660 comp rx=0 tx=0).stop 2024-04-25T10:25:59.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.546+0000 7f3f07600640 1 -- 172.21.15.19:0/1374347084 shutdown_connections 2024-04-25T10:25:59.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.546+0000 7f3f07600640 1 --2- 172.21.15.19:0/1374347084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f000ce360 0x7f3f000ce770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.546+0000 7f3f07600640 1 --2- 172.21.15.19:0/1374347084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f000c7c50 0x7f3f000cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.546+0000 7f3f07600640 1 -- 172.21.15.19:0/1374347084 >> 172.21.15.19:0/1374347084 conn(0x7f3f0006f2c0 msgr2=0x7f3f00068460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:59.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.546+0000 7f3f07600640 1 -- 172.21.15.19:0/1374347084 shutdown_connections 2024-04-25T10:25:59.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.546+0000 7f3f07600640 1 -- 172.21.15.19:0/1374347084 wait complete. 2024-04-25T10:25:59.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.549+0000 7f3f07600640 1 Processor -- start 2024-04-25T10:25:59.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.549+0000 7f3f07600640 1 -- start start 2024-04-25T10:25:59.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.550+0000 7f3f07600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f000c7c50 0x7f3f0015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.550+0000 7f3f07600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f000ce360 0x7f3f001577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.550+0000 7f3f07600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f0015c5c0 0x7f3f001f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.550+0000 7f3f07600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3f000ccbf0 con 0x7f3f0015c5c0 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.550+0000 7f3f07600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3f000cde80 con 0x7f3f000c7c50 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.550+0000 7f3f07600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3f001531c0 con 0x7f3f000ce360 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.551+0000 7f3f04c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f000c7c50 0x7f3f0015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.551+0000 7f3effe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f000ce360 0x7f3f001577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.551+0000 7f3f04c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f000c7c50 0x7f3f0015d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:35614/0 (socket says 172.21.15.19:35614) 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.551+0000 7f3f04c00640 1 -- 172.21.15.19:0/3995346300 learned_addr learned my addr 172.21.15.19:0/3995346300 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.551+0000 7f3f05600640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f0015c5c0 0x7f3f001f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.551+0000 7f3f04c00640 1 -- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f000ce360 msgr2=0x7f3f001577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.551+0000 7f3f04c00640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f000ce360 0x7f3f001577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.551+0000 7f3f04c00640 1 -- 172.21.15.19:0/3995346300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f0015c5c0 msgr2=0x7f3f001f6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.551+0000 7f3f04c00640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f0015c5c0 0x7f3f001f6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.551+0000 7f3f04c00640 1 -- 172.21.15.19:0/3995346300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f00157d20 con 0x7f3f000c7c50 2024-04-25T10:25:59.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.551+0000 7f3f04c00640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f000c7c50 0x7f3f0015d6a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400e960 tx=0x7f3ef400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:59.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.552+0000 7f3efcc00640 1 -- 172.21.15.19:0/3995346300 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4017070 con 0x7f3f000c7c50 2024-04-25T10:25:59.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.552+0000 7f3efcc00640 1 -- 172.21.15.19:0/3995346300 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef400ca00 con 0x7f3f000c7c50 2024-04-25T10:25:59.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.552+0000 7f3efcc00640 1 -- 172.21.15.19:0/3995346300 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef400cdd0 con 0x7f3f000c7c50 2024-04-25T10:25:59.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.552+0000 7f3f07600640 1 -- 172.21.15.19:0/3995346300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f00159cd0 con 0x7f3f000c7c50 2024-04-25T10:25:59.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.552+0000 7f3f07600640 1 -- 172.21.15.19:0/3995346300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f000c8b20 con 0x7f3f000c7c50 2024-04-25T10:25:59.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.553+0000 7f3f07600640 1 -- 172.21.15.19:0/3995346300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f00074780 con 0x7f3f000c7c50 2024-04-25T10:25:59.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.554+0000 7f3efcc00640 1 -- 172.21.15.19:0/3995346300 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3ef401a070 con 0x7f3f000c7c50 2024-04-25T10:25:59.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.555+0000 7f3efcc00640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3ee00744e0 0x7f3ee00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:25:59.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.555+0000 7f3efcc00640 1 -- 172.21.15.19:0/3995346300 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3ef4095310 con 0x7f3f000c7c50 2024-04-25T10:25:59.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.556+0000 7f3effe00640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3ee00744e0 0x7f3ee00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:25:59.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.556+0000 7f3effe00640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3ee00744e0 0x7f3ee00769f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f00152a80 tx=0x7f3eec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:25:59.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.560+0000 7f3efcc00640 1 -- 172.21.15.19:0/3995346300 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3f00074780 con 0x7f3f000c7c50 2024-04-25T10:25:59.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.784+0000 7f3f07600640 1 -- 172.21.15.19:0/3995346300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3f0015ac70 con 0x7f3f000c7c50 2024-04-25T10:25:59.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.785+0000 7f3efcc00640 1 -- 172.21.15.19:0/3995346300 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f3f0015ac70 con 0x7f3f000c7c50 2024-04-25T10:25:59.788 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-04-25T10:25:59.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 -- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3ee00744e0 msgr2=0x7f3ee00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3ee00744e0 0x7f3ee00769f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f00152a80 tx=0x7f3eec009040 comp rx=0 tx=0).stop 2024-04-25T10:25:59.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 -- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f000c7c50 msgr2=0x7f3f0015d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:25:59.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f000c7c50 0x7f3f0015d6a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400e960 tx=0x7f3ef400ee20 comp rx=0 tx=0).stop 2024-04-25T10:25:59.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 -- 172.21.15.19:0/3995346300 shutdown_connections 2024-04-25T10:25:59.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f0015c5c0 0x7f3f001f6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3ee00744e0 0x7f3ee00769f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f000ce360 0x7f3f001577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 --2- 172.21.15.19:0/3995346300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f000c7c50 0x7f3f0015d6a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:25:59.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 -- 172.21.15.19:0/3995346300 >> 172.21.15.19:0/3995346300 conn(0x7f3f0006f2c0 msgr2=0x7f3f0015c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:25:59.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 -- 172.21.15.19:0/3995346300 shutdown_connections 2024-04-25T10:25:59.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:25:59.788+0000 7f3f07600640 1 -- 172.21.15.19:0/3995346300 wait complete. 2024-04-25T10:25:59.816 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-04-25T10:25:59.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:25:59.816 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:25:59.880 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi019.stderr:ceph-fuse[39859]: fuse finished with error 0 and tester_r 0 2024-04-25T10:25:59.885 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:26:05.987 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:26:05.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:26:05.987 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T10:26:06.060 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:06.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.353+0000 7f4423200640 1 Processor -- start 2024-04-25T10:26:06.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.353+0000 7f4423200640 1 -- start start 2024-04-25T10:26:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.355+0000 7f4423200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 0x7f441c072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.355+0000 7f4423200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f441c0c2a50 0x7f441c163950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.355+0000 7f4423200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441c0c8340 con 0x7f441c0c2640 2024-04-25T10:26:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.355+0000 7f4423200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f441c0c9dc0 con 0x7f441c0c2a50 2024-04-25T10:26:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.355+0000 7f4423200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f441c15c680 con 0x7f441c1532c0 2024-04-25T10:26:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.355+0000 7f4421e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 0x7f441c072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.355+0000 7f4421400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f441c0c2640 0x7f441c0c2fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:54022/0 (socket says 172.21.15.19:54022) 2024-04-25T10:26:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.355+0000 7f4421400640 1 -- 172.21.15.19:0/615026024 learned_addr learned my addr 172.21.15.19:0/615026024 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.355+0000 7f4422800640 1 --2- 172.21.15.19:0/615026024 >> v2:172.21.15.19:3300/0 conn(0x7f441c0c2a50 0x7f441c163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.356+0000 7f4422800640 1 -- 172.21.15.19:0/615026024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 msgr2=0x7f441c072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.356+0000 7f4422800640 1 --2- 172.21.15.19:0/615026024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 0x7f441c072ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.356+0000 7f4422800640 1 -- 172.21.15.19:0/615026024 >> v1:172.21.15.112:6789/0 conn(0x7f441c0c2640 legacy=0x7f441c0c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.356+0000 7f4420a00640 1 -- 172.21.15.19:0/615026024 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 113432857 0 0) 0x7f441c0c8340 con 0x7f441c0c2640 2024-04-25T10:26:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.356+0000 7f4422800640 1 -- 172.21.15.19:0/615026024 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441c15c960 con 0x7f441c0c2a50 2024-04-25T10:26:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.356+0000 7f4421e00640 1 --2- 172.21.15.19:0/615026024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 0x7f441c072ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.357+0000 7f4422800640 1 --2- 172.21.15.19:0/615026024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441c0c2a50 0x7f441c163950 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4418009d90 tx=0x7f441802c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d779f58bb200133 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.357+0000 7f4420a00640 1 -- 172.21.15.19:0/615026024 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418032770 con 0x7f441c0c2a50 2024-04-25T10:26:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.357+0000 7f4420a00640 1 -- 172.21.15.19:0/615026024 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4418038070 con 0x7f441c0c2a50 2024-04-25T10:26:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.357+0000 7f4420a00640 1 -- 172.21.15.19:0/615026024 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418032b30 con 0x7f441c0c2a50 2024-04-25T10:26:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.358+0000 7f4423200640 1 -- 172.21.15.19:0/615026024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441c0c2a50 msgr2=0x7f441c163950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.358+0000 7f4423200640 1 --2- 172.21.15.19:0/615026024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441c0c2a50 0x7f441c163950 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4418009d90 tx=0x7f441802c870 comp rx=0 tx=0).stop 2024-04-25T10:26:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.358+0000 7f4423200640 1 -- 172.21.15.19:0/615026024 shutdown_connections 2024-04-25T10:26:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.358+0000 7f4423200640 1 --2- 172.21.15.19:0/615026024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441c0c2a50 0x7f441c163950 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.358+0000 7f4423200640 1 --2- 172.21.15.19:0/615026024 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 0x7f441c072ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.358+0000 7f4423200640 1 -- 172.21.15.19:0/615026024 >> 172.21.15.19:0/615026024 conn(0x7f441c0cdbc0 msgr2=0x7f441c0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.358+0000 7f4423200640 1 -- 172.21.15.19:0/615026024 shutdown_connections 2024-04-25T10:26:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.358+0000 7f4423200640 1 -- 172.21.15.19:0/615026024 wait complete. 2024-04-25T10:26:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.361+0000 7f4423200640 1 Processor -- start 2024-04-25T10:26:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.361+0000 7f4423200640 1 -- start start 2024-04-25T10:26:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.362+0000 7f4423200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441c0c2640 0x7f441c1f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.362+0000 7f4423200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f441c0c2a50 0x7f441c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.362+0000 7f4423200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 0x7f441c1e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.362+0000 7f4423200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f441c15d440 con 0x7f441c0c2640 2024-04-25T10:26:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.362+0000 7f4423200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f441c15cf20 con 0x7f441c0c2a50 2024-04-25T10:26:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.362+0000 7f4423200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f441c0c8620 con 0x7f441c1532c0 2024-04-25T10:26:06.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.363+0000 7f4421e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441c0c2640 0x7f441c1f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:06.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.363+0000 7f4422800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 0x7f441c1e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:06.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.363+0000 7f4421e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441c0c2640 0x7f441c1f2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50684/0 (socket says 172.21.15.19:50684) 2024-04-25T10:26:06.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.363+0000 7f4421e00640 1 -- 172.21.15.19:0/2599106443 learned_addr learned my addr 172.21.15.19:0/2599106443 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:06.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.363+0000 7f4421400640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f441c0c2a50 0x7f441c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.363+0000 7f4422800640 1 -- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f441c0c2a50 msgr2=0x7f441c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.363+0000 7f4422800640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f441c0c2a50 0x7f441c15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.363+0000 7f4422800640 1 -- 172.21.15.19:0/2599106443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441c0c2640 msgr2=0x7f441c1f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.363+0000 7f4422800640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441c0c2640 0x7f441c1f2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.363+0000 7f4422800640 1 -- 172.21.15.19:0/2599106443 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441c14fad0 con 0x7f441c1532c0 2024-04-25T10:26:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.363+0000 7f4421e00640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441c0c2640 0x7f441c1f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.364+0000 7f4422800640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 0x7f441c1e77e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4418034000 tx=0x7f4418004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:06.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.364+0000 7f4416000640 1 -- 172.21.15.19:0/2599106443 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418033810 con 0x7f441c1532c0 2024-04-25T10:26:06.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.364+0000 7f4416000640 1 -- 172.21.15.19:0/2599106443 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44180339b0 con 0x7f441c1532c0 2024-04-25T10:26:06.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.364+0000 7f4416000640 1 -- 172.21.15.19:0/2599106443 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418033da0 con 0x7f441c1532c0 2024-04-25T10:26:06.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.364+0000 7f4423200640 1 -- 172.21.15.19:0/2599106443 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441c0b1f60 con 0x7f441c1532c0 2024-04-25T10:26:06.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.364+0000 7f4423200640 1 -- 172.21.15.19:0/2599106443 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f441c150070 con 0x7f441c1532c0 2024-04-25T10:26:06.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.365+0000 7f4423200640 1 -- 172.21.15.19:0/2599106443 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441c151310 con 0x7f441c1532c0 2024-04-25T10:26:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.366+0000 7f4416000640 1 -- 172.21.15.19:0/2599106443 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4418032070 con 0x7f441c1532c0 2024-04-25T10:26:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.367+0000 7f4416000640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f43fc0744b0 0x7f43fc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.367+0000 7f4416000640 1 -- 172.21.15.19:0/2599106443 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f44180b6180 con 0x7f441c1532c0 2024-04-25T10:26:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.368+0000 7f4421e00640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f43fc0744b0 0x7f43fc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.368+0000 7f4421e00640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f43fc0744b0 0x7f43fc0769c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f44100095e0 tx=0x7f4410009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.373+0000 7f4416000640 1 -- 172.21.15.19:0/2599106443 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f441c151310 con 0x7f441c1532c0 2024-04-25T10:26:06.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.580+0000 7f4423200640 1 -- 172.21.15.19:0/2599106443 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f441c050740 con 0x7f441c1532c0 2024-04-25T10:26:06.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.582+0000 7f4416000640 1 -- 172.21.15.19:0/2599106443 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18518 (secure 0 0 0) 0x7f441807fee0 con 0x7f441c1532c0 2024-04-25T10:26:06.585 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:06.586 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:41.790347+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:06.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 -- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f43fc0744b0 msgr2=0x7f43fc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:06.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f43fc0744b0 0x7f43fc0769c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f44100095e0 tx=0x7f4410009190 comp rx=0 tx=0).stop 2024-04-25T10:26:06.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 -- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 msgr2=0x7f441c1e77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:06.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 0x7f441c1e77e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4418034000 tx=0x7f4418004ab0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 -- 172.21.15.19:0/2599106443 shutdown_connections 2024-04-25T10:26:06.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f43fc0744b0 0x7f43fc0769c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f441c1532c0 0x7f441c1e77e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f441c0c2a50 0x7f441c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 --2- 172.21.15.19:0/2599106443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441c0c2640 0x7f441c1f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 -- 172.21.15.19:0/2599106443 >> 172.21.15.19:0/2599106443 conn(0x7f441c0cdbc0 msgr2=0x7f441c150b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:06.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 -- 172.21.15.19:0/2599106443 shutdown_connections 2024-04-25T10:26:06.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.585+0000 7f4423200640 1 -- 172.21.15.19:0/2599106443 wait complete. 2024-04-25T10:26:06.616 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:06.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.901+0000 7f62b3e00640 1 Processor -- start 2024-04-25T10:26:06.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.901+0000 7f62b3e00640 1 -- start start 2024-04-25T10:26:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.903+0000 7f62b3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62b415a370 0x7f62b4070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.903+0000 7f62b3e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b415a8b0 con 0x7f62b4073d20 2024-04-25T10:26:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.903+0000 7f62b3e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b415ab70 con 0x7f62b40c7f90 2024-04-25T10:26:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.903+0000 7f62b3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f62b4072ea0 con 0x7f62b415a370 2024-04-25T10:26:06.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.904+0000 7f62b2a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62b415a370 0x7f62b4070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:06.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.904+0000 7f62b3400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f62b4073d20 0x7f62b4154060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38584/0 (socket says 172.21.15.19:38584) 2024-04-25T10:26:06.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.904+0000 7f62b3400640 1 -- 172.21.15.19:0/3276297650 learned_addr learned my addr 172.21.15.19:0/3276297650 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:06.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.904+0000 7f62abe00640 1 --1- 172.21.15.19:0/3276297650 >> v1:172.21.15.112:6789/0 conn(0x7f62b40c7f90 0x7f62b4073610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:54026/0 (socket says 172.21.15.19:54026) 2024-04-25T10:26:06.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.904+0000 7f62b2a00640 1 -- 172.21.15.19:0/3276297650 >> v1:172.21.15.112:6789/0 conn(0x7f62b40c7f90 legacy=0x7f62b4073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:06.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.904+0000 7f62b2a00640 1 -- 172.21.15.19:0/3276297650 >> v1:172.21.15.19:6789/0 conn(0x7f62b4073d20 legacy=0x7f62b4154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:06.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.904+0000 7f62b2a00640 1 -- 172.21.15.19:0/3276297650 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b415ae50 con 0x7f62b415a370 2024-04-25T10:26:06.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.904+0000 7f62b2000640 1 -- 172.21.15.19:0/3276297650 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459369117 0 0) 0x7f62b415a8b0 con 0x7f62b4073d20 2024-04-25T10:26:06.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.905+0000 7f62b2a00640 1 --2- 172.21.15.19:0/3276297650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62b415a370 0x7f62b4070860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f62a40097d0 tx=0x7f62a402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9068f9f7767814c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:06.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.906+0000 7f62b2000640 1 -- 172.21.15.19:0/3276297650 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4037070 con 0x7f62b415a370 2024-04-25T10:26:06.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.906+0000 7f62b2000640 1 -- 172.21.15.19:0/3276297650 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a4032440 con 0x7f62b415a370 2024-04-25T10:26:06.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.906+0000 7f62b2000640 1 -- 172.21.15.19:0/3276297650 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4032810 con 0x7f62b415a370 2024-04-25T10:26:06.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.906+0000 7f62b3e00640 1 -- 172.21.15.19:0/3276297650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62b415a370 msgr2=0x7f62b4070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:06.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.906+0000 7f62b3e00640 1 --2- 172.21.15.19:0/3276297650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62b415a370 0x7f62b4070860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f62a40097d0 tx=0x7f62a402a1a0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.907+0000 7f62b3e00640 1 -- 172.21.15.19:0/3276297650 shutdown_connections 2024-04-25T10:26:06.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.907+0000 7f62b3e00640 1 --2- 172.21.15.19:0/3276297650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62b415a370 0x7f62b4070860 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.907+0000 7f62b3e00640 1 -- 172.21.15.19:0/3276297650 >> 172.21.15.19:0/3276297650 conn(0x7f62b40cdbc0 msgr2=0x7f62b40ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:06.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.907+0000 7f62b3e00640 1 -- 172.21.15.19:0/3276297650 shutdown_connections 2024-04-25T10:26:06.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.907+0000 7f62b3e00640 1 -- 172.21.15.19:0/3276297650 wait complete. 2024-04-25T10:26:06.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.909+0000 7f62b3e00640 1 Processor -- start 2024-04-25T10:26:06.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.909+0000 7f62b3e00640 1 -- start start 2024-04-25T10:26:06.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.911+0000 7f62b3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b40c7f90 0x7f62b4148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:06.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.911+0000 7f62b3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62b415a370 0x7f62b40cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:06.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.911+0000 7f62b3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b41e41a0 0x7f62b40cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:06.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.911+0000 7f62b3e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f62b40c4b20 con 0x7f62b41e41a0 2024-04-25T10:26:06.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.911+0000 7f62b3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f62b4073180 con 0x7f62b40c7f90 2024-04-25T10:26:06.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.911+0000 7f62b3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f62b4070da0 con 0x7f62b415a370 2024-04-25T10:26:06.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.911+0000 7f62b3400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b41e41a0 0x7f62b40cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:06.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.911+0000 7f62b3400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b41e41a0 0x7f62b40cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50692/0 (socket says 172.21.15.19:50692) 2024-04-25T10:26:06.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.911+0000 7f62b2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b40c7f90 0x7f62b4148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:06.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.911+0000 7f62b3400640 1 -- 172.21.15.19:0/886178285 learned_addr learned my addr 172.21.15.19:0/886178285 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:06.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.911+0000 7f62abe00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62b415a370 0x7f62b40cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:06.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.912+0000 7f62b2a00640 1 -- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62b415a370 msgr2=0x7f62b40cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:06.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.912+0000 7f62b2a00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62b415a370 0x7f62b40cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.912+0000 7f62b2a00640 1 -- 172.21.15.19:0/886178285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b41e41a0 msgr2=0x7f62b40cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:06.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.912+0000 7f62b2a00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b41e41a0 0x7f62b40cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:06.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.912+0000 7f62b2a00640 1 -- 172.21.15.19:0/886178285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b40c3f40 con 0x7f62b40c7f90 2024-04-25T10:26:06.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.912+0000 7f62b2a00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b40c7f90 0x7f62b4148260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f62a4031000 tx=0x7f62a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:06.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.912+0000 7f62aaa00640 1 -- 172.21.15.19:0/886178285 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4042020 con 0x7f62b40c7f90 2024-04-25T10:26:06.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.912+0000 7f62aaa00640 1 -- 172.21.15.19:0/886178285 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a4030970 con 0x7f62b40c7f90 2024-04-25T10:26:06.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.912+0000 7f62aaa00640 1 -- 172.21.15.19:0/886178285 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4037040 con 0x7f62b40c7f90 2024-04-25T10:26:06.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.912+0000 7f62b3e00640 1 -- 172.21.15.19:0/886178285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b41e6230 con 0x7f62b40c7f90 2024-04-25T10:26:06.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.913+0000 7f62b3e00640 1 -- 172.21.15.19:0/886178285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b41487a0 con 0x7f62b40c7f90 2024-04-25T10:26:06.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.914+0000 7f62b3e00640 1 -- 172.21.15.19:0/886178285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62b4050740 con 0x7f62b40c7f90 2024-04-25T10:26:06.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.915+0000 7f62aaa00640 1 -- 172.21.15.19:0/886178285 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f62a4045020 con 0x7f62b40c7f90 2024-04-25T10:26:06.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.916+0000 7f62aaa00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f62900744b0 0x7f62900769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:06.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.916+0000 7f62aaa00640 1 -- 172.21.15.19:0/886178285 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f62a40b5da0 con 0x7f62b40c7f90 2024-04-25T10:26:06.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.916+0000 7f62abe00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f62900744b0 0x7f62900769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:06.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.917+0000 7f62abe00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f62900744b0 0x7f62900769c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f629c007fd0 tx=0x7f629c007e80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:06.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:06.922+0000 7f62aaa00640 1 -- 172.21.15.19:0/886178285 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62a404c030 con 0x7f62b40c7f90 2024-04-25T10:26:07.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.127+0000 7f62b3e00640 1 -- 172.21.15.19:0/886178285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62b40709f0 con 0x7f62b40c7f90 2024-04-25T10:26:07.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.130+0000 7f62aaa00640 1 -- 172.21.15.19:0/886178285 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18518 (secure 0 0 0) 0x7f62a407fc20 con 0x7f62b40c7f90 2024-04-25T10:26:07.133 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:07.133 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:41.790347+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:07.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 -- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f62900744b0 msgr2=0x7f62900769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:07.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f62900744b0 0x7f62900769c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f629c007fd0 tx=0x7f629c007e80 comp rx=0 tx=0).stop 2024-04-25T10:26:07.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 -- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b40c7f90 msgr2=0x7f62b4148260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:07.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b40c7f90 0x7f62b4148260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f62a4031000 tx=0x7f62a40046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:07.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 -- 172.21.15.19:0/886178285 shutdown_connections 2024-04-25T10:26:07.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b41e41a0 0x7f62b40cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:07.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f62900744b0 0x7f62900769c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:07.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62b415a370 0x7f62b40cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:07.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 --2- 172.21.15.19:0/886178285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b40c7f90 0x7f62b4148260 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:07.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 -- 172.21.15.19:0/886178285 >> 172.21.15.19:0/886178285 conn(0x7f62b40cdbc0 msgr2=0x7f62b40c6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:07.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 -- 172.21.15.19:0/886178285 shutdown_connections 2024-04-25T10:26:07.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.132+0000 7f62b3e00640 1 -- 172.21.15.19:0/886178285 wait complete. 2024-04-25T10:26:07.161 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:26:07.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.449+0000 7efddcc00640 1 Processor -- start 2024-04-25T10:26:07.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.450+0000 7efddcc00640 1 -- start start 2024-04-25T10:26:07.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.452+0000 7efddcc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c74c0 0x7efdd8153450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:07.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.452+0000 7efddcc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efdd80c2a50 0x7efdd8074120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:07.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.452+0000 7efddcc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd80c9730 con 0x7efdd80c2640 2024-04-25T10:26:07.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.452+0000 7efddcc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efdd80703c0 con 0x7efdd80c2a50 2024-04-25T10:26:07.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.452+0000 7efddcc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efdd80c2fe0 con 0x7efdd80c74c0 2024-04-25T10:26:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.452+0000 7efdd7400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c74c0 0x7efdd8153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.453+0000 7efdd7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efdd80c2a50 0x7efdd8074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.453+0000 7efdd6a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efdd80c2640 0x7efdd81590b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:54040/0 (socket says 172.21.15.19:54040) 2024-04-25T10:26:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.453+0000 7efdd6a00640 1 -- 172.21.15.19:0/3256778073 learned_addr learned my addr 172.21.15.19:0/3256778073 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.453+0000 7efdd6000640 1 -- 172.21.15.19:0/3256778073 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181886349 0 0) 0x7efdd80c9730 con 0x7efdd80c2640 2024-04-25T10:26:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.453+0000 7efdd6000640 1 -- 172.21.15.19:0/3256778073 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdbc003520 con 0x7efdd80c2640 2024-04-25T10:26:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.453+0000 7efdd7400640 1 -- 172.21.15.19:0/3256778073 >> v2:172.21.15.112:3300/0 conn(0x7efdd80c2a50 msgr2=0x7efdd8074120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.453+0000 7efdd7400640 1 --2- 172.21.15.19:0/3256778073 >> v2:172.21.15.112:3300/0 conn(0x7efdd80c2a50 0x7efdd8074120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.453+0000 7efdd7400640 1 -- 172.21.15.19:0/3256778073 >> v1:172.21.15.112:6789/0 conn(0x7efdd80c2640 legacy=0x7efdd81590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.453+0000 7efdd7400640 1 -- 172.21.15.19:0/3256778073 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd80c99d0 con 0x7efdd80c74c0 2024-04-25T10:26:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.453+0000 7efdd7e00640 1 --2- 172.21.15.19:0/3256778073 >> v2:172.21.15.112:3300/0 conn(0x7efdd80c2a50 0x7efdd8074120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.454+0000 7efdd7400640 1 --2- 172.21.15.19:0/3256778073 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c74c0 0x7efdd8153450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009d90 tx=0x7efdc802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1a3f9af022e211d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.455+0000 7efdd6000640 1 -- 172.21.15.19:0/3256778073 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8007740 con 0x7efdd80c74c0 2024-04-25T10:26:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.455+0000 7efdd6000640 1 -- 172.21.15.19:0/3256778073 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc80078e0 con 0x7efdd80c74c0 2024-04-25T10:26:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.455+0000 7efdd6000640 1 -- 172.21.15.19:0/3256778073 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8007cb0 con 0x7efdd80c74c0 2024-04-25T10:26:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.456+0000 7efddcc00640 1 -- 172.21.15.19:0/3256778073 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c74c0 msgr2=0x7efdd8153450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.456+0000 7efddcc00640 1 --2- 172.21.15.19:0/3256778073 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c74c0 0x7efdd8153450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009d90 tx=0x7efdc802a6f0 comp rx=0 tx=0).stop 2024-04-25T10:26:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.456+0000 7efddcc00640 1 -- 172.21.15.19:0/3256778073 shutdown_connections 2024-04-25T10:26:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.456+0000 7efddcc00640 1 --2- 172.21.15.19:0/3256778073 >> v2:172.21.15.112:3300/0 conn(0x7efdd80c2a50 0x7efdd8074120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.456+0000 7efddcc00640 1 --2- 172.21.15.19:0/3256778073 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c74c0 0x7efdd8153450 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.456+0000 7efddcc00640 1 -- 172.21.15.19:0/3256778073 >> 172.21.15.19:0/3256778073 conn(0x7efdd80ca120 msgr2=0x7efdd80ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.456+0000 7efddcc00640 1 -- 172.21.15.19:0/3256778073 shutdown_connections 2024-04-25T10:26:07.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.456+0000 7efddcc00640 1 -- 172.21.15.19:0/3256778073 wait complete. 2024-04-25T10:26:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.459+0000 7efddcc00640 1 Processor -- start 2024-04-25T10:26:07.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.459+0000 7efddcc00640 1 -- start start 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.461+0000 7efddcc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c2640 0x7efdd81f0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.461+0000 7efddcc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd80c2a50 0x7efdd8157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.461+0000 7efddcc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd80c74c0 0x7efdd8159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.461+0000 7efddcc00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80c3580 con 0x7efdd80c2a50 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.461+0000 7efddcc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80c32a0 con 0x7efdd80c74c0 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.461+0000 7efddcc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efdd80c3aa0 con 0x7efdd80c2640 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.462+0000 7efdd6a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd80c2a50 0x7efdd8157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.462+0000 7efdd7400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c2640 0x7efdd81f0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.462+0000 7efdd7400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c2640 0x7efdd81f0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:48208/0 (socket says 172.21.15.19:48208) 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.462+0000 7efdd7400640 1 -- 172.21.15.19:0/310232265 learned_addr learned my addr 172.21.15.19:0/310232265 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.462+0000 7efdd7e00640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd80c74c0 0x7efdd8159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.462+0000 7efdd7400640 1 -- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd80c74c0 msgr2=0x7efdd8159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.462+0000 7efdd7400640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd80c74c0 0x7efdd8159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.462+0000 7efdd7400640 1 -- 172.21.15.19:0/310232265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd80c2a50 msgr2=0x7efdd8157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.462+0000 7efdd7400640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd80c2a50 0x7efdd8157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.462+0000 7efdd7400640 1 -- 172.21.15.19:0/310232265 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd81f06c0 con 0x7efdd80c2640 2024-04-25T10:26:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.463+0000 7efdd7400640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c2640 0x7efdd81f0180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009d90 tx=0x7efdc8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.463+0000 7efdcf400640 1 -- 172.21.15.19:0/310232265 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc803f070 con 0x7efdd80c2640 2024-04-25T10:26:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.463+0000 7efdcf400640 1 -- 172.21.15.19:0/310232265 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8031c40 con 0x7efdd80c2640 2024-04-25T10:26:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.463+0000 7efdcf400640 1 -- 172.21.15.19:0/310232265 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8009450 con 0x7efdd80c2640 2024-04-25T10:26:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.463+0000 7efddcc00640 1 -- 172.21.15.19:0/310232265 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd8157ca0 con 0x7efdd80c2640 2024-04-25T10:26:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.463+0000 7efddcc00640 1 -- 172.21.15.19:0/310232265 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd81f0f10 con 0x7efdd80c2640 2024-04-25T10:26:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.464+0000 7efddcc00640 1 -- 172.21.15.19:0/310232265 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd8076520 con 0x7efdd80c2640 2024-04-25T10:26:07.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.465+0000 7efdcf400640 1 -- 172.21.15.19:0/310232265 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efdc8044460 con 0x7efdd80c2640 2024-04-25T10:26:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.466+0000 7efdcf400640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efdb40744b0 0x7efdb40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.466+0000 7efdcf400640 1 -- 172.21.15.19:0/310232265 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efdc80b67e0 con 0x7efdd80c2640 2024-04-25T10:26:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.467+0000 7efdd6a00640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efdb40744b0 0x7efdb40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.467+0000 7efdd6a00640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efdb40744b0 0x7efdb40769c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efdc0001200 tx=0x7efdc0000bc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:07.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.472+0000 7efdcf400640 1 -- 172.21.15.19:0/310232265 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efdc804b030 con 0x7efdd80c2640 2024-04-25T10:26:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:07.720+0000 7efddcc00640 1 -- 172.21.15.19:0/310232265 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7efdd8163810 con 0x7efdd80c2640 2024-04-25T10:26:08.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.311+0000 7efdcf400640 1 -- 172.21.15.19:0/310232265 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7efdc8080c20 con 0x7efdd80c2640 2024-04-25T10:26:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.315+0000 7efddcc00640 1 -- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efdb40744b0 msgr2=0x7efdb40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.315+0000 7efddcc00640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efdb40744b0 0x7efdb40769c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efdc0001200 tx=0x7efdc0000bc0 comp rx=0 tx=0).stop 2024-04-25T10:26:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.315+0000 7efddcc00640 1 -- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c2640 msgr2=0x7efdd81f0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.315+0000 7efddcc00640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c2640 0x7efdd81f0180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009d90 tx=0x7efdc8004a40 comp rx=0 tx=0).stop 2024-04-25T10:26:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.315+0000 7efddcc00640 1 -- 172.21.15.19:0/310232265 shutdown_connections 2024-04-25T10:26:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.315+0000 7efddcc00640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efdd80c74c0 0x7efdd8159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.315+0000 7efddcc00640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd80c2a50 0x7efdd8157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.315+0000 7efddcc00640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efdb40744b0 0x7efdb40769c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.315+0000 7efddcc00640 1 --2- 172.21.15.19:0/310232265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efdd80c2640 0x7efdd81f0180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:08.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.315+0000 7efddcc00640 1 -- 172.21.15.19:0/310232265 >> 172.21.15.19:0/310232265 conn(0x7efdd80ca120 msgr2=0x7efdd80c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:08.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.315+0000 7efddcc00640 1 -- 172.21.15.19:0/310232265 shutdown_connections 2024-04-25T10:26:08.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.316+0000 7efddcc00640 1 -- 172.21.15.19:0/310232265 wait complete. 2024-04-25T10:26:08.350 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-04-25T10:26:08.350 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-25T10:26:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.636+0000 7f1532600640 1 Processor -- start 2024-04-25T10:26:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.636+0000 7f1532600640 1 -- start start 2024-04-25T10:26:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.638+0000 7f1532600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f152c0c4930 0x7f152c1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.638+0000 7f1532600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f152c159b80 0x7f152c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.639+0000 7f1532600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f152c0b07c0 con 0x7f152c0742c0 2024-04-25T10:26:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.639+0000 7f1532600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f152c1596f0 con 0x7f152c0c4930 2024-04-25T10:26:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.639+0000 7f1532600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f152c0b2600 con 0x7f152c159b80 2024-04-25T10:26:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.639+0000 7f152be00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f152c0742c0 0x7f152c0c2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46986/0 (socket says 172.21.15.19:46986) 2024-04-25T10:26:08.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.639+0000 7f152be00640 1 -- 172.21.15.19:0/1540110965 learned_addr learned my addr 172.21.15.19:0/1540110965 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:08.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.639+0000 7f152b400640 1 --2- 172.21.15.19:0/1540110965 >> v2:172.21.15.112:3300/0 conn(0x7f152c0c4930 0x7f152c1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:08.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.639+0000 7f152aa00640 1 --2- 172.21.15.19:0/1540110965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f152c159b80 0x7f152c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:08.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.640+0000 7f152b400640 1 -- 172.21.15.19:0/1540110965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f152c159b80 msgr2=0x7f152c159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:08.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.640+0000 7f152b400640 1 --2- 172.21.15.19:0/1540110965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f152c159b80 0x7f152c159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:08.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.640+0000 7f152b400640 1 -- 172.21.15.19:0/1540110965 >> v1:172.21.15.19:6789/0 conn(0x7f152c0742c0 legacy=0x7f152c0c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:08.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.640+0000 7f152a000640 1 -- 172.21.15.19:0/1540110965 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4085634955 0 0) 0x7f152c0b07c0 con 0x7f152c0742c0 2024-04-25T10:26:08.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.640+0000 7f152b400640 1 -- 172.21.15.19:0/1540110965 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c0b28e0 con 0x7f152c0c4930 2024-04-25T10:26:08.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.640+0000 7f152aa00640 1 --2- 172.21.15.19:0/1540110965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f152c159b80 0x7f152c159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:08.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.641+0000 7f152b400640 1 --2- 172.21.15.19:0/1540110965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f152c0c4930 0x7f152c1534f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f151c0097a0 tx=0x7f151c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a89b248da08fb38a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:08.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.641+0000 7f152a000640 1 -- 172.21.15.19:0/1540110965 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c037070 con 0x7f152c0c4930 2024-04-25T10:26:08.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.641+0000 7f152a000640 1 -- 172.21.15.19:0/1540110965 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f151c032440 con 0x7f152c0c4930 2024-04-25T10:26:08.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.641+0000 7f152a000640 1 -- 172.21.15.19:0/1540110965 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c032810 con 0x7f152c0c4930 2024-04-25T10:26:08.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.642+0000 7f1532600640 1 -- 172.21.15.19:0/1540110965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f152c0c4930 msgr2=0x7f152c1534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:08.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.642+0000 7f1532600640 1 --2- 172.21.15.19:0/1540110965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f152c0c4930 0x7f152c1534f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f151c0097a0 tx=0x7f151c02a180 comp rx=0 tx=0).stop 2024-04-25T10:26:08.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.642+0000 7f1532600640 1 -- 172.21.15.19:0/1540110965 shutdown_connections 2024-04-25T10:26:08.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.642+0000 7f1532600640 1 --2- 172.21.15.19:0/1540110965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f152c159b80 0x7f152c159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:08.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.642+0000 7f1532600640 1 --2- 172.21.15.19:0/1540110965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f152c0c4930 0x7f152c1534f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:08.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.642+0000 7f1532600640 1 -- 172.21.15.19:0/1540110965 >> 172.21.15.19:0/1540110965 conn(0x7f152c06f1f0 msgr2=0x7f152c06f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:08.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.642+0000 7f1532600640 1 -- 172.21.15.19:0/1540110965 shutdown_connections 2024-04-25T10:26:08.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.642+0000 7f1532600640 1 -- 172.21.15.19:0/1540110965 wait complete. 2024-04-25T10:26:08.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.645+0000 7f1532600640 1 Processor -- start 2024-04-25T10:26:08.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.646+0000 7f1532600640 1 -- start start 2024-04-25T10:26:08.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.647+0000 7f1532600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f152c0742c0 0x7f152c0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:08.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f1532600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f152c0c4930 0x7f152c0cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:08.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f1532600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f152c159b80 0x7f152c1f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:08.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f1532600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f152c15c900 con 0x7f152c159b80 2024-04-25T10:26:08.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f1532600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f152c0b2ea0 con 0x7f152c0c4930 2024-04-25T10:26:08.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f1532600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f152c153a30 con 0x7f152c0742c0 2024-04-25T10:26:08.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f152aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f152c0c4930 0x7f152c0cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:08.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f152b400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f152c0742c0 0x7f152c0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:08.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f152aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f152c0c4930 0x7f152c0cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39540/0 (socket says 172.21.15.19:39540) 2024-04-25T10:26:08.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f152aa00640 1 -- 172.21.15.19:0/840303077 learned_addr learned my addr 172.21.15.19:0/840303077 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:08.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f152be00640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f152c159b80 0x7f152c1f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:08.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f152aa00640 1 -- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f152c0742c0 msgr2=0x7f152c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:08.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f152aa00640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f152c0742c0 0x7f152c0c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:08.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f152aa00640 1 -- 172.21.15.19:0/840303077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f152c159b80 msgr2=0x7f152c1f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:08.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f152aa00640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f152c159b80 0x7f152c1f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:08.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.648+0000 7f152aa00640 1 -- 172.21.15.19:0/840303077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c1f42b0 con 0x7f152c0c4930 2024-04-25T10:26:08.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.649+0000 7f152aa00640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f152c0c4930 0x7f152c0cab20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f151800e960 tx=0x7f151800ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:08.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.649+0000 7f1523400640 1 -- 172.21.15.19:0/840303077 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1518017070 con 0x7f152c0c4930 2024-04-25T10:26:08.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.649+0000 7f1523400640 1 -- 172.21.15.19:0/840303077 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f151800ca00 con 0x7f152c0c4930 2024-04-25T10:26:08.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.649+0000 7f1523400640 1 -- 172.21.15.19:0/840303077 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151800cdd0 con 0x7f152c0c4930 2024-04-25T10:26:08.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.649+0000 7f1532600640 1 -- 172.21.15.19:0/840303077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152c0c9260 con 0x7f152c0c4930 2024-04-25T10:26:08.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.649+0000 7f1532600640 1 -- 172.21.15.19:0/840303077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f152c0cb060 con 0x7f152c0c4930 2024-04-25T10:26:08.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.651+0000 7f1532600640 1 -- 172.21.15.19:0/840303077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f152c076520 con 0x7f152c0c4930 2024-04-25T10:26:08.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.652+0000 7f1523400640 1 -- 172.21.15.19:0/840303077 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f151801a070 con 0x7f152c0c4930 2024-04-25T10:26:08.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.653+0000 7f1523400640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f150c0744e0 0x7f150c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:08.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.653+0000 7f1523400640 1 -- 172.21.15.19:0/840303077 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f15180956c0 con 0x7f152c0c4930 2024-04-25T10:26:08.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.653+0000 7f152b400640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f150c0744e0 0x7f150c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:08.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.654+0000 7f152b400640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f150c0744e0 0x7f150c0769f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f151c034000 tx=0x7f151c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:08.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.658+0000 7f1523400640 1 -- 172.21.15.19:0/840303077 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f151805f4b0 con 0x7f152c0c4930 2024-04-25T10:26:08.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:08.899+0000 7f1532600640 1 -- 172.21.15.19:0/840303077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f152c1f4040 con 0x7f152c0c4930 2024-04-25T10:26:09.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.323+0000 7f1523400640 1 -- 172.21.15.19:0/840303077 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f15180637b0 con 0x7f152c0c4930 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.326+0000 7f1532600640 1 -- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f150c0744e0 msgr2=0x7f150c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.326+0000 7f1532600640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f150c0744e0 0x7f150c0769f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f151c034000 tx=0x7f151c02e000 comp rx=0 tx=0).stop 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.326+0000 7f1532600640 1 -- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f152c0c4930 msgr2=0x7f152c0cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.326+0000 7f1532600640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f152c0c4930 0x7f152c0cab20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f151800e960 tx=0x7f151800ee20 comp rx=0 tx=0).stop 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.327+0000 7f1532600640 1 -- 172.21.15.19:0/840303077 shutdown_connections 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.327+0000 7f1532600640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f152c159b80 0x7f152c1f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.327+0000 7f1532600640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f152c0c4930 0x7f152c0cab20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.327+0000 7f1532600640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f150c0744e0 0x7f150c0769f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.327+0000 7f1532600640 1 --2- 172.21.15.19:0/840303077 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f152c0742c0 0x7f152c0c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.327+0000 7f1532600640 1 -- 172.21.15.19:0/840303077 >> 172.21.15.19:0/840303077 conn(0x7f152c06f1f0 msgr2=0x7f152c0b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.327+0000 7f1532600640 1 -- 172.21.15.19:0/840303077 shutdown_connections 2024-04-25T10:26:09.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.327+0000 7f1532600640 1 -- 172.21.15.19:0/840303077 wait complete. 2024-04-25T10:26:09.365 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:26:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.649+0000 7fa516200640 1 Processor -- start 2024-04-25T10:26:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.649+0000 7fa516200640 1 -- start start 2024-04-25T10:26:09.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.651+0000 7fa516200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa510159f90 0x7fa5100c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:09.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.651+0000 7fa516200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5100b07c0 con 0x7fa510159b80 2024-04-25T10:26:09.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.651+0000 7fa516200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5100b2600 con 0x7fa5100c4930 2024-04-25T10:26:09.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.651+0000 7fa516200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa5101596f0 con 0x7fa510159f90 2024-04-25T10:26:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.652+0000 7fa50ea00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa510159b80 0x7fa5100742c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46998/0 (socket says 172.21.15.19:46998) 2024-04-25T10:26:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.652+0000 7fa50ea00640 1 -- 172.21.15.19:0/92318171 learned_addr learned my addr 172.21.15.19:0/92318171 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.652+0000 7fa50fe00640 1 --2- 172.21.15.19:0/92318171 >> v2:172.21.15.19:3300/0 conn(0x7fa510159f90 0x7fa5100c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.652+0000 7fa50e000640 1 -- 172.21.15.19:0/92318171 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157497562 0 0) 0x7fa5100b07c0 con 0x7fa510159b80 2024-04-25T10:26:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.652+0000 7fa50e000640 1 -- 172.21.15.19:0/92318171 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4f4005730 con 0x7fa510159b80 2024-04-25T10:26:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.652+0000 7fa50fe00640 1 -- 172.21.15.19:0/92318171 >> v1:172.21.15.112:6789/0 conn(0x7fa5100c4930 legacy=0x7fa5101534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.652+0000 7fa50e000640 1 -- 172.21.15.19:0/92318171 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 383138111 0 0) 0x7fa5100b2600 con 0x7fa5100c4930 2024-04-25T10:26:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.652+0000 7fa50fe00640 1 -- 172.21.15.19:0/92318171 >> v1:172.21.15.19:6789/0 conn(0x7fa510159b80 legacy=0x7fa5100742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.652+0000 7fa50fe00640 1 -- 172.21.15.19:0/92318171 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5100b28e0 con 0x7fa510159f90 2024-04-25T10:26:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.654+0000 7fa50fe00640 1 --2- 172.21.15.19:0/92318171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa510159f90 0x7fa5100c2a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa5080097a0 tx=0x7fa50802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bb9e884a5f18af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.654+0000 7fa50e000640 1 -- 172.21.15.19:0/92318171 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508037070 con 0x7fa510159f90 2024-04-25T10:26:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.654+0000 7fa50e000640 1 -- 172.21.15.19:0/92318171 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa508032440 con 0x7fa510159f90 2024-04-25T10:26:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.654+0000 7fa50e000640 1 -- 172.21.15.19:0/92318171 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5080327f0 con 0x7fa510159f90 2024-04-25T10:26:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.655+0000 7fa516200640 1 -- 172.21.15.19:0/92318171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa510159f90 msgr2=0x7fa5100c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.655+0000 7fa516200640 1 --2- 172.21.15.19:0/92318171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa510159f90 0x7fa5100c2a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa5080097a0 tx=0x7fa50802a230 comp rx=0 tx=0).stop 2024-04-25T10:26:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.655+0000 7fa516200640 1 -- 172.21.15.19:0/92318171 shutdown_connections 2024-04-25T10:26:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.655+0000 7fa516200640 1 --2- 172.21.15.19:0/92318171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa510159f90 0x7fa5100c2a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.655+0000 7fa516200640 1 -- 172.21.15.19:0/92318171 >> 172.21.15.19:0/92318171 conn(0x7fa51006f1f0 msgr2=0x7fa51006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.655+0000 7fa516200640 1 -- 172.21.15.19:0/92318171 shutdown_connections 2024-04-25T10:26:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.655+0000 7fa516200640 1 -- 172.21.15.19:0/92318171 wait complete. 2024-04-25T10:26:09.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.657+0000 7fa516200640 1 Processor -- start 2024-04-25T10:26:09.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.657+0000 7fa516200640 1 -- start start 2024-04-25T10:26:09.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.659+0000 7fa516200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5100c4930 0x7fa5101f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:09.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.659+0000 7fa516200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa510159b80 0x7fa5100c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:09.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.659+0000 7fa516200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa510159f90 0x7fa5100c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:09.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.659+0000 7fa516200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa51015c900 con 0x7fa510159b80 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.659+0000 7fa516200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa5100b2ea0 con 0x7fa5100c4930 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.659+0000 7fa516200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa510159330 con 0x7fa510159f90 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.659+0000 7fa50ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa510159b80 0x7fa5100c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.659+0000 7fa50ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa510159b80 0x7fa5100c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52372/0 (socket says 172.21.15.19:52372) 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.659+0000 7fa50ea00640 1 -- 172.21.15.19:0/3837248245 learned_addr learned my addr 172.21.15.19:0/3837248245 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.659+0000 7fa50f400640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5100c4930 0x7fa5101f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.659+0000 7fa50fe00640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa510159f90 0x7fa5100c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.660+0000 7fa50ea00640 1 -- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa510159f90 msgr2=0x7fa5100c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.660+0000 7fa50ea00640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa510159f90 0x7fa5100c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.660+0000 7fa50ea00640 1 -- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5100c4930 msgr2=0x7fa5101f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.660+0000 7fa50ea00640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5100c4930 0x7fa5101f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.660+0000 7fa50ea00640 1 -- 172.21.15.19:0/3837248245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa510151f60 con 0x7fa510159b80 2024-04-25T10:26:09.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.660+0000 7fa50f400640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5100c4930 0x7fa5101f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:09.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.660+0000 7fa50ea00640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa510159b80 0x7fa5100c4df0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa50000cad0 tx=0x7fa50000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:09.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.660+0000 7fa507400640 1 -- 172.21.15.19:0/3837248245 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500017070 con 0x7fa510159b80 2024-04-25T10:26:09.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.660+0000 7fa507400640 1 -- 172.21.15.19:0/3837248245 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50000ac30 con 0x7fa510159b80 2024-04-25T10:26:09.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.660+0000 7fa507400640 1 -- 172.21.15.19:0/3837248245 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500012400 con 0x7fa510159b80 2024-04-25T10:26:09.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.660+0000 7fa516200640 1 -- 172.21.15.19:0/3837248245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5100afcf0 con 0x7fa510159b80 2024-04-25T10:26:09.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.661+0000 7fa516200640 1 -- 172.21.15.19:0/3837248245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5101524e0 con 0x7fa510159b80 2024-04-25T10:26:09.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.662+0000 7fa516200640 1 -- 172.21.15.19:0/3837248245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa51015c3f0 con 0x7fa510159b80 2024-04-25T10:26:09.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.663+0000 7fa507400640 1 -- 172.21.15.19:0/3837248245 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa50001a070 con 0x7fa510159b80 2024-04-25T10:26:09.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.664+0000 7fa507400640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa4ec0744e0 0x7fa4ec0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:09.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.664+0000 7fa507400640 1 -- 172.21.15.19:0/3837248245 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa5000952f0 con 0x7fa510159b80 2024-04-25T10:26:09.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.664+0000 7fa50f400640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa4ec0744e0 0x7fa4ec0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:09.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.665+0000 7fa50f400640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa4ec0744e0 0x7fa4ec0769f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8000f60 tx=0x7fa4f8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:09.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.669+0000 7fa507400640 1 -- 172.21.15.19:0/3837248245 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa50005f060 con 0x7fa510159b80 2024-04-25T10:26:09.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:09.914+0000 7fa516200640 1 -- 172.21.15.19:0/3837248245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa510076520 con 0x7fa510159b80 2024-04-25T10:26:10.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.331+0000 7fa507400640 1 -- 172.21.15.19:0/3837248245 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fa500063360 con 0x7fa510159b80 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.335+0000 7fa516200640 1 -- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa4ec0744e0 msgr2=0x7fa4ec0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.335+0000 7fa516200640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa4ec0744e0 0x7fa4ec0769f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8000f60 tx=0x7fa4f8009040 comp rx=0 tx=0).stop 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.335+0000 7fa516200640 1 -- 172.21.15.19:0/3837248245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa510159b80 msgr2=0x7fa5100c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.335+0000 7fa516200640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa510159b80 0x7fa5100c4df0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa50000cad0 tx=0x7fa50000cf90 comp rx=0 tx=0).stop 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.336+0000 7fa516200640 1 -- 172.21.15.19:0/3837248245 shutdown_connections 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.336+0000 7fa516200640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa4ec0744e0 0x7fa4ec0769f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.336+0000 7fa516200640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa510159f90 0x7fa5100c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.336+0000 7fa516200640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa510159b80 0x7fa5100c4df0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.336+0000 7fa516200640 1 --2- 172.21.15.19:0/3837248245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5100c4930 0x7fa5101f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.336+0000 7fa516200640 1 -- 172.21.15.19:0/3837248245 >> 172.21.15.19:0/3837248245 conn(0x7fa51006f1f0 msgr2=0x7fa5100c2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.336+0000 7fa516200640 1 -- 172.21.15.19:0/3837248245 shutdown_connections 2024-04-25T10:26:10.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.336+0000 7fa516200640 1 -- 172.21.15.19:0/3837248245 wait complete. 2024-04-25T10:26:10.373 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T10:26:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.659+0000 7fd943e00640 1 Processor -- start 2024-04-25T10:26:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.659+0000 7fd943e00640 1 -- start start 2024-04-25T10:26:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.661+0000 7fd943e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9440cbb10 0x7fd9440ca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.661+0000 7fd943e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 0x7fd94415cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.661+0000 7fd943e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94415fd90 con 0x7fd94415d070 2024-04-25T10:26:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.661+0000 7fd943e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd944160050 con 0x7fd9440cbb10 2024-04-25T10:26:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.661+0000 7fd943e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd944160330 con 0x7fd9440ca760 2024-04-25T10:26:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.661+0000 7fd942a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9440cbb10 0x7fd9440ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.661+0000 7fd93be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 0x7fd94415cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.661+0000 7fd942a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9440cbb10 0x7fd9440ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52386/0 (socket says 172.21.15.19:52386) 2024-04-25T10:26:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.661+0000 7fd942a00640 1 -- 172.21.15.19:0/741328426 learned_addr learned my addr 172.21.15.19:0/741328426 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.662+0000 7fd942a00640 1 -- 172.21.15.19:0/741328426 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 msgr2=0x7fd94415cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.662+0000 7fd942a00640 1 --2- 172.21.15.19:0/741328426 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 0x7fd94415cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.662+0000 7fd942a00640 1 -- 172.21.15.19:0/741328426 >> v1:172.21.15.19:6789/0 conn(0x7fd94415d070 legacy=0x7fd9440cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.662+0000 7fd942a00640 1 -- 172.21.15.19:0/741328426 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd944160610 con 0x7fd9440cbb10 2024-04-25T10:26:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.663+0000 7fd942a00640 1 --2- 172.21.15.19:0/741328426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9440cbb10 0x7fd9440ca220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd934009870 tx=0x7fd93402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2e9c981d9c11b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.663+0000 7fd942000640 1 -- 172.21.15.19:0/741328426 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd934037070 con 0x7fd9440cbb10 2024-04-25T10:26:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.663+0000 7fd942000640 1 -- 172.21.15.19:0/741328426 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd934032440 con 0x7fd9440cbb10 2024-04-25T10:26:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.663+0000 7fd942000640 1 -- 172.21.15.19:0/741328426 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd934032810 con 0x7fd9440cbb10 2024-04-25T10:26:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.664+0000 7fd943e00640 1 -- 172.21.15.19:0/741328426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9440cbb10 msgr2=0x7fd9440ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.664+0000 7fd943e00640 1 --2- 172.21.15.19:0/741328426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9440cbb10 0x7fd9440ca220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd934009870 tx=0x7fd93402a270 comp rx=0 tx=0).stop 2024-04-25T10:26:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.664+0000 7fd943e00640 1 -- 172.21.15.19:0/741328426 shutdown_connections 2024-04-25T10:26:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.664+0000 7fd943e00640 1 --2- 172.21.15.19:0/741328426 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 0x7fd94415cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.664+0000 7fd943e00640 1 --2- 172.21.15.19:0/741328426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9440cbb10 0x7fd9440ca220 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.664+0000 7fd943e00640 1 -- 172.21.15.19:0/741328426 >> 172.21.15.19:0/741328426 conn(0x7fd944068db0 msgr2=0x7fd944072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.664+0000 7fd943e00640 1 -- 172.21.15.19:0/741328426 shutdown_connections 2024-04-25T10:26:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.664+0000 7fd943e00640 1 -- 172.21.15.19:0/741328426 wait complete. 2024-04-25T10:26:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.666+0000 7fd943e00640 1 Processor -- start 2024-04-25T10:26:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.667+0000 7fd943e00640 1 -- start start 2024-04-25T10:26:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd943e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 0x7fd9441f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd943e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd94415d070 0x7fd9441596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd943e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944071570 0x7fd944153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd943e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd94415faf0 con 0x7fd944071570 2024-04-25T10:26:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd943e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd94415f970 con 0x7fd94415d070 2024-04-25T10:26:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd943e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd94406ea60 con 0x7fd9440ca760 2024-04-25T10:26:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd943400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944071570 0x7fd944153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd942a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 0x7fd9441f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd93be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd94415d070 0x7fd9441596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd943400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944071570 0x7fd944153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52400/0 (socket says 172.21.15.19:52400) 2024-04-25T10:26:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd93be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd94415d070 0x7fd9441596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39570/0 (socket says 172.21.15.19:39570) 2024-04-25T10:26:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd942a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 0x7fd9441f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60330/0 (socket says 172.21.15.19:60330) 2024-04-25T10:26:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.668+0000 7fd943400640 1 -- 172.21.15.19:0/3964226930 learned_addr learned my addr 172.21.15.19:0/3964226930 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.669+0000 7fd942a00640 1 -- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd94415d070 msgr2=0x7fd9441596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.669+0000 7fd942a00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd94415d070 0x7fd9441596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.669+0000 7fd942a00640 1 -- 172.21.15.19:0/3964226930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944071570 msgr2=0x7fd944153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.669+0000 7fd942a00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944071570 0x7fd944153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.669+0000 7fd942a00640 1 -- 172.21.15.19:0/3964226930 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94415e170 con 0x7fd9440ca760 2024-04-25T10:26:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.669+0000 7fd943400640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944071570 0x7fd944153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.669+0000 7fd942a00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 0x7fd9441f2060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd9440727b0 tx=0x7fd9340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.670+0000 7fd93aa00640 1 -- 172.21.15.19:0/3964226930 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd934041020 con 0x7fd9440ca760 2024-04-25T10:26:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.670+0000 7fd93aa00640 1 -- 172.21.15.19:0/3964226930 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd934030700 con 0x7fd9440ca760 2024-04-25T10:26:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.670+0000 7fd93aa00640 1 -- 172.21.15.19:0/3964226930 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd934037040 con 0x7fd9440ca760 2024-04-25T10:26:10.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.670+0000 7fd943e00640 1 -- 172.21.15.19:0/3964226930 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9441e8590 con 0x7fd9440ca760 2024-04-25T10:26:10.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.670+0000 7fd943e00640 1 -- 172.21.15.19:0/3964226930 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94415e3e0 con 0x7fd9440ca760 2024-04-25T10:26:10.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.672+0000 7fd943e00640 1 -- 172.21.15.19:0/3964226930 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd944076520 con 0x7fd9440ca760 2024-04-25T10:26:10.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.672+0000 7fd93aa00640 1 -- 172.21.15.19:0/3964226930 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd934044020 con 0x7fd9440ca760 2024-04-25T10:26:10.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.673+0000 7fd93aa00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd9200744b0 0x7fd9200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:10.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.674+0000 7fd93aa00640 1 -- 172.21.15.19:0/3964226930 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd9340b5ab0 con 0x7fd9440ca760 2024-04-25T10:26:10.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.674+0000 7fd93be00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd9200744b0 0x7fd9200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:10.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.675+0000 7fd93be00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd9200744b0 0x7fd9200769c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd9440c5d40 tx=0x7fd92c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.679+0000 7fd93aa00640 1 -- 172.21.15.19:0/3964226930 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd93404b030 con 0x7fd9440ca760 2024-04-25T10:26:10.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:10.929+0000 7fd943e00640 1 -- 172.21.15.19:0/3964226930 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fd9440cac10 con 0x7fd9440ca760 2024-04-25T10:26:11.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.345+0000 7fd93aa00640 1 -- 172.21.15.19:0/3964226930 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7fd93407f8b0 con 0x7fd9440ca760 2024-04-25T10:26:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.348+0000 7fd943e00640 1 -- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd9200744b0 msgr2=0x7fd9200769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.348+0000 7fd943e00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd9200744b0 0x7fd9200769c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd9440c5d40 tx=0x7fd92c009190 comp rx=0 tx=0).stop 2024-04-25T10:26:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.349+0000 7fd943e00640 1 -- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 msgr2=0x7fd9441f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.349+0000 7fd943e00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 0x7fd9441f2060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd9440727b0 tx=0x7fd9340046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.349+0000 7fd943e00640 1 -- 172.21.15.19:0/3964226930 shutdown_connections 2024-04-25T10:26:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.349+0000 7fd943e00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd944071570 0x7fd944153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.349+0000 7fd943e00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd94415d070 0x7fd9441596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.349+0000 7fd943e00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd9200744b0 0x7fd9200769c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.349+0000 7fd943e00640 1 --2- 172.21.15.19:0/3964226930 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9440ca760 0x7fd9441f2060 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.349+0000 7fd943e00640 1 -- 172.21.15.19:0/3964226930 >> 172.21.15.19:0/3964226930 conn(0x7fd944068db0 msgr2=0x7fd944155550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.349+0000 7fd943e00640 1 -- 172.21.15.19:0/3964226930 shutdown_connections 2024-04-25T10:26:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.349+0000 7fd943e00640 1 -- 172.21.15.19:0/3964226930 wait complete. 2024-04-25T10:26:11.385 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:26:11.385 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:26:11.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.664+0000 7f041fa00640 1 Processor -- start 2024-04-25T10:26:11.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.664+0000 7f041fa00640 1 -- start start 2024-04-25T10:26:11.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.666+0000 7f041fa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f041815b2c0 0x7f04180c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:11.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.666+0000 7f041fa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0418073160 0x7f041815e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:11.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.666+0000 7f041fa00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0418158010 con 0x7f041815e760 2024-04-25T10:26:11.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.666+0000 7f041fa00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0418074970 con 0x7f041815b2c0 2024-04-25T10:26:11.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.666+0000 7f041fa00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f04180c8600 con 0x7f0418073160 2024-04-25T10:26:11.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.667+0000 7f041d000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f041815b2c0 0x7f04180c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:11.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.667+0000 7f041da00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f041815e760 0x7f04180cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47016/0 (socket says 172.21.15.19:47016) 2024-04-25T10:26:11.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.667+0000 7f041da00640 1 -- 172.21.15.19:0/1940370695 learned_addr learned my addr 172.21.15.19:0/1940370695 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:11.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.667+0000 7f0417e00640 1 --2- 172.21.15.19:0/1940370695 >> v2:172.21.15.112:3300/0 conn(0x7f0418073160 0x7f041815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.667+0000 7f0417400640 1 -- 172.21.15.19:0/1940370695 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562865655 0 0) 0x7f0418158010 con 0x7f041815e760 2024-04-25T10:26:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.667+0000 7f0417400640 1 -- 172.21.15.19:0/1940370695 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0400003520 con 0x7f041815e760 2024-04-25T10:26:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.667+0000 7f041d000640 1 -- 172.21.15.19:0/1940370695 >> v2:172.21.15.112:3300/0 conn(0x7f0418073160 msgr2=0x7f041815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.667+0000 7f041d000640 1 --2- 172.21.15.19:0/1940370695 >> v2:172.21.15.112:3300/0 conn(0x7f0418073160 0x7f041815e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.667+0000 7f041d000640 1 -- 172.21.15.19:0/1940370695 >> v1:172.21.15.19:6789/0 conn(0x7f041815e760 legacy=0x7f04180cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.667+0000 7f041d000640 1 -- 172.21.15.19:0/1940370695 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04180c88e0 con 0x7f041815b2c0 2024-04-25T10:26:11.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.668+0000 7f041d000640 1 --2- 172.21.15.19:0/1940370695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f041815b2c0 0x7f04180c9810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f04180c80b0 tx=0x7f040c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac5a0f27e7f59f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:11.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.669+0000 7f0417400640 1 -- 172.21.15.19:0/1940370695 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c037070 con 0x7f041815b2c0 2024-04-25T10:26:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.669+0000 7f0417400640 1 -- 172.21.15.19:0/1940370695 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c032440 con 0x7f041815b2c0 2024-04-25T10:26:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.669+0000 7f0417400640 1 -- 172.21.15.19:0/1940370695 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c032810 con 0x7f041815b2c0 2024-04-25T10:26:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.669+0000 7f041fa00640 1 -- 172.21.15.19:0/1940370695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f041815b2c0 msgr2=0x7f04180c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.669+0000 7f041fa00640 1 --2- 172.21.15.19:0/1940370695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f041815b2c0 0x7f04180c9810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f04180c80b0 tx=0x7f040c02a230 comp rx=0 tx=0).stop 2024-04-25T10:26:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.670+0000 7f041fa00640 1 -- 172.21.15.19:0/1940370695 shutdown_connections 2024-04-25T10:26:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.670+0000 7f041fa00640 1 --2- 172.21.15.19:0/1940370695 >> v2:172.21.15.112:3300/0 conn(0x7f0418073160 0x7f041815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.670+0000 7f041fa00640 1 --2- 172.21.15.19:0/1940370695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f041815b2c0 0x7f04180c9810 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.670+0000 7f041fa00640 1 -- 172.21.15.19:0/1940370695 >> 172.21.15.19:0/1940370695 conn(0x7f041806f1f0 msgr2=0x7f041806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.670+0000 7f041fa00640 1 -- 172.21.15.19:0/1940370695 shutdown_connections 2024-04-25T10:26:11.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.670+0000 7f041fa00640 1 -- 172.21.15.19:0/1940370695 wait complete. 2024-04-25T10:26:11.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.672+0000 7f041fa00640 1 Processor -- start 2024-04-25T10:26:11.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.672+0000 7f041fa00640 1 -- start start 2024-04-25T10:26:11.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.673+0000 7f041fa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0418073160 0x7f04181f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:11.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f041fa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f041815e760 0x7f04181583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:11.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f041fa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04181513f0 0x7f04180c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:11.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f041fa00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f041806d4c0 con 0x7f041815e760 2024-04-25T10:26:11.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f041fa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f041815a580 con 0x7f0418073160 2024-04-25T10:26:11.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f041fa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f04180ce4f0 con 0x7f04181513f0 2024-04-25T10:26:11.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f0417e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f041815e760 0x7f04181583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f041da00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04181513f0 0x7f04180c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f0417e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f041815e760 0x7f04181583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52422/0 (socket says 172.21.15.19:52422) 2024-04-25T10:26:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f041d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0418073160 0x7f04181f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f0417e00640 1 -- 172.21.15.19:0/3424809160 learned_addr learned my addr 172.21.15.19:0/3424809160 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f0417e00640 1 -- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04181513f0 msgr2=0x7f04180c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f0417e00640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04181513f0 0x7f04180c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f0417e00640 1 -- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0418073160 msgr2=0x7f04181f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f0417e00640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0418073160 0x7f04181f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.674+0000 7f0417e00640 1 -- 172.21.15.19:0/3424809160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04181f2cf0 con 0x7f041815e760 2024-04-25T10:26:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.675+0000 7f0417e00640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f041815e760 0x7f04181583c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f040400e870 tx=0x7f040400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:11.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.675+0000 7f0414c00640 1 -- 172.21.15.19:0/3424809160 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404017070 con 0x7f041815e760 2024-04-25T10:26:11.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.675+0000 7f0414c00640 1 -- 172.21.15.19:0/3424809160 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040400c940 con 0x7f041815e760 2024-04-25T10:26:11.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.675+0000 7f0414c00640 1 -- 172.21.15.19:0/3424809160 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040400cd30 con 0x7f041815e760 2024-04-25T10:26:11.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.675+0000 7f041fa00640 1 -- 172.21.15.19:0/3424809160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04180c4500 con 0x7f041815e760 2024-04-25T10:26:11.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.675+0000 7f041fa00640 1 -- 172.21.15.19:0/3424809160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0418159290 con 0x7f041815e760 2024-04-25T10:26:11.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.676+0000 7f041fa00640 1 -- 172.21.15.19:0/3424809160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04180c47f0 con 0x7f041815e760 2024-04-25T10:26:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.677+0000 7f0414c00640 1 -- 172.21.15.19:0/3424809160 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f040401a070 con 0x7f041815e760 2024-04-25T10:26:11.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.678+0000 7f0414c00640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f03f80744b0 0x7f03f80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:11.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.679+0000 7f0414c00640 1 -- 172.21.15.19:0/3424809160 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0404095400 con 0x7f041815e760 2024-04-25T10:26:11.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.679+0000 7f041d000640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f03f80744b0 0x7f03f80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:11.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.679+0000 7f041d000640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f03f80744b0 0x7f03f80769c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f040c034000 tx=0x7f040c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.684+0000 7f0414c00640 1 -- 172.21.15.19:0/3424809160 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f040405f1f0 con 0x7f041815e760 2024-04-25T10:26:11.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.928+0000 7f041fa00640 1 -- 172.21.15.19:0/3424809160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0418076520 con 0x7f041815e760 2024-04-25T10:26:11.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.929+0000 7f0414c00640 1 -- 172.21.15.19:0/3424809160 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6853 (secure 0 0 0) 0x7f04040634f0 con 0x7f041815e760 2024-04-25T10:26:11.932 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:11.932 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:10.932146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4309,"mds_1":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-25T10:26:11.933 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 11 2024-04-25T10:26:11.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.932+0000 7f041fa00640 1 -- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f03f80744b0 msgr2=0x7f03f80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:11.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.932+0000 7f041fa00640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f03f80744b0 0x7f03f80769c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f040c034000 tx=0x7f040c02e000 comp rx=0 tx=0).stop 2024-04-25T10:26:11.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.932+0000 7f041fa00640 1 -- 172.21.15.19:0/3424809160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f041815e760 msgr2=0x7f04181583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:11.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.932+0000 7f041fa00640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f041815e760 0x7f04181583c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f040400e870 tx=0x7f040400ed30 comp rx=0 tx=0).stop 2024-04-25T10:26:11.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.932+0000 7f041fa00640 1 -- 172.21.15.19:0/3424809160 shutdown_connections 2024-04-25T10:26:11.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.932+0000 7f041fa00640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f03f80744b0 0x7f03f80769c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.932+0000 7f041fa00640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04181513f0 0x7f04180c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.932+0000 7f041fa00640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f041815e760 0x7f04181583c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.932+0000 7f041fa00640 1 --2- 172.21.15.19:0/3424809160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0418073160 0x7f04181f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:11.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.932+0000 7f041fa00640 1 -- 172.21.15.19:0/3424809160 >> 172.21.15.19:0/3424809160 conn(0x7f041806f1f0 msgr2=0x7f04180b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:11.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.933+0000 7f041fa00640 1 -- 172.21.15.19:0/3424809160 shutdown_connections 2024-04-25T10:26:11.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:11.933+0000 7f041fa00640 1 -- 172.21.15.19:0/3424809160 wait complete. 2024-04-25T10:26:11.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:12.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.243+0000 7fcf49600640 1 Processor -- start 2024-04-25T10:26:12.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.244+0000 7fcf49600640 1 -- start start 2024-04-25T10:26:12.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.245+0000 7fcf49600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf440c5180 0x7fcf440ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:12.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.246+0000 7fcf49600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf4415d570 con 0x7fcf440c5590 2024-04-25T10:26:12.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.246+0000 7fcf49600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf4415c9f0 con 0x7fcf440ce5f0 2024-04-25T10:26:12.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.246+0000 7fcf49600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcf440c7030 con 0x7fcf440c5180 2024-04-25T10:26:12.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.246+0000 7fcf43400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcf440c5590 0x7fcf440c74c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47028/0 (socket says 172.21.15.19:47028) 2024-04-25T10:26:12.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.246+0000 7fcf42000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcf440ce5f0 0x7fcf44156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:40760/0 (socket says 172.21.15.19:40760) 2024-04-25T10:26:12.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.246+0000 7fcf43400640 1 -- 172.21.15.19:0/1915178339 learned_addr learned my addr 172.21.15.19:0/1915178339 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:12.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.246+0000 7fcf42a00640 1 --2- 172.21.15.19:0/1915178339 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf440c5180 0x7fcf440ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.246+0000 7fcf41600640 1 -- 172.21.15.19:0/1915178339 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567198989 0 0) 0x7fcf4415c9f0 con 0x7fcf440ce5f0 2024-04-25T10:26:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.247+0000 7fcf41600640 1 -- 172.21.15.19:0/1915178339 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf28003520 con 0x7fcf440ce5f0 2024-04-25T10:26:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.247+0000 7fcf42a00640 1 -- 172.21.15.19:0/1915178339 >> v1:172.21.15.112:6789/0 conn(0x7fcf440ce5f0 legacy=0x7fcf44156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.247+0000 7fcf42a00640 1 -- 172.21.15.19:0/1915178339 >> v1:172.21.15.19:6789/0 conn(0x7fcf440c5590 legacy=0x7fcf440c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.247+0000 7fcf41600640 1 -- 172.21.15.19:0/1915178339 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646769641 0 0) 0x7fcf4415d570 con 0x7fcf440c5590 2024-04-25T10:26:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.247+0000 7fcf42a00640 1 -- 172.21.15.19:0/1915178339 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4415ccd0 con 0x7fcf440c5180 2024-04-25T10:26:12.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.248+0000 7fcf42a00640 1 --2- 172.21.15.19:0/1915178339 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf440c5180 0x7fcf440ce0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0097d0 tx=0x7fcf2c02a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d91f812e62399225 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:12.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.248+0000 7fcf41600640 1 -- 172.21.15.19:0/1915178339 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c037070 con 0x7fcf440c5180 2024-04-25T10:26:12.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.248+0000 7fcf41600640 1 -- 172.21.15.19:0/1915178339 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c032440 con 0x7fcf440c5180 2024-04-25T10:26:12.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.248+0000 7fcf41600640 1 -- 172.21.15.19:0/1915178339 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0327f0 con 0x7fcf440c5180 2024-04-25T10:26:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.249+0000 7fcf49600640 1 -- 172.21.15.19:0/1915178339 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf440c5180 msgr2=0x7fcf440ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.249+0000 7fcf49600640 1 --2- 172.21.15.19:0/1915178339 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf440c5180 0x7fcf440ce0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0097d0 tx=0x7fcf2c02a2a0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.249+0000 7fcf49600640 1 -- 172.21.15.19:0/1915178339 shutdown_connections 2024-04-25T10:26:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.249+0000 7fcf49600640 1 --2- 172.21.15.19:0/1915178339 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf440c5180 0x7fcf440ce0b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.249+0000 7fcf49600640 1 -- 172.21.15.19:0/1915178339 >> 172.21.15.19:0/1915178339 conn(0x7fcf4406f3e0 msgr2=0x7fcf4406f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.249+0000 7fcf49600640 1 -- 172.21.15.19:0/1915178339 shutdown_connections 2024-04-25T10:26:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.249+0000 7fcf49600640 1 -- 172.21.15.19:0/1915178339 wait complete. 2024-04-25T10:26:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.251+0000 7fcf49600640 1 Processor -- start 2024-04-25T10:26:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.252+0000 7fcf49600640 1 -- start start 2024-04-25T10:26:12.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.253+0000 7fcf49600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf440c5180 0x7fcf4414aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.253+0000 7fcf49600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf440c5590 0x7fcf441f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.253+0000 7fcf49600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf440cb050 0x7fcf4414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.253+0000 7fcf49600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4415c620 con 0x7fcf440cb050 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.253+0000 7fcf49600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4415d290 con 0x7fcf440c5180 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.253+0000 7fcf49600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4415c7a0 con 0x7fcf440c5590 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.254+0000 7fcf42a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf440c5180 0x7fcf4414aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.254+0000 7fcf43400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf440cb050 0x7fcf4414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.254+0000 7fcf42000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf440c5590 0x7fcf441f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.254+0000 7fcf42a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf440c5180 0x7fcf4414aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39592/0 (socket says 172.21.15.19:39592) 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.254+0000 7fcf42a00640 1 -- 172.21.15.19:0/2624987801 learned_addr learned my addr 172.21.15.19:0/2624987801 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.254+0000 7fcf42a00640 1 -- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf440c5590 msgr2=0x7fcf441f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.254+0000 7fcf42a00640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf440c5590 0x7fcf441f23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.254+0000 7fcf42a00640 1 -- 172.21.15.19:0/2624987801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf440cb050 msgr2=0x7fcf4414d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:12.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.254+0000 7fcf42a00640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf440cb050 0x7fcf4414d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.254+0000 7fcf42a00640 1 -- 172.21.15.19:0/2624987801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf441f28f0 con 0x7fcf440c5180 2024-04-25T10:26:12.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.254+0000 7fcf42a00640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf440c5180 0x7fcf4414aa20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c02a2e0 tx=0x7fcf2c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:12.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.255+0000 7fcf3aa00640 1 -- 172.21.15.19:0/2624987801 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c037040 con 0x7fcf440c5180 2024-04-25T10:26:12.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.255+0000 7fcf3aa00640 1 -- 172.21.15.19:0/2624987801 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c042070 con 0x7fcf440c5180 2024-04-25T10:26:12.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.255+0000 7fcf3aa00640 1 -- 172.21.15.19:0/2624987801 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c03b870 con 0x7fcf440c5180 2024-04-25T10:26:12.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.255+0000 7fcf49600640 1 -- 172.21.15.19:0/2624987801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf44160410 con 0x7fcf440c5180 2024-04-25T10:26:12.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.255+0000 7fcf49600640 1 -- 172.21.15.19:0/2624987801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf4415f1e0 con 0x7fcf440c5180 2024-04-25T10:26:12.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.256+0000 7fcf49600640 1 -- 172.21.15.19:0/2624987801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf44076520 con 0x7fcf440c5180 2024-04-25T10:26:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.257+0000 7fcf3aa00640 1 -- 172.21.15.19:0/2624987801 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcf2c03ba10 con 0x7fcf440c5180 2024-04-25T10:26:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.258+0000 7fcf3aa00640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcf200744e0 0x7fcf200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.258+0000 7fcf3aa00640 1 -- 172.21.15.19:0/2624987801 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcf2c0b5ac0 con 0x7fcf440c5180 2024-04-25T10:26:12.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.259+0000 7fcf42000640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcf200744e0 0x7fcf200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:12.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.259+0000 7fcf42000640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcf200744e0 0x7fcf200769f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf4414ca40 tx=0x7fcf34007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:12.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.262+0000 7fcf3aa00640 1 -- 172.21.15.19:0/2624987801 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf2c04b020 con 0x7fcf440c5180 2024-04-25T10:26:12.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.470+0000 7fcf49600640 1 -- 172.21.15.19:0/2624987801 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf44150710 con 0x7fcf440c5180 2024-04-25T10:26:12.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.472+0000 7fcf3aa00640 1 -- 172.21.15.19:0/2624987801 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18518 (secure 0 0 0) 0x7fcf2c07f8a0 con 0x7fcf440c5180 2024-04-25T10:26:12.475 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:12.476 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:41.790347+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 -- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcf200744e0 msgr2=0x7fcf200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcf200744e0 0x7fcf200769f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf4414ca40 tx=0x7fcf34007d30 comp rx=0 tx=0).stop 2024-04-25T10:26:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 -- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf440c5180 msgr2=0x7fcf4414aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf440c5180 0x7fcf4414aa20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c02a2e0 tx=0x7fcf2c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 -- 172.21.15.19:0/2624987801 shutdown_connections 2024-04-25T10:26:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf440cb050 0x7fcf4414d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcf200744e0 0x7fcf200769f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf440c5590 0x7fcf441f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 --2- 172.21.15.19:0/2624987801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf440c5180 0x7fcf4414aa20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 -- 172.21.15.19:0/2624987801 >> 172.21.15.19:0/2624987801 conn(0x7fcf4406f3e0 msgr2=0x7fcf44155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:12.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 -- 172.21.15.19:0/2624987801 shutdown_connections 2024-04-25T10:26:12.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.475+0000 7fcf49600640 1 -- 172.21.15.19:0/2624987801 wait complete. 2024-04-25T10:26:12.507 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:26:12.507 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:26:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.784+0000 7febb9400640 1 Processor -- start 2024-04-25T10:26:12.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.784+0000 7febb9400640 1 -- start start 2024-04-25T10:26:12.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.786+0000 7febb9400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7febb415b2c0 0x7febb40c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:12.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.786+0000 7febb9400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febb4073160 0x7febb415e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.786+0000 7febb9400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb4158010 con 0x7febb415e760 2024-04-25T10:26:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.786+0000 7febb9400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7febb4074970 con 0x7febb415b2c0 2024-04-25T10:26:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.786+0000 7febb9400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7febb40c8600 con 0x7febb4073160 2024-04-25T10:26:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.787+0000 7febb2800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7febb415b2c0 0x7febb40c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.787+0000 7febb1e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febb4073160 0x7febb415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.787+0000 7febb3200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7febb415e760 0x7febb40cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47036/0 (socket says 172.21.15.19:47036) 2024-04-25T10:26:12.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.787+0000 7febb3200640 1 -- 172.21.15.19:0/1357202943 learned_addr learned my addr 172.21.15.19:0/1357202943 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:12.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.787+0000 7febb1e00640 1 -- 172.21.15.19:0/1357202943 >> v2:172.21.15.112:3300/0 conn(0x7febb415b2c0 msgr2=0x7febb40c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:12.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.787+0000 7febb1e00640 1 --2- 172.21.15.19:0/1357202943 >> v2:172.21.15.112:3300/0 conn(0x7febb415b2c0 0x7febb40c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.787+0000 7febb1e00640 1 -- 172.21.15.19:0/1357202943 >> v1:172.21.15.19:6789/0 conn(0x7febb415e760 legacy=0x7febb40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:12.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.787+0000 7febb1e00640 1 -- 172.21.15.19:0/1357202943 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb40c88e0 con 0x7febb4073160 2024-04-25T10:26:12.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.787+0000 7febb1400640 1 -- 172.21.15.19:0/1357202943 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724554087 0 0) 0x7febb4158010 con 0x7febb415e760 2024-04-25T10:26:12.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.788+0000 7febb1e00640 1 --2- 172.21.15.19:0/1357202943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febb4073160 0x7febb415e220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0097a0 tx=0x7feb9c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7737bcbffbde5ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:12.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.789+0000 7febb1400640 1 -- 172.21.15.19:0/1357202943 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c037070 con 0x7febb4073160 2024-04-25T10:26:12.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.789+0000 7febb1400640 1 -- 172.21.15.19:0/1357202943 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c032440 con 0x7febb4073160 2024-04-25T10:26:12.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.789+0000 7febb1400640 1 -- 172.21.15.19:0/1357202943 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c032810 con 0x7febb4073160 2024-04-25T10:26:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.789+0000 7febb9400640 1 -- 172.21.15.19:0/1357202943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febb4073160 msgr2=0x7febb415e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.789+0000 7febb9400640 1 --2- 172.21.15.19:0/1357202943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febb4073160 0x7febb415e220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0097a0 tx=0x7feb9c02a250 comp rx=0 tx=0).stop 2024-04-25T10:26:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.789+0000 7febb9400640 1 -- 172.21.15.19:0/1357202943 shutdown_connections 2024-04-25T10:26:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.789+0000 7febb9400640 1 --2- 172.21.15.19:0/1357202943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febb4073160 0x7febb415e220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.789+0000 7febb9400640 1 --2- 172.21.15.19:0/1357202943 >> v2:172.21.15.112:3300/0 conn(0x7febb415b2c0 0x7febb40c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.789+0000 7febb9400640 1 -- 172.21.15.19:0/1357202943 >> 172.21.15.19:0/1357202943 conn(0x7febb406f1f0 msgr2=0x7febb406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.789+0000 7febb9400640 1 -- 172.21.15.19:0/1357202943 shutdown_connections 2024-04-25T10:26:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.790+0000 7febb9400640 1 -- 172.21.15.19:0/1357202943 wait complete. 2024-04-25T10:26:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.792+0000 7febb9400640 1 Processor -- start 2024-04-25T10:26:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.792+0000 7febb9400640 1 -- start start 2024-04-25T10:26:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.793+0000 7febb9400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febb4073160 0x7febb41f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.793+0000 7febb9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febb415e760 0x7febb40cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.793+0000 7febb9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb415c3c0 0x7febb414d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.793+0000 7febb9400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7febb406d4c0 con 0x7febb415e760 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.793+0000 7febb9400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7febb415a580 con 0x7febb415c3c0 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.793+0000 7febb9400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7febb40ce4f0 con 0x7febb4073160 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.793+0000 7febb1e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febb415e760 0x7febb40cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.794+0000 7febb1e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febb415e760 0x7febb40cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52434/0 (socket says 172.21.15.19:52434) 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.794+0000 7febb1e00640 1 -- 172.21.15.19:0/2639503121 learned_addr learned my addr 172.21.15.19:0/2639503121 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.794+0000 7febb3200640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb415c3c0 0x7febb414d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.794+0000 7febb2800640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febb4073160 0x7febb41f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.794+0000 7febb1e00640 1 -- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febb4073160 msgr2=0x7febb41f0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.794+0000 7febb1e00640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febb4073160 0x7febb41f0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.794+0000 7febb1e00640 1 -- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb415c3c0 msgr2=0x7febb414d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.794+0000 7febb1e00640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb415c3c0 0x7febb414d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:12.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.794+0000 7febb1e00640 1 -- 172.21.15.19:0/2639503121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb41f4030 con 0x7febb415e760 2024-04-25T10:26:12.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.794+0000 7febb3200640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb415c3c0 0x7febb414d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:12.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.794+0000 7febb1e00640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febb415e760 0x7febb40cca20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0098c0 tx=0x7feb9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:12.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.795+0000 7febaaa00640 1 -- 172.21.15.19:0/2639503121 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c037040 con 0x7febb415e760 2024-04-25T10:26:12.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.795+0000 7febaaa00640 1 -- 172.21.15.19:0/2639503121 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c042070 con 0x7febb415e760 2024-04-25T10:26:12.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.795+0000 7febaaa00640 1 -- 172.21.15.19:0/2639503121 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c030940 con 0x7febb415e760 2024-04-25T10:26:12.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.795+0000 7febb9400640 1 -- 172.21.15.19:0/2639503121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb41f4310 con 0x7febb415e760 2024-04-25T10:26:12.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.795+0000 7febb9400640 1 -- 172.21.15.19:0/2639503121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb40cd560 con 0x7febb415e760 2024-04-25T10:26:12.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.796+0000 7febb9400640 1 -- 172.21.15.19:0/2639503121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb40cb320 con 0x7febb415e760 2024-04-25T10:26:12.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.797+0000 7febaaa00640 1 -- 172.21.15.19:0/2639503121 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feb9c030ae0 con 0x7febb415e760 2024-04-25T10:26:12.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.798+0000 7febaaa00640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb900744e0 0x7feb900769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.798+0000 7febaaa00640 1 -- 172.21.15.19:0/2639503121 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feb9c0b5de0 con 0x7febb415e760 2024-04-25T10:26:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.798+0000 7febb2800640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb900744e0 0x7feb900769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.799+0000 7febb2800640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb900744e0 0x7feb900769f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feba4009aa0 tx=0x7feba4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:12.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:12.803+0000 7febaaa00640 1 -- 172.21.15.19:0/2639503121 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7febb40cb320 con 0x7febb415e760 2024-04-25T10:26:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.002+0000 7febb9400640 1 -- 172.21.15.19:0/2639503121 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7febb41f3de0 con 0x7feb900744e0 2024-04-25T10:26:13.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.013+0000 7febaaa00640 1 -- 172.21.15.19:0/2639503121 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332522 (secure 0 0 0) 0x7febb41f3de0 con 0x7feb900744e0 2024-04-25T10:26:13.022 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:13.024 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:26:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 -- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb900744e0 msgr2=0x7feb900769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb900744e0 0x7feb900769f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feba4009aa0 tx=0x7feba4009190 comp rx=0 tx=0).stop 2024-04-25T10:26:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 -- 172.21.15.19:0/2639503121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febb415e760 msgr2=0x7febb40cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febb415e760 0x7febb40cca20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0098c0 tx=0x7feb9c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 -- 172.21.15.19:0/2639503121 shutdown_connections 2024-04-25T10:26:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb415c3c0 0x7febb414d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febb415e760 0x7febb40cca20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb900744e0 0x7feb900769f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 --2- 172.21.15.19:0/2639503121 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7febb4073160 0x7febb41f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 -- 172.21.15.19:0/2639503121 >> 172.21.15.19:0/2639503121 conn(0x7febb406f1f0 msgr2=0x7febb40cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:13.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 -- 172.21.15.19:0/2639503121 shutdown_connections 2024-04-25T10:26:13.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.021+0000 7febb9400640 1 -- 172.21.15.19:0/2639503121 wait complete. 2024-04-25T10:26:13.049 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-25T10:26:12.587034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":150,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003584"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694853+0000","last_change":"2024-04-25T10:25:36.182605+0000","last_active":"2024-04-25T10:25:42.694853+0000","last_peered":"2024-04-25T10:25:42.694853+0000","last_clean":"2024-04-25T10:25:42.694853+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:25:42.694853+0000","last_undegraded":"2024-04-25T10:25:42.694853+0000","last_fullsized":"2024-04-25T10:25:42.694853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907219+0000","last_change":"2024-04-25T10:25:37.199467+0000","last_active":"2024-04-25T10:25:42.907219+0000","last_peered":"2024-04-25T10:25:42.907219+0000","last_clean":"2024-04-25T10:25:42.907219+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:25:42.907219+0000","last_undegraded":"2024-04-25T10:25:42.907219+0000","last_fullsized":"2024-04-25T10:25:42.907219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739046+0000","last_change":"2024-04-25T10:25:41.234657+0000","last_active":"2024-04-25T10:25:42.739046+0000","last_peered":"2024-04-25T10:25:42.739046+0000","last_clean":"2024-04-25T10:25:42.739046+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:25:42.739046+0000","last_undegraded":"2024-04-25T10:25:42.739046+0000","last_fullsized":"2024-04-25T10:25:42.739046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:56.869031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907367+0000","last_change":"2024-04-25T10:25:36.166548+0000","last_active":"2024-04-25T10:25:42.907367+0000","last_peered":"2024-04-25T10:25:42.907367+0000","last_clean":"2024-04-25T10:25:42.907367+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:25:42.907367+0000","last_undegraded":"2024-04-25T10:25:42.907367+0000","last_fullsized":"2024-04-25T10:25:42.907367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907166+0000","last_change":"2024-04-25T10:25:37.179746+0000","last_active":"2024-04-25T10:25:42.907166+0000","last_peered":"2024-04-25T10:25:42.907166+0000","last_clean":"2024-04-25T10:25:42.907166+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:25:42.907166+0000","last_undegraded":"2024-04-25T10:25:42.907166+0000","last_fullsized":"2024-04-25T10:25:42.907166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213170+0000","last_change":"2024-04-25T10:25:41.232828+0000","last_active":"2024-04-25T10:25:42.213170+0000","last_peered":"2024-04-25T10:25:42.213170+0000","last_clean":"2024-04-25T10:25:42.213170+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:25:42.213170+0000","last_undegraded":"2024-04-25T10:25:42.213170+0000","last_fullsized":"2024-04-25T10:25:42.213170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:01.782881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557901+0000","last_change":"2024-04-25T10:25:36.190035+0000","last_active":"2024-04-25T10:25:42.557901+0000","last_peered":"2024-04-25T10:25:42.557901+0000","last_clean":"2024-04-25T10:25:42.557901+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:25:42.557901+0000","last_undegraded":"2024-04-25T10:25:42.557901+0000","last_fullsized":"2024-04-25T10:25:42.557901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060790+0000","last_change":"2024-04-25T10:25:37.191742+0000","last_active":"2024-04-25T10:25:43.060790+0000","last_peered":"2024-04-25T10:25:43.060790+0000","last_clean":"2024-04-25T10:25:43.060790+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:25:43.060790+0000","last_undegraded":"2024-04-25T10:25:43.060790+0000","last_fullsized":"2024-04-25T10:25:43.060790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214077+0000","last_change":"2024-04-25T10:25:41.242444+0000","last_active":"2024-04-25T10:25:42.214077+0000","last_peered":"2024-04-25T10:25:42.214077+0000","last_clean":"2024-04-25T10:25:42.214077+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:25:42.214077+0000","last_undegraded":"2024-04-25T10:25:42.214077+0000","last_fullsized":"2024-04-25T10:25:42.214077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558215+0000","last_change":"2024-04-25T10:25:36.190527+0000","last_active":"2024-04-25T10:25:42.558215+0000","last_peered":"2024-04-25T10:25:42.558215+0000","last_clean":"2024-04-25T10:25:42.558215+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:25:42.558215+0000","last_undegraded":"2024-04-25T10:25:42.558215+0000","last_fullsized":"2024-04-25T10:25:42.558215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939821+0000","last_change":"2024-04-25T10:25:37.204468+0000","last_active":"2024-04-25T10:25:42.939821+0000","last_peered":"2024-04-25T10:25:42.939821+0000","last_clean":"2024-04-25T10:25:42.939821+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:25:42.939821+0000","last_undegraded":"2024-04-25T10:25:42.939821+0000","last_fullsized":"2024-04-25T10:25:42.939821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213229+0000","last_change":"2024-04-25T10:25:41.236518+0000","last_active":"2024-04-25T10:25:42.213229+0000","last_peered":"2024-04-25T10:25:42.213229+0000","last_clean":"2024-04-25T10:25:42.213229+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:25:42.213229+0000","last_undegraded":"2024-04-25T10:25:42.213229+0000","last_fullsized":"2024-04-25T10:25:42.213229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938344+0000","last_change":"2024-04-25T10:25:37.194114+0000","last_active":"2024-04-25T10:25:42.938344+0000","last_peered":"2024-04-25T10:25:42.938344+0000","last_clean":"2024-04-25T10:25:42.938344+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:25:42.938344+0000","last_undegraded":"2024-04-25T10:25:42.938344+0000","last_fullsized":"2024-04-25T10:25:42.938344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:40.192156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938728+0000","last_change":"2024-04-25T10:25:36.188266+0000","last_active":"2024-04-25T10:25:42.938728+0000","last_peered":"2024-04-25T10:25:42.938728+0000","last_clean":"2024-04-25T10:25:42.938728+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:25:42.938728+0000","last_undegraded":"2024-04-25T10:25:42.938728+0000","last_fullsized":"2024-04-25T10:25:42.938728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.845953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939631+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:25:42.939631+0000","last_peered":"2024-04-25T10:25:42.939631+0000","last_clean":"2024-04-25T10:25:42.939631+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:25:42.939631+0000","last_undegraded":"2024-04-25T10:25:42.939631+0000","last_fullsized":"2024-04-25T10:25:42.939631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:13.684019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739296+0000","last_change":"2024-04-25T10:25:37.166002+0000","last_active":"2024-04-25T10:25:42.739296+0000","last_peered":"2024-04-25T10:25:42.739296+0000","last_clean":"2024-04-25T10:25:42.739296+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:25:42.739296+0000","last_undegraded":"2024-04-25T10:25:42.739296+0000","last_fullsized":"2024-04-25T10:25:42.739296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210956+0000","last_change":"2024-04-25T10:25:36.168204+0000","last_active":"2024-04-25T10:25:42.210956+0000","last_peered":"2024-04-25T10:25:42.210956+0000","last_clean":"2024-04-25T10:25:42.210956+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:25:42.210956+0000","last_undegraded":"2024-04-25T10:25:42.210956+0000","last_fullsized":"2024-04-25T10:25:42.210956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.907635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557959+0000","last_change":"2024-04-25T10:25:41.257264+0000","last_active":"2024-04-25T10:25:42.557959+0000","last_peered":"2024-04-25T10:25:42.557959+0000","last_clean":"2024-04-25T10:25:42.557959+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:25:42.557959+0000","last_undegraded":"2024-04-25T10:25:42.557959+0000","last_fullsized":"2024-04-25T10:25:42.557959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694025+0000","last_change":"2024-04-25T10:25:37.158884+0000","last_active":"2024-04-25T10:25:42.694025+0000","last_peered":"2024-04-25T10:25:42.694025+0000","last_clean":"2024-04-25T10:25:42.694025+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:25:42.694025+0000","last_undegraded":"2024-04-25T10:25:42.694025+0000","last_fullsized":"2024-04-25T10:25:42.694025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694481+0000","last_change":"2024-04-25T10:25:36.173499+0000","last_active":"2024-04-25T10:25:42.694481+0000","last_peered":"2024-04-25T10:25:42.694481+0000","last_clean":"2024-04-25T10:25:42.694481+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:25:42.694481+0000","last_undegraded":"2024-04-25T10:25:42.694481+0000","last_fullsized":"2024-04-25T10:25:42.694481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739678+0000","last_change":"2024-04-25T10:25:41.239990+0000","last_active":"2024-04-25T10:25:42.739678+0000","last_peered":"2024-04-25T10:25:42.739678+0000","last_clean":"2024-04-25T10:25:42.739678+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:25:42.739678+0000","last_undegraded":"2024-04-25T10:25:42.739678+0000","last_fullsized":"2024-04-25T10:25:42.739678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:15.055786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938134+0000","last_change":"2024-04-25T10:25:37.193560+0000","last_active":"2024-04-25T10:25:42.938134+0000","last_peered":"2024-04-25T10:25:42.938134+0000","last_clean":"2024-04-25T10:25:42.938134+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:25:42.938134+0000","last_undegraded":"2024-04-25T10:25:42.938134+0000","last_fullsized":"2024-04-25T10:25:42.938134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.556985+0000","last_change":"2024-04-25T10:25:36.174077+0000","last_active":"2024-04-25T10:25:42.556985+0000","last_peered":"2024-04-25T10:25:42.556985+0000","last_clean":"2024-04-25T10:25:42.556985+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:25:42.556985+0000","last_undegraded":"2024-04-25T10:25:42.556985+0000","last_fullsized":"2024-04-25T10:25:42.556985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215236+0000","last_change":"2024-04-25T10:25:41.262158+0000","last_active":"2024-04-25T10:25:42.215236+0000","last_peered":"2024-04-25T10:25:42.215236+0000","last_clean":"2024-04-25T10:25:42.215236+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:25:42.215236+0000","last_undegraded":"2024-04-25T10:25:42.215236+0000","last_fullsized":"2024-04-25T10:25:42.215236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694651+0000","last_change":"2024-04-25T10:25:37.159876+0000","last_active":"2024-04-25T10:25:42.694651+0000","last_peered":"2024-04-25T10:25:42.694651+0000","last_clean":"2024-04-25T10:25:42.694651+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:25:42.694651+0000","last_undegraded":"2024-04-25T10:25:42.694651+0000","last_fullsized":"2024-04-25T10:25:42.694651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939681+0000","last_change":"2024-04-25T10:25:36.194275+0000","last_active":"2024-04-25T10:25:42.939681+0000","last_peered":"2024-04-25T10:25:42.939681+0000","last_clean":"2024-04-25T10:25:42.939681+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:25:42.939681+0000","last_undegraded":"2024-04-25T10:25:42.939681+0000","last_fullsized":"2024-04-25T10:25:42.939681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213280+0000","last_change":"2024-04-25T10:25:41.261185+0000","last_active":"2024-04-25T10:25:42.213280+0000","last_peered":"2024-04-25T10:25:42.213280+0000","last_clean":"2024-04-25T10:25:42.213280+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:25:42.213280+0000","last_undegraded":"2024-04-25T10:25:42.213280+0000","last_fullsized":"2024-04-25T10:25:42.213280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694769+0000","last_change":"2024-04-25T10:25:37.165436+0000","last_active":"2024-04-25T10:25:42.694769+0000","last_peered":"2024-04-25T10:25:42.694769+0000","last_clean":"2024-04-25T10:25:42.694769+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:25:42.694769+0000","last_undegraded":"2024-04-25T10:25:42.694769+0000","last_fullsized":"2024-04-25T10:25:42.694769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694831+0000","last_change":"2024-04-25T10:25:36.181966+0000","last_active":"2024-04-25T10:25:42.694831+0000","last_peered":"2024-04-25T10:25:42.694831+0000","last_clean":"2024-04-25T10:25:42.694831+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:25:42.694831+0000","last_undegraded":"2024-04-25T10:25:42.694831+0000","last_fullsized":"2024-04-25T10:25:42.694831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694190+0000","last_change":"2024-04-25T10:25:41.246715+0000","last_active":"2024-04-25T10:25:42.694190+0000","last_peered":"2024-04-25T10:25:42.694190+0000","last_clean":"2024-04-25T10:25:42.694190+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:25:42.694190+0000","last_undegraded":"2024-04-25T10:25:42.694190+0000","last_fullsized":"2024-04-25T10:25:42.694190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:03.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211189+0000","last_change":"2024-04-25T10:25:37.170738+0000","last_active":"2024-04-25T10:25:42.211189+0000","last_peered":"2024-04-25T10:25:42.211189+0000","last_clean":"2024-04-25T10:25:42.211189+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:25:42.211189+0000","last_undegraded":"2024-04-25T10:25:42.211189+0000","last_fullsized":"2024-04-25T10:25:42.211189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:43.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940450+0000","last_change":"2024-04-25T10:25:36.186052+0000","last_active":"2024-04-25T10:25:42.940450+0000","last_peered":"2024-04-25T10:25:42.940450+0000","last_clean":"2024-04-25T10:25:42.940450+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:25:42.940450+0000","last_undegraded":"2024-04-25T10:25:42.940450+0000","last_fullsized":"2024-04-25T10:25:42.940450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:42.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210861+0000","last_change":"2024-04-25T10:25:41.244909+0000","last_active":"2024-04-25T10:25:42.210861+0000","last_peered":"2024-04-25T10:25:42.210861+0000","last_clean":"2024-04-25T10:25:42.210861+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:25:42.210861+0000","last_undegraded":"2024-04-25T10:25:42.210861+0000","last_fullsized":"2024-04-25T10:25:42.210861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214362+0000","last_change":"2024-04-25T10:25:37.181614+0000","last_active":"2024-04-25T10:25:42.214362+0000","last_peered":"2024-04-25T10:25:42.214362+0000","last_clean":"2024-04-25T10:25:42.214362+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:25:42.214362+0000","last_undegraded":"2024-04-25T10:25:42.214362+0000","last_fullsized":"2024-04-25T10:25:42.214362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906827+0000","last_change":"2024-04-25T10:25:36.166395+0000","last_active":"2024-04-25T10:25:42.906827+0000","last_peered":"2024-04-25T10:25:42.906827+0000","last_clean":"2024-04-25T10:25:42.906827+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:25:42.906827+0000","last_undegraded":"2024-04-25T10:25:42.906827+0000","last_fullsized":"2024-04-25T10:25:42.906827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210725+0000","last_change":"2024-04-25T10:25:41.237175+0000","last_active":"2024-04-25T10:25:42.210725+0000","last_peered":"2024-04-25T10:25:42.210725+0000","last_clean":"2024-04-25T10:25:42.210725+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:25:42.210725+0000","last_undegraded":"2024-04-25T10:25:42.210725+0000","last_fullsized":"2024-04-25T10:25:42.210725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557408+0000","last_change":"2024-04-25T10:25:37.192638+0000","last_active":"2024-04-25T10:25:42.557408+0000","last_peered":"2024-04-25T10:25:42.557408+0000","last_clean":"2024-04-25T10:25:42.557408+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:25:42.557408+0000","last_undegraded":"2024-04-25T10:25:42.557408+0000","last_fullsized":"2024-04-25T10:25:42.557408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938986+0000","last_change":"2024-04-25T10:25:36.182126+0000","last_active":"2024-04-25T10:25:42.938986+0000","last_peered":"2024-04-25T10:25:42.938986+0000","last_clean":"2024-04-25T10:25:42.938986+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:25:42.938986+0000","last_undegraded":"2024-04-25T10:25:42.938986+0000","last_fullsized":"2024-04-25T10:25:42.938986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:50.385012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211123+0000","last_change":"2024-04-25T10:25:41.247504+0000","last_active":"2024-04-25T10:25:42.211123+0000","last_peered":"2024-04-25T10:25:42.211123+0000","last_clean":"2024-04-25T10:25:42.211123+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:25:42.211123+0000","last_undegraded":"2024-04-25T10:25:42.211123+0000","last_fullsized":"2024-04-25T10:25:42.211123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906483+0000","last_change":"2024-04-25T10:25:37.171962+0000","last_active":"2024-04-25T10:25:42.906483+0000","last_peered":"2024-04-25T10:25:42.906483+0000","last_clean":"2024-04-25T10:25:42.906483+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:25:42.906483+0000","last_undegraded":"2024-04-25T10:25:42.906483+0000","last_fullsized":"2024-04-25T10:25:42.906483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739130+0000","last_change":"2024-04-25T10:25:36.167914+0000","last_active":"2024-04-25T10:25:42.739130+0000","last_peered":"2024-04-25T10:25:42.739130+0000","last_clean":"2024-04-25T10:25:42.739130+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:25:42.739130+0000","last_undegraded":"2024-04-25T10:25:42.739130+0000","last_fullsized":"2024-04-25T10:25:42.739130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211236+0000","last_change":"2024-04-25T10:25:41.250414+0000","last_active":"2024-04-25T10:25:42.211236+0000","last_peered":"2024-04-25T10:25:42.211236+0000","last_clean":"2024-04-25T10:25:42.211236+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:25:42.211236+0000","last_undegraded":"2024-04-25T10:25:42.211236+0000","last_fullsized":"2024-04-25T10:25:42.211236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210559+0000","last_change":"2024-04-25T10:25:37.179610+0000","last_active":"2024-04-25T10:25:42.210559+0000","last_peered":"2024-04-25T10:25:42.210559+0000","last_clean":"2024-04-25T10:25:42.210559+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:25:42.210559+0000","last_undegraded":"2024-04-25T10:25:42.210559+0000","last_fullsized":"2024-04-25T10:25:42.210559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:22.862181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938722+0000","last_change":"2024-04-25T10:25:36.187683+0000","last_active":"2024-04-25T10:25:42.938722+0000","last_peered":"2024-04-25T10:25:42.938722+0000","last_clean":"2024-04-25T10:25:42.938722+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:25:42.938722+0000","last_undegraded":"2024-04-25T10:25:42.938722+0000","last_fullsized":"2024-04-25T10:25:42.938722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907107+0000","last_change":"2024-04-25T10:25:41.239687+0000","last_active":"2024-04-25T10:25:42.907107+0000","last_peered":"2024-04-25T10:25:42.907107+0000","last_clean":"2024-04-25T10:25:42.907107+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:25:42.907107+0000","last_undegraded":"2024-04-25T10:25:42.907107+0000","last_fullsized":"2024-04-25T10:25:42.907107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.061875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694268+0000","last_change":"2024-04-25T10:25:37.172981+0000","last_active":"2024-04-25T10:25:42.694268+0000","last_peered":"2024-04-25T10:25:42.694268+0000","last_clean":"2024-04-25T10:25:42.694268+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:25:42.694268+0000","last_undegraded":"2024-04-25T10:25:42.694268+0000","last_fullsized":"2024-04-25T10:25:42.694268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938849+0000","last_change":"2024-04-25T10:25:36.186586+0000","last_active":"2024-04-25T10:25:42.938849+0000","last_peered":"2024-04-25T10:25:42.938849+0000","last_clean":"2024-04-25T10:25:42.938849+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:25:42.938849+0000","last_undegraded":"2024-04-25T10:25:42.938849+0000","last_fullsized":"2024-04-25T10:25:42.938849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:00.696356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060315+0000","last_change":"2024-04-25T10:25:25.811918+0000","last_active":"2024-04-25T10:25:43.060315+0000","last_peered":"2024-04-25T10:25:43.060315+0000","last_clean":"2024-04-25T10:25:43.060315+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:25:43.060315+0000","last_undegraded":"2024-04-25T10:25:43.060315+0000","last_fullsized":"2024-04-25T10:25:43.060315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_clean_scrub_stamp":"2024-04-25T10:25:24.774439+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:46.603072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940494+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:25:42.940494+0000","last_peered":"2024-04-25T10:25:42.940494+0000","last_clean":"2024-04-25T10:25:42.940494+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:25:42.940494+0000","last_undegraded":"2024-04-25T10:25:42.940494+0000","last_fullsized":"2024-04-25T10:25:42.940494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:56.121358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940058+0000","last_change":"2024-04-25T10:25:37.187670+0000","last_active":"2024-04-25T10:25:42.940058+0000","last_peered":"2024-04-25T10:25:42.940058+0000","last_clean":"2024-04-25T10:25:42.940058+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:25:42.940058+0000","last_undegraded":"2024-04-25T10:25:42.940058+0000","last_fullsized":"2024-04-25T10:25:42.940058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:09.567527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211314+0000","last_change":"2024-04-25T10:25:36.190434+0000","last_active":"2024-04-25T10:25:42.211314+0000","last_peered":"2024-04-25T10:25:42.211314+0000","last_clean":"2024-04-25T10:25:42.211314+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:25:42.211314+0000","last_undegraded":"2024-04-25T10:25:42.211314+0000","last_fullsized":"2024-04-25T10:25:42.211314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213349+0000","last_change":"2024-04-25T10:25:41.249210+0000","last_active":"2024-04-25T10:25:42.213349+0000","last_peered":"2024-04-25T10:25:42.213349+0000","last_clean":"2024-04-25T10:25:42.213349+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:25:42.213349+0000","last_undegraded":"2024-04-25T10:25:42.213349+0000","last_fullsized":"2024-04-25T10:25:42.213349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558163+0000","last_change":"2024-04-25T10:25:37.176608+0000","last_active":"2024-04-25T10:25:42.558163+0000","last_peered":"2024-04-25T10:25:42.558163+0000","last_clean":"2024-04-25T10:25:42.558163+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:25:42.558163+0000","last_undegraded":"2024-04-25T10:25:42.558163+0000","last_fullsized":"2024-04-25T10:25:42.558163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907148+0000","last_change":"2024-04-25T10:25:36.175833+0000","last_active":"2024-04-25T10:25:42.907148+0000","last_peered":"2024-04-25T10:25:42.907148+0000","last_clean":"2024-04-25T10:25:42.907148+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:25:42.907148+0000","last_undegraded":"2024-04-25T10:25:42.907148+0000","last_fullsized":"2024-04-25T10:25:42.907148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906867+0000","last_change":"2024-04-25T10:25:41.256600+0000","last_active":"2024-04-25T10:25:42.906867+0000","last_peered":"2024-04-25T10:25:42.906867+0000","last_clean":"2024-04-25T10:25:42.906867+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:25:42.906867+0000","last_undegraded":"2024-04-25T10:25:42.906867+0000","last_fullsized":"2024-04-25T10:25:42.906867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557874+0000","last_change":"2024-04-25T10:25:37.185203+0000","last_active":"2024-04-25T10:25:42.557874+0000","last_peered":"2024-04-25T10:25:42.557874+0000","last_clean":"2024-04-25T10:25:42.557874+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:25:42.557874+0000","last_undegraded":"2024-04-25T10:25:42.557874+0000","last_fullsized":"2024-04-25T10:25:42.557874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694752+0000","last_change":"2024-04-25T10:25:36.168542+0000","last_active":"2024-04-25T10:25:42.694752+0000","last_peered":"2024-04-25T10:25:42.694752+0000","last_clean":"2024-04-25T10:25:42.694752+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:25:42.694752+0000","last_undegraded":"2024-04-25T10:25:42.694752+0000","last_fullsized":"2024-04-25T10:25:42.694752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938149+0000","last_change":"2024-04-25T10:25:41.242053+0000","last_active":"2024-04-25T10:25:42.938149+0000","last_peered":"2024-04-25T10:25:42.938149+0000","last_clean":"2024-04-25T10:25:42.938149+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:25:42.938149+0000","last_undegraded":"2024-04-25T10:25:42.938149+0000","last_fullsized":"2024-04-25T10:25:42.938149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:05.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215366+0000","last_change":"2024-04-25T10:25:37.198952+0000","last_active":"2024-04-25T10:25:42.215366+0000","last_peered":"2024-04-25T10:25:42.215366+0000","last_clean":"2024-04-25T10:25:42.215366+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:25:42.215366+0000","last_undegraded":"2024-04-25T10:25:42.215366+0000","last_fullsized":"2024-04-25T10:25:42.215366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557962+0000","last_change":"2024-04-25T10:25:36.179694+0000","last_active":"2024-04-25T10:25:42.557962+0000","last_peered":"2024-04-25T10:25:42.557962+0000","last_clean":"2024-04-25T10:25:42.557962+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:25:42.557962+0000","last_undegraded":"2024-04-25T10:25:42.557962+0000","last_fullsized":"2024-04-25T10:25:42.557962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.059908+0000","last_change":"2024-04-25T10:25:41.251379+0000","last_active":"2024-04-25T10:25:43.059908+0000","last_peered":"2024-04-25T10:25:43.059908+0000","last_clean":"2024-04-25T10:25:43.059908+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:25:43.059908+0000","last_undegraded":"2024-04-25T10:25:43.059908+0000","last_fullsized":"2024-04-25T10:25:43.059908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:47.690188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.937946+0000","last_change":"2024-04-25T10:25:37.202390+0000","last_active":"2024-04-25T10:25:42.937946+0000","last_peered":"2024-04-25T10:25:42.937946+0000","last_clean":"2024-04-25T10:25:42.937946+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:25:42.937946+0000","last_undegraded":"2024-04-25T10:25:42.937946+0000","last_fullsized":"2024-04-25T10:25:42.937946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694281+0000","last_change":"2024-04-25T10:25:36.154879+0000","last_active":"2024-04-25T10:25:42.694281+0000","last_peered":"2024-04-25T10:25:42.694281+0000","last_clean":"2024-04-25T10:25:42.694281+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:25:42.694281+0000","last_undegraded":"2024-04-25T10:25:42.694281+0000","last_fullsized":"2024-04-25T10:25:42.694281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907317+0000","last_change":"2024-04-25T10:25:41.239631+0000","last_active":"2024-04-25T10:25:42.907317+0000","last_peered":"2024-04-25T10:25:42.907317+0000","last_clean":"2024-04-25T10:25:42.907317+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:25:42.907317+0000","last_undegraded":"2024-04-25T10:25:42.907317+0000","last_fullsized":"2024-04-25T10:25:42.907317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.684623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060223+0000","last_change":"2024-04-25T10:25:37.181525+0000","last_active":"2024-04-25T10:25:43.060223+0000","last_peered":"2024-04-25T10:25:43.060223+0000","last_clean":"2024-04-25T10:25:43.060223+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:25:43.060223+0000","last_undegraded":"2024-04-25T10:25:43.060223+0000","last_fullsized":"2024-04-25T10:25:43.060223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557280+0000","last_change":"2024-04-25T10:25:36.192797+0000","last_active":"2024-04-25T10:25:42.557280+0000","last_peered":"2024-04-25T10:25:42.557280+0000","last_clean":"2024-04-25T10:25:42.557280+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:25:42.557280+0000","last_undegraded":"2024-04-25T10:25:42.557280+0000","last_fullsized":"2024-04-25T10:25:42.557280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907235+0000","last_change":"2024-04-25T10:25:41.244618+0000","last_active":"2024-04-25T10:25:42.907235+0000","last_peered":"2024-04-25T10:25:42.907235+0000","last_clean":"2024-04-25T10:25:42.907235+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:25:42.907235+0000","last_undegraded":"2024-04-25T10:25:42.907235+0000","last_fullsized":"2024-04-25T10:25:42.907235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:13.625947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938496+0000","last_change":"2024-04-25T10:25:37.208984+0000","last_active":"2024-04-25T10:25:42.938496+0000","last_peered":"2024-04-25T10:25:42.938496+0000","last_clean":"2024-04-25T10:25:42.938496+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:25:42.938496+0000","last_undegraded":"2024-04-25T10:25:42.938496+0000","last_fullsized":"2024-04-25T10:25:42.938496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938829+0000","last_change":"2024-04-25T10:25:36.185689+0000","last_active":"2024-04-25T10:25:42.938829+0000","last_peered":"2024-04-25T10:25:42.938829+0000","last_clean":"2024-04-25T10:25:42.938829+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:25:42.938829+0000","last_undegraded":"2024-04-25T10:25:42.938829+0000","last_fullsized":"2024-04-25T10:25:42.938829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:35.671970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211007+0000","last_change":"2024-04-25T10:25:41.247314+0000","last_active":"2024-04-25T10:25:42.211007+0000","last_peered":"2024-04-25T10:25:42.211007+0000","last_clean":"2024-04-25T10:25:42.211007+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:25:42.211007+0000","last_undegraded":"2024-04-25T10:25:42.211007+0000","last_fullsized":"2024-04-25T10:25:42.211007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210831+0000","last_change":"2024-04-25T10:25:37.193696+0000","last_active":"2024-04-25T10:25:42.210831+0000","last_peered":"2024-04-25T10:25:42.210831+0000","last_clean":"2024-04-25T10:25:42.210831+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:25:42.210831+0000","last_undegraded":"2024-04-25T10:25:42.210831+0000","last_fullsized":"2024-04-25T10:25:42.210831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739406+0000","last_change":"2024-04-25T10:25:36.181843+0000","last_active":"2024-04-25T10:25:42.739406+0000","last_peered":"2024-04-25T10:25:42.739406+0000","last_clean":"2024-04-25T10:25:42.739406+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:25:42.739406+0000","last_undegraded":"2024-04-25T10:25:42.739406+0000","last_fullsized":"2024-04-25T10:25:42.739406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939937+0000","last_change":"2024-04-25T10:25:41.247061+0000","last_active":"2024-04-25T10:25:42.939937+0000","last_peered":"2024-04-25T10:25:42.939937+0000","last_clean":"2024-04-25T10:25:42.939937+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:25:42.939937+0000","last_undegraded":"2024-04-25T10:25:42.939937+0000","last_fullsized":"2024-04-25T10:25:42.939937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.491573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557676+0000","last_change":"2024-04-25T10:25:37.185402+0000","last_active":"2024-04-25T10:25:42.557676+0000","last_peered":"2024-04-25T10:25:42.557676+0000","last_clean":"2024-04-25T10:25:42.557676+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:25:42.557676+0000","last_undegraded":"2024-04-25T10:25:42.557676+0000","last_fullsized":"2024-04-25T10:25:42.557676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:59.881941+0000","last_change":"2024-04-25T10:25:36.166998+0000","last_active":"2024-04-25T10:25:59.881941+0000","last_peered":"2024-04-25T10:25:59.881941+0000","last_clean":"2024-04-25T10:25:59.881941+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:25:59.881941+0000","last_undegraded":"2024-04-25T10:25:59.881941+0000","last_fullsized":"2024-04-25T10:25:59.881941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:25.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694238+0000","last_change":"2024-04-25T10:25:41.248522+0000","last_active":"2024-04-25T10:25:42.694238+0000","last_peered":"2024-04-25T10:25:42.694238+0000","last_clean":"2024-04-25T10:25:42.694238+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:25:42.694238+0000","last_undegraded":"2024-04-25T10:25:42.694238+0000","last_fullsized":"2024-04-25T10:25:42.694238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:51.139406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938911+0000","last_change":"2024-04-25T10:25:37.196588+0000","last_active":"2024-04-25T10:25:42.938911+0000","last_peered":"2024-04-25T10:25:42.938911+0000","last_clean":"2024-04-25T10:25:42.938911+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:25:42.938911+0000","last_undegraded":"2024-04-25T10:25:42.938911+0000","last_fullsized":"2024-04-25T10:25:42.938911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:00.003456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739663+0000","last_change":"2024-04-25T10:25:36.156630+0000","last_active":"2024-04-25T10:25:42.739663+0000","last_peered":"2024-04-25T10:25:42.739663+0000","last_clean":"2024-04-25T10:25:42.739663+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:25:42.739663+0000","last_undegraded":"2024-04-25T10:25:42.739663+0000","last_fullsized":"2024-04-25T10:25:42.739663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214326+0000","last_change":"2024-04-25T10:25:41.261315+0000","last_active":"2024-04-25T10:25:42.214326+0000","last_peered":"2024-04-25T10:25:42.214326+0000","last_clean":"2024-04-25T10:25:42.214326+0000","last_became_active":"2024-04-25T10:25:41.260933+0000","last_became_peered":"2024-04-25T10:25:41.260933+0000","last_unstale":"2024-04-25T10:25:42.214326+0000","last_undegraded":"2024-04-25T10:25:42.214326+0000","last_fullsized":"2024-04-25T10:25:42.214326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907317+0000","last_change":"2024-04-25T10:25:37.187575+0000","last_active":"2024-04-25T10:25:42.907317+0000","last_peered":"2024-04-25T10:25:42.907317+0000","last_clean":"2024-04-25T10:25:42.907317+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:25:42.907317+0000","last_undegraded":"2024-04-25T10:25:42.907317+0000","last_fullsized":"2024-04-25T10:25:42.907317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557647+0000","last_change":"2024-04-25T10:25:36.183582+0000","last_active":"2024-04-25T10:25:42.557647+0000","last_peered":"2024-04-25T10:25:42.557647+0000","last_clean":"2024-04-25T10:25:42.557647+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:25:42.557647+0000","last_undegraded":"2024-04-25T10:25:42.557647+0000","last_fullsized":"2024-04-25T10:25:42.557647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.738922+0000","last_change":"2024-04-25T10:25:41.238488+0000","last_active":"2024-04-25T10:25:42.738922+0000","last_peered":"2024-04-25T10:25:42.738922+0000","last_clean":"2024-04-25T10:25:42.738922+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:25:42.738922+0000","last_undegraded":"2024-04-25T10:25:42.738922+0000","last_fullsized":"2024-04-25T10:25:42.738922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:05.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215257+0000","last_change":"2024-04-25T10:25:37.192707+0000","last_active":"2024-04-25T10:25:42.215257+0000","last_peered":"2024-04-25T10:25:42.215257+0000","last_clean":"2024-04-25T10:25:42.215257+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:25:42.215257+0000","last_undegraded":"2024-04-25T10:25:42.215257+0000","last_fullsized":"2024-04-25T10:25:42.215257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.062293+0000","last_change":"2024-04-25T10:25:36.173755+0000","last_active":"2024-04-25T10:25:43.062293+0000","last_peered":"2024-04-25T10:25:43.062293+0000","last_clean":"2024-04-25T10:25:43.062293+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:25:43.062293+0000","last_undegraded":"2024-04-25T10:25:43.062293+0000","last_fullsized":"2024-04-25T10:25:43.062293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694479+0000","last_change":"2024-04-25T10:25:41.248983+0000","last_active":"2024-04-25T10:25:42.694479+0000","last_peered":"2024-04-25T10:25:42.694479+0000","last_clean":"2024-04-25T10:25:42.694479+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:25:42.694479+0000","last_undegraded":"2024-04-25T10:25:42.694479+0000","last_fullsized":"2024-04-25T10:25:42.694479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.880608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694655+0000","last_change":"2024-04-25T10:25:41.246692+0000","last_active":"2024-04-25T10:25:42.694655+0000","last_peered":"2024-04-25T10:25:42.694655+0000","last_clean":"2024-04-25T10:25:42.694655+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:25:42.694655+0000","last_undegraded":"2024-04-25T10:25:42.694655+0000","last_fullsized":"2024-04-25T10:25:42.694655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:44.250576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694263+0000","last_change":"2024-04-25T10:25:37.178691+0000","last_active":"2024-04-25T10:25:42.694263+0000","last_peered":"2024-04-25T10:25:42.694263+0000","last_clean":"2024-04-25T10:25:42.694263+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:25:42.694263+0000","last_undegraded":"2024-04-25T10:25:42.694263+0000","last_fullsized":"2024-04-25T10:25:42.694263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938338+0000","last_change":"2024-04-25T10:25:36.191338+0000","last_active":"2024-04-25T10:25:42.938338+0000","last_peered":"2024-04-25T10:25:42.938338+0000","last_clean":"2024-04-25T10:25:42.938338+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:25:42.938338+0000","last_undegraded":"2024-04-25T10:25:42.938338+0000","last_fullsized":"2024-04-25T10:25:42.938338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939550+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:25:42.939550+0000","last_peered":"2024-04-25T10:25:42.939550+0000","last_clean":"2024-04-25T10:25:42.939550+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:25:42.939550+0000","last_undegraded":"2024-04-25T10:25:42.939550+0000","last_fullsized":"2024-04-25T10:25:42.939550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:21.254459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906524+0000","last_change":"2024-04-25T10:25:37.170931+0000","last_active":"2024-04-25T10:25:42.906524+0000","last_peered":"2024-04-25T10:25:42.906524+0000","last_clean":"2024-04-25T10:25:42.906524+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:25:42.906524+0000","last_undegraded":"2024-04-25T10:25:42.906524+0000","last_fullsized":"2024-04-25T10:25:42.906524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210600+0000","last_change":"2024-04-25T10:25:36.173721+0000","last_active":"2024-04-25T10:25:42.210600+0000","last_peered":"2024-04-25T10:25:42.210600+0000","last_clean":"2024-04-25T10:25:42.210600+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:25:42.210600+0000","last_undegraded":"2024-04-25T10:25:42.210600+0000","last_fullsized":"2024-04-25T10:25:42.210600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:42.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938659+0000","last_change":"2024-04-25T10:25:36.195499+0000","last_active":"2024-04-25T10:25:42.938659+0000","last_peered":"2024-04-25T10:25:42.938659+0000","last_clean":"2024-04-25T10:25:42.938659+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:25:42.938659+0000","last_undegraded":"2024-04-25T10:25:42.938659+0000","last_fullsized":"2024-04-25T10:25:42.938659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:05.600702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694264+0000","last_change":"2024-04-25T10:25:37.180896+0000","last_active":"2024-04-25T10:25:42.694264+0000","last_peered":"2024-04-25T10:25:42.694264+0000","last_clean":"2024-04-25T10:25:42.694264+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:25:42.694264+0000","last_undegraded":"2024-04-25T10:25:42.694264+0000","last_fullsized":"2024-04-25T10:25:42.694264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694682+0000","last_change":"2024-04-25T10:25:41.231793+0000","last_active":"2024-04-25T10:25:42.694682+0000","last_peered":"2024-04-25T10:25:42.694682+0000","last_clean":"2024-04-25T10:25:42.694682+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:25:42.694682+0000","last_undegraded":"2024-04-25T10:25:42.694682+0000","last_fullsized":"2024-04-25T10:25:42.694682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:33.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906946+0000","last_change":"2024-04-25T10:25:36.166742+0000","last_active":"2024-04-25T10:25:42.906946+0000","last_peered":"2024-04-25T10:25:42.906946+0000","last_clean":"2024-04-25T10:25:42.906946+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:25:42.906946+0000","last_undegraded":"2024-04-25T10:25:42.906946+0000","last_fullsized":"2024-04-25T10:25:42.906946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060207+0000","last_change":"2024-04-25T10:25:37.185699+0000","last_active":"2024-04-25T10:25:43.060207+0000","last_peered":"2024-04-25T10:25:43.060207+0000","last_clean":"2024-04-25T10:25:43.060207+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:25:43.060207+0000","last_undegraded":"2024-04-25T10:25:43.060207+0000","last_fullsized":"2024-04-25T10:25:43.060207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739632+0000","last_change":"2024-04-25T10:25:41.258191+0000","last_active":"2024-04-25T10:25:42.739632+0000","last_peered":"2024-04-25T10:25:42.739632+0000","last_clean":"2024-04-25T10:25:42.739632+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:25:42.739632+0000","last_undegraded":"2024-04-25T10:25:42.739632+0000","last_fullsized":"2024-04-25T10:25:42.739632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.479785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213165+0000","last_change":"2024-04-25T10:25:37.183192+0000","last_active":"2024-04-25T10:25:42.213165+0000","last_peered":"2024-04-25T10:25:42.213165+0000","last_clean":"2024-04-25T10:25:42.213165+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:25:42.213165+0000","last_undegraded":"2024-04-25T10:25:42.213165+0000","last_fullsized":"2024-04-25T10:25:42.213165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739050+0000","last_change":"2024-04-25T10:25:37.180242+0000","last_active":"2024-04-25T10:25:42.739050+0000","last_peered":"2024-04-25T10:25:42.739050+0000","last_clean":"2024-04-25T10:25:42.739050+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:25:42.739050+0000","last_undegraded":"2024-04-25T10:25:42.739050+0000","last_fullsized":"2024-04-25T10:25:42.739050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939126+0000","last_change":"2024-04-25T10:25:37.187312+0000","last_active":"2024-04-25T10:25:42.939126+0000","last_peered":"2024-04-25T10:25:42.939126+0000","last_clean":"2024-04-25T10:25:42.939126+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:25:42.939126+0000","last_undegraded":"2024-04-25T10:25:42.939126+0000","last_fullsized":"2024-04-25T10:25:42.939126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:22.595222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906846+0000","last_change":"2024-04-25T10:25:37.166351+0000","last_active":"2024-04-25T10:25:42.906846+0000","last_peered":"2024-04-25T10:25:42.906846+0000","last_clean":"2024-04-25T10:25:42.906846+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:25:42.906846+0000","last_undegraded":"2024-04-25T10:25:42.906846+0000","last_fullsized":"2024-04-25T10:25:42.906846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211208+0000","last_change":"2024-04-25T10:25:37.181021+0000","last_active":"2024-04-25T10:25:42.211208+0000","last_peered":"2024-04-25T10:25:42.211208+0000","last_clean":"2024-04-25T10:25:42.211208+0000","last_became_active":"2024-04-25T10:25:37.180457+0000","last_became_peered":"2024-04-25T10:25:37.180457+0000","last_unstale":"2024-04-25T10:25:42.211208+0000","last_undegraded":"2024-04-25T10:25:42.211208+0000","last_fullsized":"2024-04-25T10:25:42.211208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211379+0000","last_change":"2024-04-25T10:25:37.170647+0000","last_active":"2024-04-25T10:25:42.211379+0000","last_peered":"2024-04-25T10:25:42.211379+0000","last_clean":"2024-04-25T10:25:42.211379+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:25:42.211379+0000","last_undegraded":"2024-04-25T10:25:42.211379+0000","last_fullsized":"2024-04-25T10:25:42.211379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214987+0000","last_change":"2024-04-25T10:25:37.196676+0000","last_active":"2024-04-25T10:25:42.214987+0000","last_peered":"2024-04-25T10:25:42.214987+0000","last_clean":"2024-04-25T10:25:42.214987+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:25:42.214987+0000","last_undegraded":"2024-04-25T10:25:42.214987+0000","last_fullsized":"2024-04-25T10:25:42.214987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906997+0000","last_change":"2024-04-25T10:25:37.186567+0000","last_active":"2024-04-25T10:25:42.906997+0000","last_peered":"2024-04-25T10:25:42.906997+0000","last_clean":"2024-04-25T10:25:42.906997+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:25:42.906997+0000","last_undegraded":"2024-04-25T10:25:42.906997+0000","last_fullsized":"2024-04-25T10:25:42.906997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938137+0000","last_change":"2024-04-25T10:25:37.184887+0000","last_active":"2024-04-25T10:25:42.938137+0000","last_peered":"2024-04-25T10:25:42.938137+0000","last_clean":"2024-04-25T10:25:42.938137+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:25:42.938137+0000","last_undegraded":"2024-04-25T10:25:42.938137+0000","last_fullsized":"2024-04-25T10:25:42.938137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906496+0000","last_change":"2024-04-25T10:25:37.196649+0000","last_active":"2024-04-25T10:25:42.906496+0000","last_peered":"2024-04-25T10:25:42.906496+0000","last_clean":"2024-04-25T10:25:42.906496+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:25:42.906496+0000","last_undegraded":"2024-04-25T10:25:42.906496+0000","last_fullsized":"2024-04-25T10:25:42.906496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.059874+0000","last_change":"2024-04-25T10:25:37.192093+0000","last_active":"2024-04-25T10:25:43.059874+0000","last_peered":"2024-04-25T10:25:43.059874+0000","last_clean":"2024-04-25T10:25:43.059874+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:25:43.059874+0000","last_undegraded":"2024-04-25T10:25:43.059874+0000","last_fullsized":"2024-04-25T10:25:43.059874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694151+0000","last_change":"2024-04-25T10:25:37.184014+0000","last_active":"2024-04-25T10:25:42.694151+0000","last_peered":"2024-04-25T10:25:42.694151+0000","last_clean":"2024-04-25T10:25:42.694151+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:25:42.694151+0000","last_undegraded":"2024-04-25T10:25:42.694151+0000","last_fullsized":"2024-04-25T10:25:42.694151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:52.810612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558111+0000","last_change":"2024-04-25T10:25:37.187384+0000","last_active":"2024-04-25T10:25:42.558111+0000","last_peered":"2024-04-25T10:25:42.558111+0000","last_clean":"2024-04-25T10:25:42.558111+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:25:42.558111+0000","last_undegraded":"2024-04-25T10:25:42.558111+0000","last_fullsized":"2024-04-25T10:25:42.558111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940269+0000","last_change":"2024-04-25T10:25:37.195712+0000","last_active":"2024-04-25T10:25:42.940269+0000","last_peered":"2024-04-25T10:25:42.940269+0000","last_clean":"2024-04-25T10:25:42.940269+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:25:42.940269+0000","last_undegraded":"2024-04-25T10:25:42.940269+0000","last_fullsized":"2024-04-25T10:25:42.940269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:13.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739591+0000","last_change":"2024-04-25T10:25:37.198664+0000","last_active":"2024-04-25T10:25:42.739591+0000","last_peered":"2024-04-25T10:25:42.739591+0000","last_clean":"2024-04-25T10:25:42.739591+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:25:42.739591+0000","last_undegraded":"2024-04-25T10:25:42.739591+0000","last_fullsized":"2024-04-25T10:25:42.739591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939668+0000","last_change":"2024-04-25T10:25:37.203174+0000","last_active":"2024-04-25T10:25:42.939668+0000","last_peered":"2024-04-25T10:25:42.939668+0000","last_clean":"2024-04-25T10:25:42.939668+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:25:42.939668+0000","last_undegraded":"2024-04-25T10:25:42.939668+0000","last_fullsized":"2024-04-25T10:25:42.939668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:05.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.937977+0000","last_change":"2024-04-25T10:25:37.199911+0000","last_active":"2024-04-25T10:25:42.937977+0000","last_peered":"2024-04-25T10:25:42.937977+0000","last_clean":"2024-04-25T10:25:42.937977+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:25:42.937977+0000","last_undegraded":"2024-04-25T10:25:42.937977+0000","last_fullsized":"2024-04-25T10:25:42.937977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:29.272654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906404+0000","last_change":"2024-04-25T10:25:37.177405+0000","last_active":"2024-04-25T10:25:42.906404+0000","last_peered":"2024-04-25T10:25:42.906404+0000","last_clean":"2024-04-25T10:25:42.906404+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:25:42.906404+0000","last_undegraded":"2024-04-25T10:25:42.906404+0000","last_fullsized":"2024-04-25T10:25:42.906404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210795+0000","last_change":"2024-04-25T10:25:37.167752+0000","last_active":"2024-04-25T10:25:42.210795+0000","last_peered":"2024-04-25T10:25:42.210795+0000","last_clean":"2024-04-25T10:25:42.210795+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:25:42.210795+0000","last_undegraded":"2024-04-25T10:25:42.210795+0000","last_fullsized":"2024-04-25T10:25:42.210795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211127+0000","last_change":"2024-04-25T10:25:37.180781+0000","last_active":"2024-04-25T10:25:42.211127+0000","last_peered":"2024-04-25T10:25:42.211127+0000","last_clean":"2024-04-25T10:25:42.211127+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:25:42.211127+0000","last_undegraded":"2024-04-25T10:25:42.211127+0000","last_fullsized":"2024-04-25T10:25:42.211127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558079+0000","last_change":"2024-04-25T10:25:37.192759+0000","last_active":"2024-04-25T10:25:42.558079+0000","last_peered":"2024-04-25T10:25:42.558079+0000","last_clean":"2024-04-25T10:25:42.558079+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:25:42.558079+0000","last_undegraded":"2024-04-25T10:25:42.558079+0000","last_fullsized":"2024-04-25T10:25:42.558079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557604+0000","last_change":"2024-04-25T10:25:37.195532+0000","last_active":"2024-04-25T10:25:42.557604+0000","last_peered":"2024-04-25T10:25:42.557604+0000","last_clean":"2024-04-25T10:25:42.557604+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:25:42.557604+0000","last_undegraded":"2024-04-25T10:25:42.557604+0000","last_fullsized":"2024-04-25T10:25:42.557604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557494+0000","last_change":"2024-04-25T10:25:37.200331+0000","last_active":"2024-04-25T10:25:42.557494+0000","last_peered":"2024-04-25T10:25:42.557494+0000","last_clean":"2024-04-25T10:25:42.557494+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:25:42.557494+0000","last_undegraded":"2024-04-25T10:25:42.557494+0000","last_fullsized":"2024-04-25T10:25:42.557494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.062123+0000","last_change":"2024-04-25T10:25:37.194514+0000","last_active":"2024-04-25T10:25:43.062123+0000","last_peered":"2024-04-25T10:25:43.062123+0000","last_clean":"2024-04-25T10:25:43.062123+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:25:43.062123+0000","last_undegraded":"2024-04-25T10:25:43.062123+0000","last_fullsized":"2024-04-25T10:25:43.062123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906388+0000","last_change":"2024-04-25T10:25:37.177730+0000","last_active":"2024-04-25T10:25:42.906388+0000","last_peered":"2024-04-25T10:25:42.906388+0000","last_clean":"2024-04-25T10:25:42.906388+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:25:42.906388+0000","last_undegraded":"2024-04-25T10:25:42.906388+0000","last_fullsized":"2024-04-25T10:25:42.906388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557231+0000","last_change":"2024-04-25T10:25:37.173419+0000","last_active":"2024-04-25T10:25:42.557231+0000","last_peered":"2024-04-25T10:25:42.557231+0000","last_clean":"2024-04-25T10:25:42.557231+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:25:42.557231+0000","last_undegraded":"2024-04-25T10:25:42.557231+0000","last_fullsized":"2024-04-25T10:25:42.557231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213625+0000","last_change":"2024-04-25T10:25:37.182871+0000","last_active":"2024-04-25T10:25:42.213625+0000","last_peered":"2024-04-25T10:25:42.213625+0000","last_clean":"2024-04-25T10:25:42.213625+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:25:42.213625+0000","last_undegraded":"2024-04-25T10:25:42.213625+0000","last_fullsized":"2024-04-25T10:25:42.213625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557442+0000","last_change":"2024-04-25T10:25:37.173983+0000","last_active":"2024-04-25T10:25:42.557442+0000","last_peered":"2024-04-25T10:25:42.557442+0000","last_clean":"2024-04-25T10:25:42.557442+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:25:42.557442+0000","last_undegraded":"2024-04-25T10:25:42.557442+0000","last_fullsized":"2024-04-25T10:25:42.557442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213953+0000","last_change":"2024-04-25T10:25:37.182178+0000","last_active":"2024-04-25T10:25:42.213953+0000","last_peered":"2024-04-25T10:25:42.213953+0000","last_clean":"2024-04-25T10:25:42.213953+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:25:42.213953+0000","last_undegraded":"2024-04-25T10:25:42.213953+0000","last_fullsized":"2024-04-25T10:25:42.213953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907005+0000","last_change":"2024-04-25T10:25:37.170383+0000","last_active":"2024-04-25T10:25:42.907005+0000","last_peered":"2024-04-25T10:25:42.907005+0000","last_clean":"2024-04-25T10:25:42.907005+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:25:42.907005+0000","last_undegraded":"2024-04-25T10:25:42.907005+0000","last_fullsized":"2024-04-25T10:25:42.907005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907087+0000","last_change":"2024-04-25T10:25:37.167687+0000","last_active":"2024-04-25T10:25:42.907087+0000","last_peered":"2024-04-25T10:25:42.907087+0000","last_clean":"2024-04-25T10:25:42.907087+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:25:42.907087+0000","last_undegraded":"2024-04-25T10:25:42.907087+0000","last_fullsized":"2024-04-25T10:25:42.907087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557840+0000","last_change":"2024-04-25T10:25:37.196591+0000","last_active":"2024-04-25T10:25:42.557840+0000","last_peered":"2024-04-25T10:25:42.557840+0000","last_clean":"2024-04-25T10:25:42.557840+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:25:42.557840+0000","last_undegraded":"2024-04-25T10:25:42.557840+0000","last_fullsized":"2024-04-25T10:25:42.557840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":100388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":100264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":104778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:26:13.061 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:26:13.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.375+0000 7fe772800640 1 Processor -- start 2024-04-25T10:26:13.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.375+0000 7fe772800640 1 -- start start 2024-04-25T10:26:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.377+0000 7fe772800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe76c0c6800 0x7fe76c156910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.377+0000 7fe772800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe76c0cb3d0 con 0x7fe76c15fc50 2024-04-25T10:26:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.377+0000 7fe772800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe76c15c9b0 con 0x7fe76c0caee0 2024-04-25T10:26:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.377+0000 7fe772800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe76c156e50 con 0x7fe76c0c6800 2024-04-25T10:26:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.377+0000 7fe76aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe76c0c6800 0x7fe76c156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.378+0000 7fe76aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe76c0c6800 0x7fe76c156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52450/0 (socket says 172.21.15.19:52450) 2024-04-25T10:26:13.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.378+0000 7fe76aa00640 1 -- 172.21.15.19:0/1611240051 learned_addr learned my addr 172.21.15.19:0/1611240051 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:13.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.378+0000 7fe76be00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe76c15fc50 0x7fe76c160060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47044/0 (socket says 172.21.15.19:47044) 2024-04-25T10:26:13.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.378+0000 7fe76aa00640 1 -- 172.21.15.19:0/1611240051 >> v1:172.21.15.112:6789/0 conn(0x7fe76c0caee0 legacy=0x7fe76c0cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.378+0000 7fe76aa00640 1 -- 172.21.15.19:0/1611240051 >> v1:172.21.15.19:6789/0 conn(0x7fe76c15fc50 legacy=0x7fe76c160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.378+0000 7fe76a000640 1 -- 172.21.15.19:0/1611240051 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842060463 0 0) 0x7fe76c15c9b0 con 0x7fe76c0caee0 2024-04-25T10:26:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.378+0000 7fe76aa00640 1 -- 172.21.15.19:0/1611240051 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76c15cc90 con 0x7fe76c0c6800 2024-04-25T10:26:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.379+0000 7fe76aa00640 1 --2- 172.21.15.19:0/1611240051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76c0c6800 0x7fe76c156910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe758009870 tx=0x7fe75802a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911a450262ea9a9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.380+0000 7fe76a000640 1 -- 172.21.15.19:0/1611240051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758037070 con 0x7fe76c0c6800 2024-04-25T10:26:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.380+0000 7fe76a000640 1 -- 172.21.15.19:0/1611240051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe758032640 con 0x7fe76c0c6800 2024-04-25T10:26:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.380+0000 7fe76a000640 1 -- 172.21.15.19:0/1611240051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758032a10 con 0x7fe76c0c6800 2024-04-25T10:26:13.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.380+0000 7fe772800640 1 -- 172.21.15.19:0/1611240051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76c0c6800 msgr2=0x7fe76c156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.380+0000 7fe772800640 1 --2- 172.21.15.19:0/1611240051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76c0c6800 0x7fe76c156910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe758009870 tx=0x7fe75802a3c0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.380+0000 7fe772800640 1 -- 172.21.15.19:0/1611240051 shutdown_connections 2024-04-25T10:26:13.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.380+0000 7fe772800640 1 --2- 172.21.15.19:0/1611240051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76c0c6800 0x7fe76c156910 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.380+0000 7fe772800640 1 -- 172.21.15.19:0/1611240051 >> 172.21.15.19:0/1611240051 conn(0x7fe76c0730f0 msgr2=0x7fe76c073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:13.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.380+0000 7fe772800640 1 -- 172.21.15.19:0/1611240051 shutdown_connections 2024-04-25T10:26:13.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.381+0000 7fe772800640 1 -- 172.21.15.19:0/1611240051 wait complete. 2024-04-25T10:26:13.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.383+0000 7fe772800640 1 Processor -- start 2024-04-25T10:26:13.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.383+0000 7fe772800640 1 -- start start 2024-04-25T10:26:13.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe772800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c0c6800 0x7fe76c0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:13.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe772800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe76c0caee0 0x7fe76c0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:13.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe772800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76c15fc50 0x7fe76c1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:13.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe772800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c15c660 con 0x7fe76c15fc50 2024-04-25T10:26:13.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe772800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c15d2e0 con 0x7fe76c0c6800 2024-04-25T10:26:13.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe772800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe76c0d02a0 con 0x7fe76c0caee0 2024-04-25T10:26:13.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe76be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76c15fc50 0x7fe76c1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:13.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe76aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe76c0caee0 0x7fe76c0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:13.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe76b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c0c6800 0x7fe76c0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:13.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe76be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76c15fc50 0x7fe76c1558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52458/0 (socket says 172.21.15.19:52458) 2024-04-25T10:26:13.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe76be00640 1 -- 172.21.15.19:0/3297068021 learned_addr learned my addr 172.21.15.19:0/3297068021 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:13.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe76aa00640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe76c0caee0 0x7fe76c0b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60372/0 (socket says 172.21.15.19:60372) 2024-04-25T10:26:13.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe76be00640 1 -- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe76c0caee0 msgr2=0x7fe76c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe76be00640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe76c0caee0 0x7fe76c0b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe76be00640 1 -- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c0c6800 msgr2=0x7fe76c0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe76be00640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c0c6800 0x7fe76c0c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.385+0000 7fe76be00640 1 -- 172.21.15.19:0/3297068021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76c1f2fc0 con 0x7fe76c15fc50 2024-04-25T10:26:13.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.386+0000 7fe76be00640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76c15fc50 0x7fe76c1558e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe76400c3c0 tx=0x7fe76400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:13.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.386+0000 7fe763400640 1 -- 172.21.15.19:0/3297068021 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7640074e0 con 0x7fe76c15fc50 2024-04-25T10:26:13.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.386+0000 7fe763400640 1 -- 172.21.15.19:0/3297068021 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe764007680 con 0x7fe76c15fc50 2024-04-25T10:26:13.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.386+0000 7fe763400640 1 -- 172.21.15.19:0/3297068021 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7640049e0 con 0x7fe76c15fc50 2024-04-25T10:26:13.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.386+0000 7fe772800640 1 -- 172.21.15.19:0/3297068021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76c0c6ea0 con 0x7fe76c15fc50 2024-04-25T10:26:13.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.386+0000 7fe772800640 1 -- 172.21.15.19:0/3297068021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe76c15c870 con 0x7fe76c15fc50 2024-04-25T10:26:13.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.387+0000 7fe772800640 1 -- 172.21.15.19:0/3297068021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76c06f860 con 0x7fe76c15fc50 2024-04-25T10:26:13.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.389+0000 7fe763400640 1 -- 172.21.15.19:0/3297068021 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe76401a020 con 0x7fe76c15fc50 2024-04-25T10:26:13.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.390+0000 7fe763400640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe74c0744b0 0x7fe74c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:13.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.391+0000 7fe763400640 1 -- 172.21.15.19:0/3297068021 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe764094ae0 con 0x7fe76c15fc50 2024-04-25T10:26:13.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.391+0000 7fe76b400640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe74c0744b0 0x7fe74c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:13.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.391+0000 7fe76b400640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe74c0744b0 0x7fe74c0769c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0012e0 tx=0x7fe75c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:13.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.395+0000 7fe763400640 1 -- 172.21.15.19:0/3297068021 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe76405ea00 con 0x7fe76c15fc50 2024-04-25T10:26:13.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.598+0000 7fe772800640 1 -- 172.21.15.19:0/3297068021 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe76c076520 con 0x7fe74c0744b0 2024-04-25T10:26:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.609+0000 7fe763400640 1 -- 172.21.15.19:0/3297068021 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332522 (secure 0 0 0) 0x7fe76c076520 con 0x7fe74c0744b0 2024-04-25T10:26:13.617 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:13.619 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:26:13.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 -- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe74c0744b0 msgr2=0x7fe74c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe74c0744b0 0x7fe74c0769c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0012e0 tx=0x7fe75c009040 comp rx=0 tx=0).stop 2024-04-25T10:26:13.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 -- 172.21.15.19:0/3297068021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76c15fc50 msgr2=0x7fe76c1558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76c15fc50 0x7fe76c1558e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe76400c3c0 tx=0x7fe76400c880 comp rx=0 tx=0).stop 2024-04-25T10:26:13.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 -- 172.21.15.19:0/3297068021 shutdown_connections 2024-04-25T10:26:13.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76c15fc50 0x7fe76c1558e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe74c0744b0 0x7fe74c0769c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe76c0caee0 0x7fe76c0b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 --2- 172.21.15.19:0/3297068021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c0c6800 0x7fe76c0c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 -- 172.21.15.19:0/3297068021 >> 172.21.15.19:0/3297068021 conn(0x7fe76c0730f0 msgr2=0x7fe76c0ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:13.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 -- 172.21.15.19:0/3297068021 shutdown_connections 2024-04-25T10:26:13.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.616+0000 7fe772800640 1 -- 172.21.15.19:0/3297068021 wait complete. 2024-04-25T10:26:13.644 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-25T10:26:12.587034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":150,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003584"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694853+0000","last_change":"2024-04-25T10:25:36.182605+0000","last_active":"2024-04-25T10:25:42.694853+0000","last_peered":"2024-04-25T10:25:42.694853+0000","last_clean":"2024-04-25T10:25:42.694853+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:25:42.694853+0000","last_undegraded":"2024-04-25T10:25:42.694853+0000","last_fullsized":"2024-04-25T10:25:42.694853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907219+0000","last_change":"2024-04-25T10:25:37.199467+0000","last_active":"2024-04-25T10:25:42.907219+0000","last_peered":"2024-04-25T10:25:42.907219+0000","last_clean":"2024-04-25T10:25:42.907219+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:25:42.907219+0000","last_undegraded":"2024-04-25T10:25:42.907219+0000","last_fullsized":"2024-04-25T10:25:42.907219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739046+0000","last_change":"2024-04-25T10:25:41.234657+0000","last_active":"2024-04-25T10:25:42.739046+0000","last_peered":"2024-04-25T10:25:42.739046+0000","last_clean":"2024-04-25T10:25:42.739046+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:25:42.739046+0000","last_undegraded":"2024-04-25T10:25:42.739046+0000","last_fullsized":"2024-04-25T10:25:42.739046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:56.869031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907367+0000","last_change":"2024-04-25T10:25:36.166548+0000","last_active":"2024-04-25T10:25:42.907367+0000","last_peered":"2024-04-25T10:25:42.907367+0000","last_clean":"2024-04-25T10:25:42.907367+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:25:42.907367+0000","last_undegraded":"2024-04-25T10:25:42.907367+0000","last_fullsized":"2024-04-25T10:25:42.907367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907166+0000","last_change":"2024-04-25T10:25:37.179746+0000","last_active":"2024-04-25T10:25:42.907166+0000","last_peered":"2024-04-25T10:25:42.907166+0000","last_clean":"2024-04-25T10:25:42.907166+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:25:42.907166+0000","last_undegraded":"2024-04-25T10:25:42.907166+0000","last_fullsized":"2024-04-25T10:25:42.907166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213170+0000","last_change":"2024-04-25T10:25:41.232828+0000","last_active":"2024-04-25T10:25:42.213170+0000","last_peered":"2024-04-25T10:25:42.213170+0000","last_clean":"2024-04-25T10:25:42.213170+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:25:42.213170+0000","last_undegraded":"2024-04-25T10:25:42.213170+0000","last_fullsized":"2024-04-25T10:25:42.213170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:01.782881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557901+0000","last_change":"2024-04-25T10:25:36.190035+0000","last_active":"2024-04-25T10:25:42.557901+0000","last_peered":"2024-04-25T10:25:42.557901+0000","last_clean":"2024-04-25T10:25:42.557901+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:25:42.557901+0000","last_undegraded":"2024-04-25T10:25:42.557901+0000","last_fullsized":"2024-04-25T10:25:42.557901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060790+0000","last_change":"2024-04-25T10:25:37.191742+0000","last_active":"2024-04-25T10:25:43.060790+0000","last_peered":"2024-04-25T10:25:43.060790+0000","last_clean":"2024-04-25T10:25:43.060790+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:25:43.060790+0000","last_undegraded":"2024-04-25T10:25:43.060790+0000","last_fullsized":"2024-04-25T10:25:43.060790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214077+0000","last_change":"2024-04-25T10:25:41.242444+0000","last_active":"2024-04-25T10:25:42.214077+0000","last_peered":"2024-04-25T10:25:42.214077+0000","last_clean":"2024-04-25T10:25:42.214077+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:25:42.214077+0000","last_undegraded":"2024-04-25T10:25:42.214077+0000","last_fullsized":"2024-04-25T10:25:42.214077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558215+0000","last_change":"2024-04-25T10:25:36.190527+0000","last_active":"2024-04-25T10:25:42.558215+0000","last_peered":"2024-04-25T10:25:42.558215+0000","last_clean":"2024-04-25T10:25:42.558215+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:25:42.558215+0000","last_undegraded":"2024-04-25T10:25:42.558215+0000","last_fullsized":"2024-04-25T10:25:42.558215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939821+0000","last_change":"2024-04-25T10:25:37.204468+0000","last_active":"2024-04-25T10:25:42.939821+0000","last_peered":"2024-04-25T10:25:42.939821+0000","last_clean":"2024-04-25T10:25:42.939821+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:25:42.939821+0000","last_undegraded":"2024-04-25T10:25:42.939821+0000","last_fullsized":"2024-04-25T10:25:42.939821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213229+0000","last_change":"2024-04-25T10:25:41.236518+0000","last_active":"2024-04-25T10:25:42.213229+0000","last_peered":"2024-04-25T10:25:42.213229+0000","last_clean":"2024-04-25T10:25:42.213229+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:25:42.213229+0000","last_undegraded":"2024-04-25T10:25:42.213229+0000","last_fullsized":"2024-04-25T10:25:42.213229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938344+0000","last_change":"2024-04-25T10:25:37.194114+0000","last_active":"2024-04-25T10:25:42.938344+0000","last_peered":"2024-04-25T10:25:42.938344+0000","last_clean":"2024-04-25T10:25:42.938344+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:25:42.938344+0000","last_undegraded":"2024-04-25T10:25:42.938344+0000","last_fullsized":"2024-04-25T10:25:42.938344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:40.192156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938728+0000","last_change":"2024-04-25T10:25:36.188266+0000","last_active":"2024-04-25T10:25:42.938728+0000","last_peered":"2024-04-25T10:25:42.938728+0000","last_clean":"2024-04-25T10:25:42.938728+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:25:42.938728+0000","last_undegraded":"2024-04-25T10:25:42.938728+0000","last_fullsized":"2024-04-25T10:25:42.938728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.845953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939631+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:25:42.939631+0000","last_peered":"2024-04-25T10:25:42.939631+0000","last_clean":"2024-04-25T10:25:42.939631+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:25:42.939631+0000","last_undegraded":"2024-04-25T10:25:42.939631+0000","last_fullsized":"2024-04-25T10:25:42.939631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:13.684019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739296+0000","last_change":"2024-04-25T10:25:37.166002+0000","last_active":"2024-04-25T10:25:42.739296+0000","last_peered":"2024-04-25T10:25:42.739296+0000","last_clean":"2024-04-25T10:25:42.739296+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:25:42.739296+0000","last_undegraded":"2024-04-25T10:25:42.739296+0000","last_fullsized":"2024-04-25T10:25:42.739296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210956+0000","last_change":"2024-04-25T10:25:36.168204+0000","last_active":"2024-04-25T10:25:42.210956+0000","last_peered":"2024-04-25T10:25:42.210956+0000","last_clean":"2024-04-25T10:25:42.210956+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:25:42.210956+0000","last_undegraded":"2024-04-25T10:25:42.210956+0000","last_fullsized":"2024-04-25T10:25:42.210956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.907635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557959+0000","last_change":"2024-04-25T10:25:41.257264+0000","last_active":"2024-04-25T10:25:42.557959+0000","last_peered":"2024-04-25T10:25:42.557959+0000","last_clean":"2024-04-25T10:25:42.557959+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:25:42.557959+0000","last_undegraded":"2024-04-25T10:25:42.557959+0000","last_fullsized":"2024-04-25T10:25:42.557959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694025+0000","last_change":"2024-04-25T10:25:37.158884+0000","last_active":"2024-04-25T10:25:42.694025+0000","last_peered":"2024-04-25T10:25:42.694025+0000","last_clean":"2024-04-25T10:25:42.694025+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:25:42.694025+0000","last_undegraded":"2024-04-25T10:25:42.694025+0000","last_fullsized":"2024-04-25T10:25:42.694025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694481+0000","last_change":"2024-04-25T10:25:36.173499+0000","last_active":"2024-04-25T10:25:42.694481+0000","last_peered":"2024-04-25T10:25:42.694481+0000","last_clean":"2024-04-25T10:25:42.694481+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:25:42.694481+0000","last_undegraded":"2024-04-25T10:25:42.694481+0000","last_fullsized":"2024-04-25T10:25:42.694481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739678+0000","last_change":"2024-04-25T10:25:41.239990+0000","last_active":"2024-04-25T10:25:42.739678+0000","last_peered":"2024-04-25T10:25:42.739678+0000","last_clean":"2024-04-25T10:25:42.739678+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:25:42.739678+0000","last_undegraded":"2024-04-25T10:25:42.739678+0000","last_fullsized":"2024-04-25T10:25:42.739678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:15.055786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938134+0000","last_change":"2024-04-25T10:25:37.193560+0000","last_active":"2024-04-25T10:25:42.938134+0000","last_peered":"2024-04-25T10:25:42.938134+0000","last_clean":"2024-04-25T10:25:42.938134+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:25:42.938134+0000","last_undegraded":"2024-04-25T10:25:42.938134+0000","last_fullsized":"2024-04-25T10:25:42.938134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.556985+0000","last_change":"2024-04-25T10:25:36.174077+0000","last_active":"2024-04-25T10:25:42.556985+0000","last_peered":"2024-04-25T10:25:42.556985+0000","last_clean":"2024-04-25T10:25:42.556985+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:25:42.556985+0000","last_undegraded":"2024-04-25T10:25:42.556985+0000","last_fullsized":"2024-04-25T10:25:42.556985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215236+0000","last_change":"2024-04-25T10:25:41.262158+0000","last_active":"2024-04-25T10:25:42.215236+0000","last_peered":"2024-04-25T10:25:42.215236+0000","last_clean":"2024-04-25T10:25:42.215236+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:25:42.215236+0000","last_undegraded":"2024-04-25T10:25:42.215236+0000","last_fullsized":"2024-04-25T10:25:42.215236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694651+0000","last_change":"2024-04-25T10:25:37.159876+0000","last_active":"2024-04-25T10:25:42.694651+0000","last_peered":"2024-04-25T10:25:42.694651+0000","last_clean":"2024-04-25T10:25:42.694651+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:25:42.694651+0000","last_undegraded":"2024-04-25T10:25:42.694651+0000","last_fullsized":"2024-04-25T10:25:42.694651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939681+0000","last_change":"2024-04-25T10:25:36.194275+0000","last_active":"2024-04-25T10:25:42.939681+0000","last_peered":"2024-04-25T10:25:42.939681+0000","last_clean":"2024-04-25T10:25:42.939681+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:25:42.939681+0000","last_undegraded":"2024-04-25T10:25:42.939681+0000","last_fullsized":"2024-04-25T10:25:42.939681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213280+0000","last_change":"2024-04-25T10:25:41.261185+0000","last_active":"2024-04-25T10:25:42.213280+0000","last_peered":"2024-04-25T10:25:42.213280+0000","last_clean":"2024-04-25T10:25:42.213280+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:25:42.213280+0000","last_undegraded":"2024-04-25T10:25:42.213280+0000","last_fullsized":"2024-04-25T10:25:42.213280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694769+0000","last_change":"2024-04-25T10:25:37.165436+0000","last_active":"2024-04-25T10:25:42.694769+0000","last_peered":"2024-04-25T10:25:42.694769+0000","last_clean":"2024-04-25T10:25:42.694769+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:25:42.694769+0000","last_undegraded":"2024-04-25T10:25:42.694769+0000","last_fullsized":"2024-04-25T10:25:42.694769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694831+0000","last_change":"2024-04-25T10:25:36.181966+0000","last_active":"2024-04-25T10:25:42.694831+0000","last_peered":"2024-04-25T10:25:42.694831+0000","last_clean":"2024-04-25T10:25:42.694831+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:25:42.694831+0000","last_undegraded":"2024-04-25T10:25:42.694831+0000","last_fullsized":"2024-04-25T10:25:42.694831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694190+0000","last_change":"2024-04-25T10:25:41.246715+0000","last_active":"2024-04-25T10:25:42.694190+0000","last_peered":"2024-04-25T10:25:42.694190+0000","last_clean":"2024-04-25T10:25:42.694190+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:25:42.694190+0000","last_undegraded":"2024-04-25T10:25:42.694190+0000","last_fullsized":"2024-04-25T10:25:42.694190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:03.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211189+0000","last_change":"2024-04-25T10:25:37.170738+0000","last_active":"2024-04-25T10:25:42.211189+0000","last_peered":"2024-04-25T10:25:42.211189+0000","last_clean":"2024-04-25T10:25:42.211189+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:25:42.211189+0000","last_undegraded":"2024-04-25T10:25:42.211189+0000","last_fullsized":"2024-04-25T10:25:42.211189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:43.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940450+0000","last_change":"2024-04-25T10:25:36.186052+0000","last_active":"2024-04-25T10:25:42.940450+0000","last_peered":"2024-04-25T10:25:42.940450+0000","last_clean":"2024-04-25T10:25:42.940450+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:25:42.940450+0000","last_undegraded":"2024-04-25T10:25:42.940450+0000","last_fullsized":"2024-04-25T10:25:42.940450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:42.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210861+0000","last_change":"2024-04-25T10:25:41.244909+0000","last_active":"2024-04-25T10:25:42.210861+0000","last_peered":"2024-04-25T10:25:42.210861+0000","last_clean":"2024-04-25T10:25:42.210861+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:25:42.210861+0000","last_undegraded":"2024-04-25T10:25:42.210861+0000","last_fullsized":"2024-04-25T10:25:42.210861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214362+0000","last_change":"2024-04-25T10:25:37.181614+0000","last_active":"2024-04-25T10:25:42.214362+0000","last_peered":"2024-04-25T10:25:42.214362+0000","last_clean":"2024-04-25T10:25:42.214362+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:25:42.214362+0000","last_undegraded":"2024-04-25T10:25:42.214362+0000","last_fullsized":"2024-04-25T10:25:42.214362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906827+0000","last_change":"2024-04-25T10:25:36.166395+0000","last_active":"2024-04-25T10:25:42.906827+0000","last_peered":"2024-04-25T10:25:42.906827+0000","last_clean":"2024-04-25T10:25:42.906827+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:25:42.906827+0000","last_undegraded":"2024-04-25T10:25:42.906827+0000","last_fullsized":"2024-04-25T10:25:42.906827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210725+0000","last_change":"2024-04-25T10:25:41.237175+0000","last_active":"2024-04-25T10:25:42.210725+0000","last_peered":"2024-04-25T10:25:42.210725+0000","last_clean":"2024-04-25T10:25:42.210725+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:25:42.210725+0000","last_undegraded":"2024-04-25T10:25:42.210725+0000","last_fullsized":"2024-04-25T10:25:42.210725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557408+0000","last_change":"2024-04-25T10:25:37.192638+0000","last_active":"2024-04-25T10:25:42.557408+0000","last_peered":"2024-04-25T10:25:42.557408+0000","last_clean":"2024-04-25T10:25:42.557408+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:25:42.557408+0000","last_undegraded":"2024-04-25T10:25:42.557408+0000","last_fullsized":"2024-04-25T10:25:42.557408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938986+0000","last_change":"2024-04-25T10:25:36.182126+0000","last_active":"2024-04-25T10:25:42.938986+0000","last_peered":"2024-04-25T10:25:42.938986+0000","last_clean":"2024-04-25T10:25:42.938986+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:25:42.938986+0000","last_undegraded":"2024-04-25T10:25:42.938986+0000","last_fullsized":"2024-04-25T10:25:42.938986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:50.385012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211123+0000","last_change":"2024-04-25T10:25:41.247504+0000","last_active":"2024-04-25T10:25:42.211123+0000","last_peered":"2024-04-25T10:25:42.211123+0000","last_clean":"2024-04-25T10:25:42.211123+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:25:42.211123+0000","last_undegraded":"2024-04-25T10:25:42.211123+0000","last_fullsized":"2024-04-25T10:25:42.211123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906483+0000","last_change":"2024-04-25T10:25:37.171962+0000","last_active":"2024-04-25T10:25:42.906483+0000","last_peered":"2024-04-25T10:25:42.906483+0000","last_clean":"2024-04-25T10:25:42.906483+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:25:42.906483+0000","last_undegraded":"2024-04-25T10:25:42.906483+0000","last_fullsized":"2024-04-25T10:25:42.906483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739130+0000","last_change":"2024-04-25T10:25:36.167914+0000","last_active":"2024-04-25T10:25:42.739130+0000","last_peered":"2024-04-25T10:25:42.739130+0000","last_clean":"2024-04-25T10:25:42.739130+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:25:42.739130+0000","last_undegraded":"2024-04-25T10:25:42.739130+0000","last_fullsized":"2024-04-25T10:25:42.739130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211236+0000","last_change":"2024-04-25T10:25:41.250414+0000","last_active":"2024-04-25T10:25:42.211236+0000","last_peered":"2024-04-25T10:25:42.211236+0000","last_clean":"2024-04-25T10:25:42.211236+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:25:42.211236+0000","last_undegraded":"2024-04-25T10:25:42.211236+0000","last_fullsized":"2024-04-25T10:25:42.211236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210559+0000","last_change":"2024-04-25T10:25:37.179610+0000","last_active":"2024-04-25T10:25:42.210559+0000","last_peered":"2024-04-25T10:25:42.210559+0000","last_clean":"2024-04-25T10:25:42.210559+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:25:42.210559+0000","last_undegraded":"2024-04-25T10:25:42.210559+0000","last_fullsized":"2024-04-25T10:25:42.210559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:22.862181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938722+0000","last_change":"2024-04-25T10:25:36.187683+0000","last_active":"2024-04-25T10:25:42.938722+0000","last_peered":"2024-04-25T10:25:42.938722+0000","last_clean":"2024-04-25T10:25:42.938722+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:25:42.938722+0000","last_undegraded":"2024-04-25T10:25:42.938722+0000","last_fullsized":"2024-04-25T10:25:42.938722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907107+0000","last_change":"2024-04-25T10:25:41.239687+0000","last_active":"2024-04-25T10:25:42.907107+0000","last_peered":"2024-04-25T10:25:42.907107+0000","last_clean":"2024-04-25T10:25:42.907107+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:25:42.907107+0000","last_undegraded":"2024-04-25T10:25:42.907107+0000","last_fullsized":"2024-04-25T10:25:42.907107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.061875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694268+0000","last_change":"2024-04-25T10:25:37.172981+0000","last_active":"2024-04-25T10:25:42.694268+0000","last_peered":"2024-04-25T10:25:42.694268+0000","last_clean":"2024-04-25T10:25:42.694268+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:25:42.694268+0000","last_undegraded":"2024-04-25T10:25:42.694268+0000","last_fullsized":"2024-04-25T10:25:42.694268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938849+0000","last_change":"2024-04-25T10:25:36.186586+0000","last_active":"2024-04-25T10:25:42.938849+0000","last_peered":"2024-04-25T10:25:42.938849+0000","last_clean":"2024-04-25T10:25:42.938849+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:25:42.938849+0000","last_undegraded":"2024-04-25T10:25:42.938849+0000","last_fullsized":"2024-04-25T10:25:42.938849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:00.696356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060315+0000","last_change":"2024-04-25T10:25:25.811918+0000","last_active":"2024-04-25T10:25:43.060315+0000","last_peered":"2024-04-25T10:25:43.060315+0000","last_clean":"2024-04-25T10:25:43.060315+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:25:43.060315+0000","last_undegraded":"2024-04-25T10:25:43.060315+0000","last_fullsized":"2024-04-25T10:25:43.060315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_clean_scrub_stamp":"2024-04-25T10:25:24.774439+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:46.603072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940494+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:25:42.940494+0000","last_peered":"2024-04-25T10:25:42.940494+0000","last_clean":"2024-04-25T10:25:42.940494+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:25:42.940494+0000","last_undegraded":"2024-04-25T10:25:42.940494+0000","last_fullsized":"2024-04-25T10:25:42.940494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:56.121358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940058+0000","last_change":"2024-04-25T10:25:37.187670+0000","last_active":"2024-04-25T10:25:42.940058+0000","last_peered":"2024-04-25T10:25:42.940058+0000","last_clean":"2024-04-25T10:25:42.940058+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:25:42.940058+0000","last_undegraded":"2024-04-25T10:25:42.940058+0000","last_fullsized":"2024-04-25T10:25:42.940058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:09.567527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211314+0000","last_change":"2024-04-25T10:25:36.190434+0000","last_active":"2024-04-25T10:25:42.211314+0000","last_peered":"2024-04-25T10:25:42.211314+0000","last_clean":"2024-04-25T10:25:42.211314+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:25:42.211314+0000","last_undegraded":"2024-04-25T10:25:42.211314+0000","last_fullsized":"2024-04-25T10:25:42.211314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213349+0000","last_change":"2024-04-25T10:25:41.249210+0000","last_active":"2024-04-25T10:25:42.213349+0000","last_peered":"2024-04-25T10:25:42.213349+0000","last_clean":"2024-04-25T10:25:42.213349+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:25:42.213349+0000","last_undegraded":"2024-04-25T10:25:42.213349+0000","last_fullsized":"2024-04-25T10:25:42.213349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558163+0000","last_change":"2024-04-25T10:25:37.176608+0000","last_active":"2024-04-25T10:25:42.558163+0000","last_peered":"2024-04-25T10:25:42.558163+0000","last_clean":"2024-04-25T10:25:42.558163+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:25:42.558163+0000","last_undegraded":"2024-04-25T10:25:42.558163+0000","last_fullsized":"2024-04-25T10:25:42.558163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907148+0000","last_change":"2024-04-25T10:25:36.175833+0000","last_active":"2024-04-25T10:25:42.907148+0000","last_peered":"2024-04-25T10:25:42.907148+0000","last_clean":"2024-04-25T10:25:42.907148+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:25:42.907148+0000","last_undegraded":"2024-04-25T10:25:42.907148+0000","last_fullsized":"2024-04-25T10:25:42.907148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906867+0000","last_change":"2024-04-25T10:25:41.256600+0000","last_active":"2024-04-25T10:25:42.906867+0000","last_peered":"2024-04-25T10:25:42.906867+0000","last_clean":"2024-04-25T10:25:42.906867+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:25:42.906867+0000","last_undegraded":"2024-04-25T10:25:42.906867+0000","last_fullsized":"2024-04-25T10:25:42.906867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557874+0000","last_change":"2024-04-25T10:25:37.185203+0000","last_active":"2024-04-25T10:25:42.557874+0000","last_peered":"2024-04-25T10:25:42.557874+0000","last_clean":"2024-04-25T10:25:42.557874+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:25:42.557874+0000","last_undegraded":"2024-04-25T10:25:42.557874+0000","last_fullsized":"2024-04-25T10:25:42.557874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694752+0000","last_change":"2024-04-25T10:25:36.168542+0000","last_active":"2024-04-25T10:25:42.694752+0000","last_peered":"2024-04-25T10:25:42.694752+0000","last_clean":"2024-04-25T10:25:42.694752+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:25:42.694752+0000","last_undegraded":"2024-04-25T10:25:42.694752+0000","last_fullsized":"2024-04-25T10:25:42.694752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938149+0000","last_change":"2024-04-25T10:25:41.242053+0000","last_active":"2024-04-25T10:25:42.938149+0000","last_peered":"2024-04-25T10:25:42.938149+0000","last_clean":"2024-04-25T10:25:42.938149+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:25:42.938149+0000","last_undegraded":"2024-04-25T10:25:42.938149+0000","last_fullsized":"2024-04-25T10:25:42.938149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:05.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215366+0000","last_change":"2024-04-25T10:25:37.198952+0000","last_active":"2024-04-25T10:25:42.215366+0000","last_peered":"2024-04-25T10:25:42.215366+0000","last_clean":"2024-04-25T10:25:42.215366+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:25:42.215366+0000","last_undegraded":"2024-04-25T10:25:42.215366+0000","last_fullsized":"2024-04-25T10:25:42.215366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557962+0000","last_change":"2024-04-25T10:25:36.179694+0000","last_active":"2024-04-25T10:25:42.557962+0000","last_peered":"2024-04-25T10:25:42.557962+0000","last_clean":"2024-04-25T10:25:42.557962+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:25:42.557962+0000","last_undegraded":"2024-04-25T10:25:42.557962+0000","last_fullsized":"2024-04-25T10:25:42.557962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.059908+0000","last_change":"2024-04-25T10:25:41.251379+0000","last_active":"2024-04-25T10:25:43.059908+0000","last_peered":"2024-04-25T10:25:43.059908+0000","last_clean":"2024-04-25T10:25:43.059908+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:25:43.059908+0000","last_undegraded":"2024-04-25T10:25:43.059908+0000","last_fullsized":"2024-04-25T10:25:43.059908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:47.690188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.937946+0000","last_change":"2024-04-25T10:25:37.202390+0000","last_active":"2024-04-25T10:25:42.937946+0000","last_peered":"2024-04-25T10:25:42.937946+0000","last_clean":"2024-04-25T10:25:42.937946+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:25:42.937946+0000","last_undegraded":"2024-04-25T10:25:42.937946+0000","last_fullsized":"2024-04-25T10:25:42.937946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694281+0000","last_change":"2024-04-25T10:25:36.154879+0000","last_active":"2024-04-25T10:25:42.694281+0000","last_peered":"2024-04-25T10:25:42.694281+0000","last_clean":"2024-04-25T10:25:42.694281+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:25:42.694281+0000","last_undegraded":"2024-04-25T10:25:42.694281+0000","last_fullsized":"2024-04-25T10:25:42.694281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907317+0000","last_change":"2024-04-25T10:25:41.239631+0000","last_active":"2024-04-25T10:25:42.907317+0000","last_peered":"2024-04-25T10:25:42.907317+0000","last_clean":"2024-04-25T10:25:42.907317+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:25:42.907317+0000","last_undegraded":"2024-04-25T10:25:42.907317+0000","last_fullsized":"2024-04-25T10:25:42.907317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.684623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060223+0000","last_change":"2024-04-25T10:25:37.181525+0000","last_active":"2024-04-25T10:25:43.060223+0000","last_peered":"2024-04-25T10:25:43.060223+0000","last_clean":"2024-04-25T10:25:43.060223+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:25:43.060223+0000","last_undegraded":"2024-04-25T10:25:43.060223+0000","last_fullsized":"2024-04-25T10:25:43.060223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557280+0000","last_change":"2024-04-25T10:25:36.192797+0000","last_active":"2024-04-25T10:25:42.557280+0000","last_peered":"2024-04-25T10:25:42.557280+0000","last_clean":"2024-04-25T10:25:42.557280+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:25:42.557280+0000","last_undegraded":"2024-04-25T10:25:42.557280+0000","last_fullsized":"2024-04-25T10:25:42.557280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907235+0000","last_change":"2024-04-25T10:25:41.244618+0000","last_active":"2024-04-25T10:25:42.907235+0000","last_peered":"2024-04-25T10:25:42.907235+0000","last_clean":"2024-04-25T10:25:42.907235+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:25:42.907235+0000","last_undegraded":"2024-04-25T10:25:42.907235+0000","last_fullsized":"2024-04-25T10:25:42.907235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:13.625947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938496+0000","last_change":"2024-04-25T10:25:37.208984+0000","last_active":"2024-04-25T10:25:42.938496+0000","last_peered":"2024-04-25T10:25:42.938496+0000","last_clean":"2024-04-25T10:25:42.938496+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:25:42.938496+0000","last_undegraded":"2024-04-25T10:25:42.938496+0000","last_fullsized":"2024-04-25T10:25:42.938496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938829+0000","last_change":"2024-04-25T10:25:36.185689+0000","last_active":"2024-04-25T10:25:42.938829+0000","last_peered":"2024-04-25T10:25:42.938829+0000","last_clean":"2024-04-25T10:25:42.938829+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:25:42.938829+0000","last_undegraded":"2024-04-25T10:25:42.938829+0000","last_fullsized":"2024-04-25T10:25:42.938829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:35.671970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211007+0000","last_change":"2024-04-25T10:25:41.247314+0000","last_active":"2024-04-25T10:25:42.211007+0000","last_peered":"2024-04-25T10:25:42.211007+0000","last_clean":"2024-04-25T10:25:42.211007+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:25:42.211007+0000","last_undegraded":"2024-04-25T10:25:42.211007+0000","last_fullsized":"2024-04-25T10:25:42.211007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210831+0000","last_change":"2024-04-25T10:25:37.193696+0000","last_active":"2024-04-25T10:25:42.210831+0000","last_peered":"2024-04-25T10:25:42.210831+0000","last_clean":"2024-04-25T10:25:42.210831+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:25:42.210831+0000","last_undegraded":"2024-04-25T10:25:42.210831+0000","last_fullsized":"2024-04-25T10:25:42.210831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739406+0000","last_change":"2024-04-25T10:25:36.181843+0000","last_active":"2024-04-25T10:25:42.739406+0000","last_peered":"2024-04-25T10:25:42.739406+0000","last_clean":"2024-04-25T10:25:42.739406+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:25:42.739406+0000","last_undegraded":"2024-04-25T10:25:42.739406+0000","last_fullsized":"2024-04-25T10:25:42.739406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939937+0000","last_change":"2024-04-25T10:25:41.247061+0000","last_active":"2024-04-25T10:25:42.939937+0000","last_peered":"2024-04-25T10:25:42.939937+0000","last_clean":"2024-04-25T10:25:42.939937+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:25:42.939937+0000","last_undegraded":"2024-04-25T10:25:42.939937+0000","last_fullsized":"2024-04-25T10:25:42.939937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.491573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557676+0000","last_change":"2024-04-25T10:25:37.185402+0000","last_active":"2024-04-25T10:25:42.557676+0000","last_peered":"2024-04-25T10:25:42.557676+0000","last_clean":"2024-04-25T10:25:42.557676+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:25:42.557676+0000","last_undegraded":"2024-04-25T10:25:42.557676+0000","last_fullsized":"2024-04-25T10:25:42.557676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:59.881941+0000","last_change":"2024-04-25T10:25:36.166998+0000","last_active":"2024-04-25T10:25:59.881941+0000","last_peered":"2024-04-25T10:25:59.881941+0000","last_clean":"2024-04-25T10:25:59.881941+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:25:59.881941+0000","last_undegraded":"2024-04-25T10:25:59.881941+0000","last_fullsized":"2024-04-25T10:25:59.881941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:25.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694238+0000","last_change":"2024-04-25T10:25:41.248522+0000","last_active":"2024-04-25T10:25:42.694238+0000","last_peered":"2024-04-25T10:25:42.694238+0000","last_clean":"2024-04-25T10:25:42.694238+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:25:42.694238+0000","last_undegraded":"2024-04-25T10:25:42.694238+0000","last_fullsized":"2024-04-25T10:25:42.694238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:51.139406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938911+0000","last_change":"2024-04-25T10:25:37.196588+0000","last_active":"2024-04-25T10:25:42.938911+0000","last_peered":"2024-04-25T10:25:42.938911+0000","last_clean":"2024-04-25T10:25:42.938911+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:25:42.938911+0000","last_undegraded":"2024-04-25T10:25:42.938911+0000","last_fullsized":"2024-04-25T10:25:42.938911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:00.003456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739663+0000","last_change":"2024-04-25T10:25:36.156630+0000","last_active":"2024-04-25T10:25:42.739663+0000","last_peered":"2024-04-25T10:25:42.739663+0000","last_clean":"2024-04-25T10:25:42.739663+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:25:42.739663+0000","last_undegraded":"2024-04-25T10:25:42.739663+0000","last_fullsized":"2024-04-25T10:25:42.739663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214326+0000","last_change":"2024-04-25T10:25:41.261315+0000","last_active":"2024-04-25T10:25:42.214326+0000","last_peered":"2024-04-25T10:25:42.214326+0000","last_clean":"2024-04-25T10:25:42.214326+0000","last_became_active":"2024-04-25T10:25:41.260933+0000","last_became_peered":"2024-04-25T10:25:41.260933+0000","last_unstale":"2024-04-25T10:25:42.214326+0000","last_undegraded":"2024-04-25T10:25:42.214326+0000","last_fullsized":"2024-04-25T10:25:42.214326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907317+0000","last_change":"2024-04-25T10:25:37.187575+0000","last_active":"2024-04-25T10:25:42.907317+0000","last_peered":"2024-04-25T10:25:42.907317+0000","last_clean":"2024-04-25T10:25:42.907317+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:25:42.907317+0000","last_undegraded":"2024-04-25T10:25:42.907317+0000","last_fullsized":"2024-04-25T10:25:42.907317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557647+0000","last_change":"2024-04-25T10:25:36.183582+0000","last_active":"2024-04-25T10:25:42.557647+0000","last_peered":"2024-04-25T10:25:42.557647+0000","last_clean":"2024-04-25T10:25:42.557647+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:25:42.557647+0000","last_undegraded":"2024-04-25T10:25:42.557647+0000","last_fullsized":"2024-04-25T10:25:42.557647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.738922+0000","last_change":"2024-04-25T10:25:41.238488+0000","last_active":"2024-04-25T10:25:42.738922+0000","last_peered":"2024-04-25T10:25:42.738922+0000","last_clean":"2024-04-25T10:25:42.738922+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:25:42.738922+0000","last_undegraded":"2024-04-25T10:25:42.738922+0000","last_fullsized":"2024-04-25T10:25:42.738922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:05.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215257+0000","last_change":"2024-04-25T10:25:37.192707+0000","last_active":"2024-04-25T10:25:42.215257+0000","last_peered":"2024-04-25T10:25:42.215257+0000","last_clean":"2024-04-25T10:25:42.215257+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:25:42.215257+0000","last_undegraded":"2024-04-25T10:25:42.215257+0000","last_fullsized":"2024-04-25T10:25:42.215257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.062293+0000","last_change":"2024-04-25T10:25:36.173755+0000","last_active":"2024-04-25T10:25:43.062293+0000","last_peered":"2024-04-25T10:25:43.062293+0000","last_clean":"2024-04-25T10:25:43.062293+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:25:43.062293+0000","last_undegraded":"2024-04-25T10:25:43.062293+0000","last_fullsized":"2024-04-25T10:25:43.062293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694479+0000","last_change":"2024-04-25T10:25:41.248983+0000","last_active":"2024-04-25T10:25:42.694479+0000","last_peered":"2024-04-25T10:25:42.694479+0000","last_clean":"2024-04-25T10:25:42.694479+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:25:42.694479+0000","last_undegraded":"2024-04-25T10:25:42.694479+0000","last_fullsized":"2024-04-25T10:25:42.694479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.880608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694655+0000","last_change":"2024-04-25T10:25:41.246692+0000","last_active":"2024-04-25T10:25:42.694655+0000","last_peered":"2024-04-25T10:25:42.694655+0000","last_clean":"2024-04-25T10:25:42.694655+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:25:42.694655+0000","last_undegraded":"2024-04-25T10:25:42.694655+0000","last_fullsized":"2024-04-25T10:25:42.694655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:44.250576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694263+0000","last_change":"2024-04-25T10:25:37.178691+0000","last_active":"2024-04-25T10:25:42.694263+0000","last_peered":"2024-04-25T10:25:42.694263+0000","last_clean":"2024-04-25T10:25:42.694263+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:25:42.694263+0000","last_undegraded":"2024-04-25T10:25:42.694263+0000","last_fullsized":"2024-04-25T10:25:42.694263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938338+0000","last_change":"2024-04-25T10:25:36.191338+0000","last_active":"2024-04-25T10:25:42.938338+0000","last_peered":"2024-04-25T10:25:42.938338+0000","last_clean":"2024-04-25T10:25:42.938338+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:25:42.938338+0000","last_undegraded":"2024-04-25T10:25:42.938338+0000","last_fullsized":"2024-04-25T10:25:42.938338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939550+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:25:42.939550+0000","last_peered":"2024-04-25T10:25:42.939550+0000","last_clean":"2024-04-25T10:25:42.939550+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:25:42.939550+0000","last_undegraded":"2024-04-25T10:25:42.939550+0000","last_fullsized":"2024-04-25T10:25:42.939550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:21.254459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906524+0000","last_change":"2024-04-25T10:25:37.170931+0000","last_active":"2024-04-25T10:25:42.906524+0000","last_peered":"2024-04-25T10:25:42.906524+0000","last_clean":"2024-04-25T10:25:42.906524+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:25:42.906524+0000","last_undegraded":"2024-04-25T10:25:42.906524+0000","last_fullsized":"2024-04-25T10:25:42.906524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210600+0000","last_change":"2024-04-25T10:25:36.173721+0000","last_active":"2024-04-25T10:25:42.210600+0000","last_peered":"2024-04-25T10:25:42.210600+0000","last_clean":"2024-04-25T10:25:42.210600+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:25:42.210600+0000","last_undegraded":"2024-04-25T10:25:42.210600+0000","last_fullsized":"2024-04-25T10:25:42.210600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:42.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938659+0000","last_change":"2024-04-25T10:25:36.195499+0000","last_active":"2024-04-25T10:25:42.938659+0000","last_peered":"2024-04-25T10:25:42.938659+0000","last_clean":"2024-04-25T10:25:42.938659+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:25:42.938659+0000","last_undegraded":"2024-04-25T10:25:42.938659+0000","last_fullsized":"2024-04-25T10:25:42.938659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:05.600702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694264+0000","last_change":"2024-04-25T10:25:37.180896+0000","last_active":"2024-04-25T10:25:42.694264+0000","last_peered":"2024-04-25T10:25:42.694264+0000","last_clean":"2024-04-25T10:25:42.694264+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:25:42.694264+0000","last_undegraded":"2024-04-25T10:25:42.694264+0000","last_fullsized":"2024-04-25T10:25:42.694264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694682+0000","last_change":"2024-04-25T10:25:41.231793+0000","last_active":"2024-04-25T10:25:42.694682+0000","last_peered":"2024-04-25T10:25:42.694682+0000","last_clean":"2024-04-25T10:25:42.694682+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:25:42.694682+0000","last_undegraded":"2024-04-25T10:25:42.694682+0000","last_fullsized":"2024-04-25T10:25:42.694682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:33.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906946+0000","last_change":"2024-04-25T10:25:36.166742+0000","last_active":"2024-04-25T10:25:42.906946+0000","last_peered":"2024-04-25T10:25:42.906946+0000","last_clean":"2024-04-25T10:25:42.906946+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:25:42.906946+0000","last_undegraded":"2024-04-25T10:25:42.906946+0000","last_fullsized":"2024-04-25T10:25:42.906946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060207+0000","last_change":"2024-04-25T10:25:37.185699+0000","last_active":"2024-04-25T10:25:43.060207+0000","last_peered":"2024-04-25T10:25:43.060207+0000","last_clean":"2024-04-25T10:25:43.060207+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:25:43.060207+0000","last_undegraded":"2024-04-25T10:25:43.060207+0000","last_fullsized":"2024-04-25T10:25:43.060207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739632+0000","last_change":"2024-04-25T10:25:41.258191+0000","last_active":"2024-04-25T10:25:42.739632+0000","last_peered":"2024-04-25T10:25:42.739632+0000","last_clean":"2024-04-25T10:25:42.739632+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:25:42.739632+0000","last_undegraded":"2024-04-25T10:25:42.739632+0000","last_fullsized":"2024-04-25T10:25:42.739632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.479785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213165+0000","last_change":"2024-04-25T10:25:37.183192+0000","last_active":"2024-04-25T10:25:42.213165+0000","last_peered":"2024-04-25T10:25:42.213165+0000","last_clean":"2024-04-25T10:25:42.213165+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:25:42.213165+0000","last_undegraded":"2024-04-25T10:25:42.213165+0000","last_fullsized":"2024-04-25T10:25:42.213165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739050+0000","last_change":"2024-04-25T10:25:37.180242+0000","last_active":"2024-04-25T10:25:42.739050+0000","last_peered":"2024-04-25T10:25:42.739050+0000","last_clean":"2024-04-25T10:25:42.739050+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:25:42.739050+0000","last_undegraded":"2024-04-25T10:25:42.739050+0000","last_fullsized":"2024-04-25T10:25:42.739050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939126+0000","last_change":"2024-04-25T10:25:37.187312+0000","last_active":"2024-04-25T10:25:42.939126+0000","last_peered":"2024-04-25T10:25:42.939126+0000","last_clean":"2024-04-25T10:25:42.939126+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:25:42.939126+0000","last_undegraded":"2024-04-25T10:25:42.939126+0000","last_fullsized":"2024-04-25T10:25:42.939126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:22.595222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906846+0000","last_change":"2024-04-25T10:25:37.166351+0000","last_active":"2024-04-25T10:25:42.906846+0000","last_peered":"2024-04-25T10:25:42.906846+0000","last_clean":"2024-04-25T10:25:42.906846+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:25:42.906846+0000","last_undegraded":"2024-04-25T10:25:42.906846+0000","last_fullsized":"2024-04-25T10:25:42.906846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211208+0000","last_change":"2024-04-25T10:25:37.181021+0000","last_active":"2024-04-25T10:25:42.211208+0000","last_peered":"2024-04-25T10:25:42.211208+0000","last_clean":"2024-04-25T10:25:42.211208+0000","last_became_active":"2024-04-25T10:25:37.180457+0000","last_became_peered":"2024-04-25T10:25:37.180457+0000","last_unstale":"2024-04-25T10:25:42.211208+0000","last_undegraded":"2024-04-25T10:25:42.211208+0000","last_fullsized":"2024-04-25T10:25:42.211208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211379+0000","last_change":"2024-04-25T10:25:37.170647+0000","last_active":"2024-04-25T10:25:42.211379+0000","last_peered":"2024-04-25T10:25:42.211379+0000","last_clean":"2024-04-25T10:25:42.211379+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:25:42.211379+0000","last_undegraded":"2024-04-25T10:25:42.211379+0000","last_fullsized":"2024-04-25T10:25:42.211379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214987+0000","last_change":"2024-04-25T10:25:37.196676+0000","last_active":"2024-04-25T10:25:42.214987+0000","last_peered":"2024-04-25T10:25:42.214987+0000","last_clean":"2024-04-25T10:25:42.214987+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:25:42.214987+0000","last_undegraded":"2024-04-25T10:25:42.214987+0000","last_fullsized":"2024-04-25T10:25:42.214987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906997+0000","last_change":"2024-04-25T10:25:37.186567+0000","last_active":"2024-04-25T10:25:42.906997+0000","last_peered":"2024-04-25T10:25:42.906997+0000","last_clean":"2024-04-25T10:25:42.906997+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:25:42.906997+0000","last_undegraded":"2024-04-25T10:25:42.906997+0000","last_fullsized":"2024-04-25T10:25:42.906997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938137+0000","last_change":"2024-04-25T10:25:37.184887+0000","last_active":"2024-04-25T10:25:42.938137+0000","last_peered":"2024-04-25T10:25:42.938137+0000","last_clean":"2024-04-25T10:25:42.938137+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:25:42.938137+0000","last_undegraded":"2024-04-25T10:25:42.938137+0000","last_fullsized":"2024-04-25T10:25:42.938137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906496+0000","last_change":"2024-04-25T10:25:37.196649+0000","last_active":"2024-04-25T10:25:42.906496+0000","last_peered":"2024-04-25T10:25:42.906496+0000","last_clean":"2024-04-25T10:25:42.906496+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:25:42.906496+0000","last_undegraded":"2024-04-25T10:25:42.906496+0000","last_fullsized":"2024-04-25T10:25:42.906496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.059874+0000","last_change":"2024-04-25T10:25:37.192093+0000","last_active":"2024-04-25T10:25:43.059874+0000","last_peered":"2024-04-25T10:25:43.059874+0000","last_clean":"2024-04-25T10:25:43.059874+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:25:43.059874+0000","last_undegraded":"2024-04-25T10:25:43.059874+0000","last_fullsized":"2024-04-25T10:25:43.059874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694151+0000","last_change":"2024-04-25T10:25:37.184014+0000","last_active":"2024-04-25T10:25:42.694151+0000","last_peered":"2024-04-25T10:25:42.694151+0000","last_clean":"2024-04-25T10:25:42.694151+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:25:42.694151+0000","last_undegraded":"2024-04-25T10:25:42.694151+0000","last_fullsized":"2024-04-25T10:25:42.694151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:52.810612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558111+0000","last_change":"2024-04-25T10:25:37.187384+0000","last_active":"2024-04-25T10:25:42.558111+0000","last_peered":"2024-04-25T10:25:42.558111+0000","last_clean":"2024-04-25T10:25:42.558111+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:25:42.558111+0000","last_undegraded":"2024-04-25T10:25:42.558111+0000","last_fullsized":"2024-04-25T10:25:42.558111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940269+0000","last_change":"2024-04-25T10:25:37.195712+0000","last_active":"2024-04-25T10:25:42.940269+0000","last_peered":"2024-04-25T10:25:42.940269+0000","last_clean":"2024-04-25T10:25:42.940269+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:25:42.940269+0000","last_undegraded":"2024-04-25T10:25:42.940269+0000","last_fullsized":"2024-04-25T10:25:42.940269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:13.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739591+0000","last_change":"2024-04-25T10:25:37.198664+0000","last_active":"2024-04-25T10:25:42.739591+0000","last_peered":"2024-04-25T10:25:42.739591+0000","last_clean":"2024-04-25T10:25:42.739591+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:25:42.739591+0000","last_undegraded":"2024-04-25T10:25:42.739591+0000","last_fullsized":"2024-04-25T10:25:42.739591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939668+0000","last_change":"2024-04-25T10:25:37.203174+0000","last_active":"2024-04-25T10:25:42.939668+0000","last_peered":"2024-04-25T10:25:42.939668+0000","last_clean":"2024-04-25T10:25:42.939668+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:25:42.939668+0000","last_undegraded":"2024-04-25T10:25:42.939668+0000","last_fullsized":"2024-04-25T10:25:42.939668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:05.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.937977+0000","last_change":"2024-04-25T10:25:37.199911+0000","last_active":"2024-04-25T10:25:42.937977+0000","last_peered":"2024-04-25T10:25:42.937977+0000","last_clean":"2024-04-25T10:25:42.937977+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:25:42.937977+0000","last_undegraded":"2024-04-25T10:25:42.937977+0000","last_fullsized":"2024-04-25T10:25:42.937977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:29.272654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906404+0000","last_change":"2024-04-25T10:25:37.177405+0000","last_active":"2024-04-25T10:25:42.906404+0000","last_peered":"2024-04-25T10:25:42.906404+0000","last_clean":"2024-04-25T10:25:42.906404+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:25:42.906404+0000","last_undegraded":"2024-04-25T10:25:42.906404+0000","last_fullsized":"2024-04-25T10:25:42.906404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210795+0000","last_change":"2024-04-25T10:25:37.167752+0000","last_active":"2024-04-25T10:25:42.210795+0000","last_peered":"2024-04-25T10:25:42.210795+0000","last_clean":"2024-04-25T10:25:42.210795+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:25:42.210795+0000","last_undegraded":"2024-04-25T10:25:42.210795+0000","last_fullsized":"2024-04-25T10:25:42.210795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211127+0000","last_change":"2024-04-25T10:25:37.180781+0000","last_active":"2024-04-25T10:25:42.211127+0000","last_peered":"2024-04-25T10:25:42.211127+0000","last_clean":"2024-04-25T10:25:42.211127+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:25:42.211127+0000","last_undegraded":"2024-04-25T10:25:42.211127+0000","last_fullsized":"2024-04-25T10:25:42.211127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558079+0000","last_change":"2024-04-25T10:25:37.192759+0000","last_active":"2024-04-25T10:25:42.558079+0000","last_peered":"2024-04-25T10:25:42.558079+0000","last_clean":"2024-04-25T10:25:42.558079+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:25:42.558079+0000","last_undegraded":"2024-04-25T10:25:42.558079+0000","last_fullsized":"2024-04-25T10:25:42.558079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557604+0000","last_change":"2024-04-25T10:25:37.195532+0000","last_active":"2024-04-25T10:25:42.557604+0000","last_peered":"2024-04-25T10:25:42.557604+0000","last_clean":"2024-04-25T10:25:42.557604+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:25:42.557604+0000","last_undegraded":"2024-04-25T10:25:42.557604+0000","last_fullsized":"2024-04-25T10:25:42.557604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557494+0000","last_change":"2024-04-25T10:25:37.200331+0000","last_active":"2024-04-25T10:25:42.557494+0000","last_peered":"2024-04-25T10:25:42.557494+0000","last_clean":"2024-04-25T10:25:42.557494+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:25:42.557494+0000","last_undegraded":"2024-04-25T10:25:42.557494+0000","last_fullsized":"2024-04-25T10:25:42.557494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.062123+0000","last_change":"2024-04-25T10:25:37.194514+0000","last_active":"2024-04-25T10:25:43.062123+0000","last_peered":"2024-04-25T10:25:43.062123+0000","last_clean":"2024-04-25T10:25:43.062123+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:25:43.062123+0000","last_undegraded":"2024-04-25T10:25:43.062123+0000","last_fullsized":"2024-04-25T10:25:43.062123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906388+0000","last_change":"2024-04-25T10:25:37.177730+0000","last_active":"2024-04-25T10:25:42.906388+0000","last_peered":"2024-04-25T10:25:42.906388+0000","last_clean":"2024-04-25T10:25:42.906388+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:25:42.906388+0000","last_undegraded":"2024-04-25T10:25:42.906388+0000","last_fullsized":"2024-04-25T10:25:42.906388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557231+0000","last_change":"2024-04-25T10:25:37.173419+0000","last_active":"2024-04-25T10:25:42.557231+0000","last_peered":"2024-04-25T10:25:42.557231+0000","last_clean":"2024-04-25T10:25:42.557231+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:25:42.557231+0000","last_undegraded":"2024-04-25T10:25:42.557231+0000","last_fullsized":"2024-04-25T10:25:42.557231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213625+0000","last_change":"2024-04-25T10:25:37.182871+0000","last_active":"2024-04-25T10:25:42.213625+0000","last_peered":"2024-04-25T10:25:42.213625+0000","last_clean":"2024-04-25T10:25:42.213625+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:25:42.213625+0000","last_undegraded":"2024-04-25T10:25:42.213625+0000","last_fullsized":"2024-04-25T10:25:42.213625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557442+0000","last_change":"2024-04-25T10:25:37.173983+0000","last_active":"2024-04-25T10:25:42.557442+0000","last_peered":"2024-04-25T10:25:42.557442+0000","last_clean":"2024-04-25T10:25:42.557442+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:25:42.557442+0000","last_undegraded":"2024-04-25T10:25:42.557442+0000","last_fullsized":"2024-04-25T10:25:42.557442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213953+0000","last_change":"2024-04-25T10:25:37.182178+0000","last_active":"2024-04-25T10:25:42.213953+0000","last_peered":"2024-04-25T10:25:42.213953+0000","last_clean":"2024-04-25T10:25:42.213953+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:25:42.213953+0000","last_undegraded":"2024-04-25T10:25:42.213953+0000","last_fullsized":"2024-04-25T10:25:42.213953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907005+0000","last_change":"2024-04-25T10:25:37.170383+0000","last_active":"2024-04-25T10:25:42.907005+0000","last_peered":"2024-04-25T10:25:42.907005+0000","last_clean":"2024-04-25T10:25:42.907005+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:25:42.907005+0000","last_undegraded":"2024-04-25T10:25:42.907005+0000","last_fullsized":"2024-04-25T10:25:42.907005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907087+0000","last_change":"2024-04-25T10:25:37.167687+0000","last_active":"2024-04-25T10:25:42.907087+0000","last_peered":"2024-04-25T10:25:42.907087+0000","last_clean":"2024-04-25T10:25:42.907087+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:25:42.907087+0000","last_undegraded":"2024-04-25T10:25:42.907087+0000","last_fullsized":"2024-04-25T10:25:42.907087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557840+0000","last_change":"2024-04-25T10:25:37.196591+0000","last_active":"2024-04-25T10:25:42.557840+0000","last_peered":"2024-04-25T10:25:42.557840+0000","last_clean":"2024-04-25T10:25:42.557840+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:25:42.557840+0000","last_undegraded":"2024-04-25T10:25:42.557840+0000","last_fullsized":"2024-04-25T10:25:42.557840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":100388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":100264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":104778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:26:13.649 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:26:13.650 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T10:26:13.650 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T10:26:13.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T10:26:13.650 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T10:26:13.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.971+0000 7fcccd400640 1 Processor -- start 2024-04-25T10:26:13.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.971+0000 7fcccd400640 1 -- start start 2024-04-25T10:26:13.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.973+0000 7fcccd400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccc80cdde0 0x7fccc80ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:13.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.973+0000 7fcccd400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fccc8073d50 0x7fccc8074160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:13.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.973+0000 7fcccd400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccc80af780 con 0x7fccc8156850 2024-04-25T10:26:13.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.974+0000 7fcccd400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fccc8156c60 con 0x7fccc8073d50 2024-04-25T10:26:13.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.974+0000 7fcccd400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fccc80af1c0 con 0x7fccc80cdde0 2024-04-25T10:26:13.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.974+0000 7fccbfe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccc80cdde0 0x7fccc80ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:13.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.974+0000 7fccc6800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fccc8156850 0x7fccc815d000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47060/0 (socket says 172.21.15.19:47060) 2024-04-25T10:26:13.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.974+0000 7fccc6800640 1 -- 172.21.15.19:0/4083837640 learned_addr learned my addr 172.21.15.19:0/4083837640 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:13.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.974+0000 7fccc7200640 1 --2- 172.21.15.19:0/4083837640 >> v2:172.21.15.112:3300/0 conn(0x7fccc8073d50 0x7fccc8074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:13.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.975+0000 7fccbfe00640 1 -- 172.21.15.19:0/4083837640 >> v2:172.21.15.112:3300/0 conn(0x7fccc8073d50 msgr2=0x7fccc8074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:13.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.975+0000 7fccbfe00640 1 --2- 172.21.15.19:0/4083837640 >> v2:172.21.15.112:3300/0 conn(0x7fccc8073d50 0x7fccc8074160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.975+0000 7fccbfe00640 1 -- 172.21.15.19:0/4083837640 >> v1:172.21.15.19:6789/0 conn(0x7fccc8156850 legacy=0x7fccc815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.975+0000 7fccbfe00640 1 -- 172.21.15.19:0/4083837640 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc80af4a0 con 0x7fccc80cdde0 2024-04-25T10:26:13.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.976+0000 7fccbfe00640 1 --2- 172.21.15.19:0/4083837640 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccc80cdde0 0x7fccc80ce1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fccb00097a0 tx=0x7fccb002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e76d6d94e4b8ab98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:13.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.976+0000 7fccc5e00640 1 -- 172.21.15.19:0/4083837640 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0037070 con 0x7fccc80cdde0 2024-04-25T10:26:13.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.976+0000 7fccc5e00640 1 -- 172.21.15.19:0/4083837640 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb0032440 con 0x7fccc80cdde0 2024-04-25T10:26:13.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.976+0000 7fccc5e00640 1 -- 172.21.15.19:0/4083837640 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0032810 con 0x7fccc80cdde0 2024-04-25T10:26:13.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.977+0000 7fcccd400640 1 -- 172.21.15.19:0/4083837640 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccc80cdde0 msgr2=0x7fccc80ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.977+0000 7fcccd400640 1 --2- 172.21.15.19:0/4083837640 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccc80cdde0 0x7fccc80ce1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fccb00097a0 tx=0x7fccb002a230 comp rx=0 tx=0).stop 2024-04-25T10:26:13.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.977+0000 7fcccd400640 1 -- 172.21.15.19:0/4083837640 shutdown_connections 2024-04-25T10:26:13.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.977+0000 7fcccd400640 1 --2- 172.21.15.19:0/4083837640 >> v2:172.21.15.112:3300/0 conn(0x7fccc8073d50 0x7fccc8074160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.977+0000 7fcccd400640 1 --2- 172.21.15.19:0/4083837640 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccc80cdde0 0x7fccc80ce1f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.977+0000 7fcccd400640 1 -- 172.21.15.19:0/4083837640 >> 172.21.15.19:0/4083837640 conn(0x7fccc806f1f0 msgr2=0x7fccc806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:13.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.977+0000 7fcccd400640 1 -- 172.21.15.19:0/4083837640 shutdown_connections 2024-04-25T10:26:13.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.977+0000 7fcccd400640 1 -- 172.21.15.19:0/4083837640 wait complete. 2024-04-25T10:26:13.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.979+0000 7fcccd400640 1 Processor -- start 2024-04-25T10:26:13.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.980+0000 7fcccd400640 1 -- start start 2024-04-25T10:26:13.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.981+0000 7fcccd400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccc8073d50 0x7fccc8157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:13.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.981+0000 7fcccd400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccc80cdde0 0x7fccc81515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:13.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.981+0000 7fcccd400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccc8156850 0x7fccc81f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:13.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.981+0000 7fcccd400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8073830 con 0x7fccc8073d50 2024-04-25T10:26:13.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.981+0000 7fcccd400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8073550 con 0x7fccc80cdde0 2024-04-25T10:26:13.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.981+0000 7fcccd400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fccc80746a0 con 0x7fccc8156850 2024-04-25T10:26:13.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.981+0000 7fccc6800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccc8073d50 0x7fccc8157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:13.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.981+0000 7fccc6800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccc8073d50 0x7fccc8157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52464/0 (socket says 172.21.15.19:52464) 2024-04-25T10:26:13.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.981+0000 7fccc6800640 1 -- 172.21.15.19:0/3740879643 learned_addr learned my addr 172.21.15.19:0/3740879643 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:13.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.981+0000 7fccc7200640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccc8156850 0x7fccc81f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:13.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.981+0000 7fccbfe00640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccc80cdde0 0x7fccc81515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:13.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.982+0000 7fccc6800640 1 -- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccc8156850 msgr2=0x7fccc81f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.982+0000 7fccc6800640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccc8156850 0x7fccc81f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.982+0000 7fccc6800640 1 -- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccc80cdde0 msgr2=0x7fccc81515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:13.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.982+0000 7fccc6800640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccc80cdde0 0x7fccc81515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:13.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.982+0000 7fccc6800640 1 -- 172.21.15.19:0/3740879643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc80cd170 con 0x7fccc8073d50 2024-04-25T10:26:13.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.982+0000 7fccc6800640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccc8073d50 0x7fccc8157850 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fccb800c3c0 tx=0x7fccb800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:13.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.983+0000 7fccbea00640 1 -- 172.21.15.19:0/3740879643 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8017070 con 0x7fccc8073d50 2024-04-25T10:26:13.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.983+0000 7fccbea00640 1 -- 172.21.15.19:0/3740879643 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb8005ce0 con 0x7fccc8073d50 2024-04-25T10:26:13.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.983+0000 7fccbea00640 1 -- 172.21.15.19:0/3740879643 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb80072f0 con 0x7fccc8073d50 2024-04-25T10:26:13.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.983+0000 7fcccd400640 1 -- 172.21.15.19:0/3740879643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc8157d90 con 0x7fccc8073d50 2024-04-25T10:26:13.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.983+0000 7fcccd400640 1 -- 172.21.15.19:0/3740879643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc80cd3e0 con 0x7fccc8073d50 2024-04-25T10:26:13.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.984+0000 7fcccd400640 1 -- 172.21.15.19:0/3740879643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc8076520 con 0x7fccc8073d50 2024-04-25T10:26:13.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.985+0000 7fccbea00640 1 -- 172.21.15.19:0/3740879643 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fccb801a070 con 0x7fccc8073d50 2024-04-25T10:26:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.986+0000 7fccbea00640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcca40744e0 0x7fcca40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.987+0000 7fccbea00640 1 -- 172.21.15.19:0/3740879643 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fccb8094780 con 0x7fccc8073d50 2024-04-25T10:26:13.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.987+0000 7fccbfe00640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcca40744e0 0x7fcca40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:13.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.988+0000 7fccbfe00640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcca40744e0 0x7fcca40769f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fccb0034000 tx=0x7fccb002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:13.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:13.991+0000 7fccbea00640 1 -- 172.21.15.19:0/3740879643 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fccb805e600 con 0x7fccc8073d50 2024-04-25T10:26:14.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.240+0000 7fcccd400640 1 -- 172.21.15.19:0/3740879643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fccc80b01f0 con 0x7fccc8073d50 2024-04-25T10:26:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.249+0000 7fccbea00640 1 -- 172.21.15.19:0/3740879643 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186744 (secure 0 0 0) 0x7fccb8062900 con 0x7fccc8073d50 2024-04-25T10:26:14.255 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.254+0000 7fcccd400640 1 -- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcca40744e0 msgr2=0x7fcca40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.254+0000 7fcccd400640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcca40744e0 0x7fcca40769f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fccb0034000 tx=0x7fccb002e000 comp rx=0 tx=0).stop 2024-04-25T10:26:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.254+0000 7fcccd400640 1 -- 172.21.15.19:0/3740879643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccc8073d50 msgr2=0x7fccc8157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.254+0000 7fcccd400640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccc8073d50 0x7fccc8157850 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fccb800c3c0 tx=0x7fccb800c880 comp rx=0 tx=0).stop 2024-04-25T10:26:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.254+0000 7fcccd400640 1 -- 172.21.15.19:0/3740879643 shutdown_connections 2024-04-25T10:26:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.254+0000 7fcccd400640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcca40744e0 0x7fcca40769f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.254+0000 7fcccd400640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fccc8156850 0x7fccc81f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.254+0000 7fcccd400640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccc80cdde0 0x7fccc81515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.254+0000 7fcccd400640 1 --2- 172.21.15.19:0/3740879643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccc8073d50 0x7fccc8157850 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.254+0000 7fcccd400640 1 -- 172.21.15.19:0/3740879643 >> 172.21.15.19:0/3740879643 conn(0x7fccc806f1f0 msgr2=0x7fccc8153500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.255+0000 7fcccd400640 1 -- 172.21.15.19:0/3740879643 shutdown_connections 2024-04-25T10:26:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.255+0000 7fcccd400640 1 -- 172.21.15.19:0/3740879643 wait complete. 2024-04-25T10:26:14.286 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"flags":0,"active_gid":4109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":228103152},{"type":"v1","addr":"172.21.15.112:6833","nonce":228103152}]},"active_addr":"172.21.15.112:6833/228103152","active_change":"2024-04-25T10:25:16.563647+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":641081436}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":797147769}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3167412702}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":993133465}]}]} 2024-04-25T10:26:14.291 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T10:26:14.292 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T10:26:14.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:14.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.568+0000 7fd10d200640 1 Processor -- start 2024-04-25T10:26:14.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.568+0000 7fd10d200640 1 -- start start 2024-04-25T10:26:14.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.571+0000 7fd10d200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd10815e400 0x7fd1080ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:14.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.571+0000 7fd10d200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1081544c0 0x7fd10806fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:14.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.571+0000 7fd10d200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1081548d0 con 0x7fd10815a200 2024-04-25T10:26:14.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.571+0000 7fd10d200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd10815ac20 con 0x7fd10815e400 2024-04-25T10:26:14.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.571+0000 7fd10d200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd10815af00 con 0x7fd1081544c0 2024-04-25T10:26:14.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.571+0000 7fd107400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd10815e400 0x7fd1080ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:14.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.571+0000 7fd107400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd10815e400 0x7fd1080ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52478/0 (socket says 172.21.15.19:52478) 2024-04-25T10:26:14.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.571+0000 7fd107400640 1 -- 172.21.15.19:0/2305577554 learned_addr learned my addr 172.21.15.19:0/2305577554 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:14.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.571+0000 7fd106a00640 1 --2- 172.21.15.19:0/2305577554 >> v2:172.21.15.112:3300/0 conn(0x7fd1081544c0 0x7fd10806fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:14.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.572+0000 7fd107400640 1 -- 172.21.15.19:0/2305577554 >> v2:172.21.15.112:3300/0 conn(0x7fd1081544c0 msgr2=0x7fd10806fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:14.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.572+0000 7fd107400640 1 --2- 172.21.15.19:0/2305577554 >> v2:172.21.15.112:3300/0 conn(0x7fd1081544c0 0x7fd10806fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.572+0000 7fd107400640 1 -- 172.21.15.19:0/2305577554 >> v1:172.21.15.112:6789/0 conn(0x7fd10815a200 legacy=0x7fd1080cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:14.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.572+0000 7fd107400640 1 -- 172.21.15.19:0/2305577554 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10815d920 con 0x7fd10815e400 2024-04-25T10:26:14.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.573+0000 7fd107400640 1 --2- 172.21.15.19:0/2305577554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815e400 0x7fd1080ca3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009870 tx=0x7fd0f802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542e681014aba192 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:14.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.573+0000 7fd106000640 1 -- 172.21.15.19:0/2305577554 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8037070 con 0x7fd10815e400 2024-04-25T10:26:14.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.573+0000 7fd106000640 1 -- 172.21.15.19:0/2305577554 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f8032440 con 0x7fd10815e400 2024-04-25T10:26:14.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.573+0000 7fd106000640 1 -- 172.21.15.19:0/2305577554 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8032810 con 0x7fd10815e400 2024-04-25T10:26:14.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.574+0000 7fd10d200640 1 -- 172.21.15.19:0/2305577554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815e400 msgr2=0x7fd1080ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:14.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.574+0000 7fd10d200640 1 --2- 172.21.15.19:0/2305577554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815e400 0x7fd1080ca3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009870 tx=0x7fd0f802a2a0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.574+0000 7fd10d200640 1 -- 172.21.15.19:0/2305577554 shutdown_connections 2024-04-25T10:26:14.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.574+0000 7fd10d200640 1 --2- 172.21.15.19:0/2305577554 >> v2:172.21.15.112:3300/0 conn(0x7fd1081544c0 0x7fd10806fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.574+0000 7fd10d200640 1 --2- 172.21.15.19:0/2305577554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815e400 0x7fd1080ca3f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.574+0000 7fd10d200640 1 -- 172.21.15.19:0/2305577554 >> 172.21.15.19:0/2305577554 conn(0x7fd10806d6d0 msgr2=0x7fd10806dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:14.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.574+0000 7fd10d200640 1 -- 172.21.15.19:0/2305577554 shutdown_connections 2024-04-25T10:26:14.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.574+0000 7fd10d200640 1 -- 172.21.15.19:0/2305577554 wait complete. 2024-04-25T10:26:14.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.576+0000 7fd10d200640 1 Processor -- start 2024-04-25T10:26:14.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.577+0000 7fd10d200640 1 -- start start 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.578+0000 7fd10d200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1081544c0 0x7fd1081f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.578+0000 7fd10d200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd10815a200 0x7fd108150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.578+0000 7fd10d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815e400 0x7fd10814e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.578+0000 7fd10d200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd1080cb840 con 0x7fd10815e400 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.578+0000 7fd10d200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd10815dee0 con 0x7fd10815a200 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.578+0000 7fd10d200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd1080cb9c0 con 0x7fd1081544c0 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.578+0000 7fd107400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1081544c0 0x7fd1081f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.579+0000 7fd107400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1081544c0 0x7fd1081f3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60396/0 (socket says 172.21.15.19:60396) 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.579+0000 7fd106a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd10815a200 0x7fd108150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.579+0000 7fd107400640 1 -- 172.21.15.19:0/198809404 learned_addr learned my addr 172.21.15.19:0/198809404 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.579+0000 7fd107e00640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815e400 0x7fd10814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.579+0000 7fd107400640 1 -- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd10815a200 msgr2=0x7fd108150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:14.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.579+0000 7fd107400640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd10815a200 0x7fd108150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.579+0000 7fd107400640 1 -- 172.21.15.19:0/198809404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815e400 msgr2=0x7fd10814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:14.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.579+0000 7fd107400640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815e400 0x7fd10814e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.579+0000 7fd107400640 1 -- 172.21.15.19:0/198809404 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1081f3870 con 0x7fd1081544c0 2024-04-25T10:26:14.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.580+0000 7fd107400640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1081544c0 0x7fd1081f3330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd0f802a2e0 tx=0x7fd0f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:14.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.580+0000 7fd0ff400640 1 -- 172.21.15.19:0/198809404 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8037040 con 0x7fd1081544c0 2024-04-25T10:26:14.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.580+0000 7fd0ff400640 1 -- 172.21.15.19:0/198809404 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f8042070 con 0x7fd1081544c0 2024-04-25T10:26:14.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.580+0000 7fd0ff400640 1 -- 172.21.15.19:0/198809404 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8030880 con 0x7fd1081544c0 2024-04-25T10:26:14.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.580+0000 7fd10d200640 1 -- 172.21.15.19:0/198809404 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10814f3f0 con 0x7fd1081544c0 2024-04-25T10:26:14.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.580+0000 7fd10d200640 1 -- 172.21.15.19:0/198809404 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1080c3cc0 con 0x7fd1081544c0 2024-04-25T10:26:14.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.581+0000 7fd10d200640 1 -- 172.21.15.19:0/198809404 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1080c3f00 con 0x7fd1081544c0 2024-04-25T10:26:14.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.583+0000 7fd0ff400640 1 -- 172.21.15.19:0/198809404 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd0f8030a20 con 0x7fd1081544c0 2024-04-25T10:26:14.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.584+0000 7fd0ff400640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0e40744b0 0x7fd0e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.584+0000 7fd0ff400640 1 -- 172.21.15.19:0/198809404 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd0f80b5d50 con 0x7fd1081544c0 2024-04-25T10:26:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.584+0000 7fd106a00640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0e40744b0 0x7fd0e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.585+0000 7fd106a00640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0e40744b0 0x7fd0e40769c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd108076420 tx=0x7fd0f0009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:14.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.590+0000 7fd0ff400640 1 -- 172.21.15.19:0/198809404 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd1080c3f00 con 0x7fd1081544c0 2024-04-25T10:26:14.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.793+0000 7fd10d200640 1 -- 172.21.15.19:0/198809404 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd108050740 con 0x7fd1081544c0 2024-04-25T10:26:14.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.795+0000 7fd0ff400640 1 -- 172.21.15.19:0/198809404 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18518 (secure 0 0 0) 0x7fd0f807fb40 con 0x7fd1081544c0 2024-04-25T10:26:14.798 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:14.798 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:41.790347+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:14.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.798+0000 7fd10d200640 1 -- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0e40744b0 msgr2=0x7fd0e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:14.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.798+0000 7fd10d200640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0e40744b0 0x7fd0e40769c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd108076420 tx=0x7fd0f0009190 comp rx=0 tx=0).stop 2024-04-25T10:26:14.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.798+0000 7fd10d200640 1 -- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1081544c0 msgr2=0x7fd1081f3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:14.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.798+0000 7fd10d200640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1081544c0 0x7fd1081f3330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd0f802a2e0 tx=0x7fd0f80046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.799+0000 7fd10d200640 1 -- 172.21.15.19:0/198809404 shutdown_connections 2024-04-25T10:26:14.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.799+0000 7fd10d200640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815e400 0x7fd10814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.799+0000 7fd10d200640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd10815a200 0x7fd108150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.799+0000 7fd10d200640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0e40744b0 0x7fd0e40769c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.799+0000 7fd10d200640 1 --2- 172.21.15.19:0/198809404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1081544c0 0x7fd1081f3330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:14.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.799+0000 7fd10d200640 1 -- 172.21.15.19:0/198809404 >> 172.21.15.19:0/198809404 conn(0x7fd10806d6d0 msgr2=0x7fd10814a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:14.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.799+0000 7fd10d200640 1 -- 172.21.15.19:0/198809404 shutdown_connections 2024-04-25T10:26:14.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:14.799+0000 7fd10d200640 1 -- 172.21.15.19:0/198809404 wait complete. 2024-04-25T10:26:14.826 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T10:26:14.827 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:15.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.093+0000 7fba03800640 1 Processor -- start 2024-04-25T10:26:15.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.093+0000 7fba03800640 1 -- start start 2024-04-25T10:26:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.095+0000 7fba03800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb9fc0cbc60 0x7fb9fc1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.096+0000 7fba03800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc0caee0 0x7fb9fc0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.096+0000 7fba03800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9fc15b3c0 con 0x7fb9fc15a440 2024-04-25T10:26:15.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.096+0000 7fba03800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb9fc0c4ab0 con 0x7fb9fc0cbc60 2024-04-25T10:26:15.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.096+0000 7fba03800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc0cd2a0 con 0x7fb9fc0caee0 2024-04-25T10:26:15.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.096+0000 7fba00e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb9fc0cbc60 0x7fb9fc1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.096+0000 7fba01800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc0caee0 0x7fb9fc0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.096+0000 7fb9fbe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb9fc15a440 0x7fb9fc0ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:40800/0 (socket says 172.21.15.19:40800) 2024-04-25T10:26:15.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.096+0000 7fb9fbe00640 1 -- 172.21.15.19:0/472383729 learned_addr learned my addr 172.21.15.19:0/472383729 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:15.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.096+0000 7fba01800640 1 -- 172.21.15.19:0/472383729 >> v2:172.21.15.112:3300/0 conn(0x7fb9fc0cbc60 msgr2=0x7fb9fc1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:15.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.096+0000 7fba01800640 1 --2- 172.21.15.19:0/472383729 >> v2:172.21.15.112:3300/0 conn(0x7fb9fc0cbc60 0x7fb9fc1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.096+0000 7fba01800640 1 -- 172.21.15.19:0/472383729 >> v1:172.21.15.112:6789/0 conn(0x7fb9fc15a440 legacy=0x7fb9fc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.097+0000 7fba01800640 1 -- 172.21.15.19:0/472383729 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc15a850 con 0x7fb9fc0caee0 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.098+0000 7fba01800640 1 --2- 172.21.15.19:0/472383729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc0caee0 0x7fb9fc0cb2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009d90 tx=0x7fb9f402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d1eb730a29f66b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.098+0000 7fb9fb400640 1 -- 172.21.15.19:0/472383729 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4007740 con 0x7fb9fc0caee0 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.098+0000 7fb9fb400640 1 -- 172.21.15.19:0/472383729 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f40078e0 con 0x7fb9fc0caee0 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.098+0000 7fb9fb400640 1 -- 172.21.15.19:0/472383729 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4007cb0 con 0x7fb9fc0caee0 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.099+0000 7fba03800640 1 -- 172.21.15.19:0/472383729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc0caee0 msgr2=0x7fb9fc0cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.099+0000 7fba03800640 1 --2- 172.21.15.19:0/472383729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc0caee0 0x7fb9fc0cb2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009d90 tx=0x7fb9f402a660 comp rx=0 tx=0).stop 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.099+0000 7fba03800640 1 -- 172.21.15.19:0/472383729 shutdown_connections 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.099+0000 7fba03800640 1 --2- 172.21.15.19:0/472383729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc0caee0 0x7fb9fc0cb2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.099+0000 7fba03800640 1 --2- 172.21.15.19:0/472383729 >> v2:172.21.15.112:3300/0 conn(0x7fb9fc0cbc60 0x7fb9fc1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.099+0000 7fba03800640 1 -- 172.21.15.19:0/472383729 >> 172.21.15.19:0/472383729 conn(0x7fb9fc0730f0 msgr2=0x7fb9fc073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.099+0000 7fba03800640 1 -- 172.21.15.19:0/472383729 shutdown_connections 2024-04-25T10:26:15.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.099+0000 7fba03800640 1 -- 172.21.15.19:0/472383729 wait complete. 2024-04-25T10:26:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.101+0000 7fba03800640 1 Processor -- start 2024-04-25T10:26:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.101+0000 7fba03800640 1 -- start start 2024-04-25T10:26:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.103+0000 7fba03800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9fc0caee0 0x7fb9fc14c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.103+0000 7fba03800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc0cbc60 0x7fb9fc152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.103+0000 7fba03800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9fc15a440 0x7fb9fc1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.103+0000 7fba03800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc15b0e0 con 0x7fb9fc0caee0 2024-04-25T10:26:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.103+0000 7fba03800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc15ae00 con 0x7fb9fc15a440 2024-04-25T10:26:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.103+0000 7fba03800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc0cc390 con 0x7fb9fc0cbc60 2024-04-25T10:26:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.103+0000 7fba00e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9fc0caee0 0x7fb9fc14c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.103+0000 7fba00e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9fc0caee0 0x7fb9fc14c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52498/0 (socket says 172.21.15.19:52498) 2024-04-25T10:26:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.103+0000 7fba00e00640 1 -- 172.21.15.19:0/1039210921 learned_addr learned my addr 172.21.15.19:0/1039210921 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.103+0000 7fb9fbe00640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc0cbc60 0x7fb9fc152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.103+0000 7fba01800640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9fc15a440 0x7fb9fc1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.104+0000 7fba00e00640 1 -- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc0cbc60 msgr2=0x7fb9fc152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.104+0000 7fba00e00640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc0cbc60 0x7fb9fc152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.104+0000 7fba00e00640 1 -- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9fc15a440 msgr2=0x7fb9fc1f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.104+0000 7fba00e00640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9fc15a440 0x7fb9fc1f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.104+0000 7fba00e00640 1 -- 172.21.15.19:0/1039210921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc151e70 con 0x7fb9fc0caee0 2024-04-25T10:26:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.104+0000 7fba00e00640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9fc0caee0 0x7fb9fc14c3b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000e8a0 tx=0x7fb9f000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.104+0000 7fb9f8c00640 1 -- 172.21.15.19:0/1039210921 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0017070 con 0x7fb9fc0caee0 2024-04-25T10:26:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.104+0000 7fb9f8c00640 1 -- 172.21.15.19:0/1039210921 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f000c940 con 0x7fb9fc0caee0 2024-04-25T10:26:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.104+0000 7fba03800640 1 -- 172.21.15.19:0/1039210921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc151610 con 0x7fb9fc0caee0 2024-04-25T10:26:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.105+0000 7fb9f8c00640 1 -- 172.21.15.19:0/1039210921 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f000cd30 con 0x7fb9fc0caee0 2024-04-25T10:26:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.105+0000 7fba03800640 1 -- 172.21.15.19:0/1039210921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc0cf300 con 0x7fb9fc0caee0 2024-04-25T10:26:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.106+0000 7fba03800640 1 -- 172.21.15.19:0/1039210921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc076520 con 0x7fb9fc0caee0 2024-04-25T10:26:15.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.108+0000 7fb9f8c00640 1 -- 172.21.15.19:0/1039210921 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb9f001a070 con 0x7fb9fc0caee0 2024-04-25T10:26:15.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.110+0000 7fb9f8c00640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9dc0744e0 0x7fb9dc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.110+0000 7fb9f8c00640 1 -- 172.21.15.19:0/1039210921 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb9f00957c0 con 0x7fb9fc0caee0 2024-04-25T10:26:15.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.110+0000 7fb9fbe00640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9dc0744e0 0x7fb9dc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.111+0000 7fb9fbe00640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9dc0744e0 0x7fb9dc0769f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc159210 tx=0x7fb9e8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.115+0000 7fb9f8c00640 1 -- 172.21.15.19:0/1039210921 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9f005f520 con 0x7fb9fc0caee0 2024-04-25T10:26:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.317+0000 7fba03800640 1 -- 172.21.15.19:0/1039210921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9fc158090 con 0x7fb9fc0caee0 2024-04-25T10:26:15.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.319+0000 7fb9f8c00640 1 -- 172.21.15.19:0/1039210921 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18518 (secure 0 0 0) 0x7fb9f0063820 con 0x7fb9fc0caee0 2024-04-25T10:26:15.323 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:15.323 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:25:41.790347+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.322+0000 7fba03800640 1 -- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9dc0744e0 msgr2=0x7fb9dc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.322+0000 7fba03800640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9dc0744e0 0x7fb9dc0769f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc159210 tx=0x7fb9e8009040 comp rx=0 tx=0).stop 2024-04-25T10:26:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.322+0000 7fba03800640 1 -- 172.21.15.19:0/1039210921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9fc0caee0 msgr2=0x7fb9fc14c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.322+0000 7fba03800640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9fc0caee0 0x7fb9fc14c3b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000e8a0 tx=0x7fb9f000ed60 comp rx=0 tx=0).stop 2024-04-25T10:26:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.322+0000 7fba03800640 1 -- 172.21.15.19:0/1039210921 shutdown_connections 2024-04-25T10:26:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.322+0000 7fba03800640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9fc15a440 0x7fb9fc1f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.322+0000 7fba03800640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb9dc0744e0 0x7fb9dc0769f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.322+0000 7fba03800640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb9fc0cbc60 0x7fb9fc152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.322+0000 7fba03800640 1 --2- 172.21.15.19:0/1039210921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9fc0caee0 0x7fb9fc14c3b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.322+0000 7fba03800640 1 -- 172.21.15.19:0/1039210921 >> 172.21.15.19:0/1039210921 conn(0x7fb9fc0730f0 msgr2=0x7fb9fc0ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.323+0000 7fba03800640 1 -- 172.21.15.19:0/1039210921 shutdown_connections 2024-04-25T10:26:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.323+0000 7fba03800640 1 -- 172.21.15.19:0/1039210921 wait complete. 2024-04-25T10:26:15.351 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T10:26:15.352 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T10:26:15.352 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T10:26:15.353 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T10:26:15.353 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T10:26:15.353 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T10:26:15.354 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T10:26:15.354 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T10:26:15.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.790+0000 7fbe05000640 1 Processor -- start 2024-04-25T10:26:15.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.790+0000 7fbe05000640 1 -- start start 2024-04-25T10:26:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.794+0000 7fbe05000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe000742d0 0x7fbe00161370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.794+0000 7fbdff400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbe000c2640 0x7fbe000cd2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:40812/0 (socket says 172.21.15.19:40812) 2024-04-25T10:26:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.794+0000 7fbdff400640 1 -- 172.21.15.19:0/4155280379 learned_addr learned my addr 172.21.15.19:0/4155280379 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.795+0000 7fbe05000640 1 -- 172.21.15.19:0/4155280379 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe000c4010 con 0x7fbe000c9850 2024-04-25T10:26:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.795+0000 7fbe05000640 1 -- 172.21.15.19:0/4155280379 --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe000c42f0 con 0x7fbe000c2640 2024-04-25T10:26:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.795+0000 7fbe05000640 1 -- 172.21.15.19:0/4155280379 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fbe000ca530 con 0x7fbe000742d0 2024-04-25T10:26:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.796+0000 7fbdffe00640 1 --2- 172.21.15.19:0/4155280379 >> v2:172.21.15.19:3300/0 conn(0x7fbe000742d0 0x7fbe00161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.796+0000 7fbdfe000640 1 -- 172.21.15.19:0/4155280379 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 800963052 0 0) 0x7fbe000c42f0 con 0x7fbe000c2640 2024-04-25T10:26:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.796+0000 7fbdfe000640 1 -- 172.21.15.19:0/4155280379 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbde4003520 con 0x7fbe000c2640 2024-04-25T10:26:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.796+0000 7fbdffe00640 1 -- 172.21.15.19:0/4155280379 >> v1:172.21.15.112:6789/0 conn(0x7fbe000c2640 legacy=0x7fbe000cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.796+0000 7fbdffe00640 1 -- 172.21.15.19:0/4155280379 >> v1:172.21.15.19:6789/0 conn(0x7fbe000c9850 legacy=0x7fbe00073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.796+0000 7fbdffe00640 1 -- 172.21.15.19:0/4155280379 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe000730e0 con 0x7fbe000742d0 2024-04-25T10:26:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.798+0000 7fbdffe00640 1 --2- 172.21.15.19:0/4155280379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe000742d0 0x7fbe00161370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbe000ca6b0 tx=0x7fbdec02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b3b28f8e53d59a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.799+0000 7fbdfe000640 1 -- 172.21.15.19:0/4155280379 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec037070 con 0x7fbe000742d0 2024-04-25T10:26:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.799+0000 7fbdfe000640 1 -- 172.21.15.19:0/4155280379 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdec032440 con 0x7fbe000742d0 2024-04-25T10:26:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.800+0000 7fbdfe000640 1 -- 172.21.15.19:0/4155280379 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec037070 con 0x7fbe000742d0 2024-04-25T10:26:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.800+0000 7fbe05000640 1 -- 172.21.15.19:0/4155280379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe000742d0 msgr2=0x7fbe00161370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.800+0000 7fbe05000640 1 --2- 172.21.15.19:0/4155280379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe000742d0 0x7fbe00161370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbe000ca6b0 tx=0x7fbdec02a2a0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.801+0000 7fbe05000640 1 -- 172.21.15.19:0/4155280379 shutdown_connections 2024-04-25T10:26:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.801+0000 7fbe05000640 1 --2- 172.21.15.19:0/4155280379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe000742d0 0x7fbe00161370 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.801+0000 7fbe05000640 1 -- 172.21.15.19:0/4155280379 >> 172.21.15.19:0/4155280379 conn(0x7fbe00070d10 msgr2=0x7fbe00071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.802+0000 7fbe05000640 1 -- 172.21.15.19:0/4155280379 shutdown_connections 2024-04-25T10:26:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.802+0000 7fbe05000640 1 -- 172.21.15.19:0/4155280379 wait complete. 2024-04-25T10:26:15.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.804+0000 7f0079a00640 1 Processor -- start 2024-04-25T10:26:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.806+0000 7fbe05000640 1 Processor -- start 2024-04-25T10:26:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.806+0000 7f614f200640 1 Processor -- start 2024-04-25T10:26:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.804+0000 7f0079a00640 1 -- start start 2024-04-25T10:26:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.807+0000 7f0079a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f006c0495e0 0x7f006c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.807+0000 7f0079a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f006c050050 0x7f006c0e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.808+0000 7f614f200640 1 -- start start 2024-04-25T10:26:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.810+0000 7f0079a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f006c050af0 con 0x7f006c007910 2024-04-25T10:26:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.810+0000 7f0079a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f006c050700 con 0x7f006c050050 2024-04-25T10:26:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.810+0000 7f0079a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f006c050db0 con 0x7f006c0495e0 2024-04-25T10:26:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.810+0000 7f0072a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f006c0495e0 0x7f006c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.810+0000 7f0073400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f006c050050 0x7f006c0e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.807+0000 7fbe05000640 1 -- start start 2024-04-25T10:26:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.809+0000 7fbe05000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe000742d0 0x7fbe00154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.809+0000 7fbe05000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe000c2640 0x7fbe00159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.809+0000 7fbe05000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe000c9850 0x7fbe0015a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.810+0000 7f0072a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f006c0495e0 0x7f006c0073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39660/0 (socket says 172.21.15.19:39660) 2024-04-25T10:26:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.810+0000 7f0072a00640 1 -- 172.21.15.19:0/3980783868 learned_addr learned my addr 172.21.15.19:0/3980783868 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.809+0000 7fbe05000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbe000cd9d0 con 0x7fbe000742d0 2024-04-25T10:26:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.809+0000 7fbe05000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe000736a0 con 0x7fbe000c9850 2024-04-25T10:26:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.809+0000 7fbe05000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbe000cdb50 con 0x7fbe000c2640 2024-04-25T10:26:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.810+0000 7fbdffe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe000c9850 0x7fbe0015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.811+0000 7f0072a00640 1 -- 172.21.15.19:0/3980783868 >> v2:172.21.15.19:3300/0 conn(0x7f006c050050 msgr2=0x7f006c0e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.811+0000 7f0072a00640 1 --2- 172.21.15.19:0/3980783868 >> v2:172.21.15.19:3300/0 conn(0x7f006c050050 0x7f006c0e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.811+0000 7f0072a00640 1 -- 172.21.15.19:0/3980783868 >> v1:172.21.15.19:6789/0 conn(0x7f006c007910 legacy=0x7f006c04f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.811+0000 7f0072a00640 1 -- 172.21.15.19:0/3980783868 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c0e35c0 con 0x7f006c0495e0 2024-04-25T10:26:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.812+0000 7fbdffe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe000c9850 0x7fbe0015a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39668/0 (socket says 172.21.15.19:39668) 2024-04-25T10:26:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.812+0000 7fbdffe00640 1 -- 172.21.15.19:0/1063669321 learned_addr learned my addr 172.21.15.19:0/1063669321 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.813+0000 7fbdffe00640 1 -- 172.21.15.19:0/1063669321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe000c2640 msgr2=0x7fbe00159e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:26:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.813+0000 7fbdffe00640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe000c2640 0x7fbe00159e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.811+0000 7f614f200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f614815cf20 0x7f614808d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.811+0000 7f614f200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61480cee50 con 0x7f61480c7cd0 2024-04-25T10:26:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.811+0000 7f614f200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61480c6ab0 con 0x7f614808dca0 2024-04-25T10:26:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.811+0000 7f614f200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f61480c7840 con 0x7f614815cf20 2024-04-25T10:26:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.812+0000 7f6147400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f614815cf20 0x7f614808d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.814+0000 7fbdffe00640 1 -- 172.21.15.19:0/1063669321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe000742d0 msgr2=0x7fbe00154740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:26:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.812+0000 7f6147400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f614815cf20 0x7f614808d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39682/0 (socket says 172.21.15.19:39682) 2024-04-25T10:26:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.812+0000 7f6147400640 1 -- 172.21.15.19:0/1001777431 learned_addr learned my addr 172.21.15.19:0/1001777431 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.813+0000 7f6147400640 1 -- 172.21.15.19:0/1001777431 >> v1:172.21.15.112:6789/0 conn(0x7f614808dca0 legacy=0x7f6148166e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.813+0000 7f6147400640 1 -- 172.21.15.19:0/1001777431 >> v1:172.21.15.19:6789/0 conn(0x7f61480c7cd0 legacy=0x7f61480b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.813+0000 7f6147400640 1 -- 172.21.15.19:0/1001777431 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61480c6f50 con 0x7f614815cf20 2024-04-25T10:26:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.814+0000 7fbdffe00640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe000742d0 0x7fbe00154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.814+0000 7fbdffe00640 1 -- 172.21.15.19:0/1063669321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0015ab30 con 0x7fbe000c9850 2024-04-25T10:26:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.814+0000 7f0072a00640 1 --2- 172.21.15.19:0/3980783868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f006c0495e0 0x7f006c0073d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f006c009e30 tx=0x7f006002a310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca313e47251db569 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.815+0000 7f0071600640 1 -- 172.21.15.19:0/3980783868 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060037070 con 0x7f006c0495e0 2024-04-25T10:26:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.815+0000 7f6147400640 1 --2- 172.21.15.19:0/1001777431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f614815cf20 0x7f614808d760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6140014a00 tx=0x7f6140033340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a8c361b4c38c7de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.815+0000 7f0071600640 1 -- 172.21.15.19:0/3980783868 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0060032640 con 0x7f006c0495e0 2024-04-25T10:26:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.815+0000 7fbdffe00640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe000c9850 0x7fbe0015a350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009890 tx=0x7fbdec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.815+0000 7f0071600640 1 -- 172.21.15.19:0/3980783868 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006002ae60 con 0x7f006c0495e0 2024-04-25T10:26:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.816+0000 7fbdf7400640 1 -- 172.21.15.19:0/1063669321 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec041020 con 0x7fbe000c9850 2024-04-25T10:26:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.816+0000 7fbdf7400640 1 -- 172.21.15.19:0/1063669321 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdec003bc0 con 0x7fbe000c9850 2024-04-25T10:26:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.816+0000 7f6146a00640 1 -- 172.21.15.19:0/1001777431 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61400112d0 con 0x7f614815cf20 2024-04-25T10:26:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.816+0000 7f6146a00640 1 -- 172.21.15.19:0/1001777431 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6140033e50 con 0x7f614815cf20 2024-04-25T10:26:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.816+0000 7f6146a00640 1 -- 172.21.15.19:0/1001777431 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61400116d0 con 0x7f614815cf20 2024-04-25T10:26:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.816+0000 7f0079a00640 1 -- 172.21.15.19:0/3980783868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f006c0495e0 msgr2=0x7f006c0073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.816+0000 7f0079a00640 1 --2- 172.21.15.19:0/3980783868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f006c0495e0 0x7f006c0073d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f006c009e30 tx=0x7f006002a310 comp rx=0 tx=0).stop 2024-04-25T10:26:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.816+0000 7fbe05000640 1 -- 172.21.15.19:0/1063669321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe001f6870 con 0x7fbe000c9850 2024-04-25T10:26:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.817+0000 7fbdf7400640 1 -- 172.21.15.19:0/1063669321 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec037040 con 0x7fbe000c9850 2024-04-25T10:26:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.818+0000 7fbe05000640 1 -- 172.21.15.19:0/1063669321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe001f6e30 con 0x7fbe000c9850 2024-04-25T10:26:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.817+0000 7f614f200640 1 -- 172.21.15.19:0/1001777431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f614815cf20 msgr2=0x7f614808d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.817+0000 7f614f200640 1 --2- 172.21.15.19:0/1001777431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f614815cf20 0x7f614808d760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6140014a00 tx=0x7f6140033340 comp rx=0 tx=0).stop 2024-04-25T10:26:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.818+0000 7f614f200640 1 -- 172.21.15.19:0/1001777431 shutdown_connections 2024-04-25T10:26:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.818+0000 7f614f200640 1 --2- 172.21.15.19:0/1001777431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f614815cf20 0x7f614808d760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.818+0000 7f614f200640 1 -- 172.21.15.19:0/1001777431 >> 172.21.15.19:0/1001777431 conn(0x7f614806f2e0 msgr2=0x7f6148068460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.818+0000 7f614f200640 1 -- 172.21.15.19:0/1001777431 shutdown_connections 2024-04-25T10:26:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.818+0000 7f614f200640 1 -- 172.21.15.19:0/1001777431 wait complete. 2024-04-25T10:26:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.817+0000 7f0079a00640 1 -- 172.21.15.19:0/3980783868 shutdown_connections 2024-04-25T10:26:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.817+0000 7f0079a00640 1 --2- 172.21.15.19:0/3980783868 >> v2:172.21.15.19:3300/0 conn(0x7f006c050050 0x7f006c0e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.817+0000 7f0079a00640 1 --2- 172.21.15.19:0/3980783868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f006c0495e0 0x7f006c0073d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.817+0000 7f0079a00640 1 -- 172.21.15.19:0/3980783868 >> 172.21.15.19:0/3980783868 conn(0x7f006c00e380 msgr2=0x7f006c00e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.817+0000 7f0079a00640 1 -- 172.21.15.19:0/3980783868 shutdown_connections 2024-04-25T10:26:15.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.817+0000 7f0079a00640 1 -- 172.21.15.19:0/3980783868 wait complete. 2024-04-25T10:26:15.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.821+0000 7f0079a00640 1 Processor -- start 2024-04-25T10:26:15.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.822+0000 7f614f200640 1 Processor -- start 2024-04-25T10:26:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.822+0000 7f0079a00640 1 -- start start 2024-04-25T10:26:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.822+0000 7f89ed200640 1 Processor -- start 2024-04-25T10:26:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.822+0000 7f614f200640 1 -- start start 2024-04-25T10:26:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.822+0000 7f89ed200640 1 -- start start 2024-04-25T10:26:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.823+0000 7f9a0f400640 1 Processor -- start 2024-04-25T10:26:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.823+0000 7f9a0f400640 1 -- start start 2024-04-25T10:26:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.825+0000 7f614f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f614808dca0 0x7f61480c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f0079a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006c007910 0x7f006c053720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f89ed200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80ca280 0x7f89e815c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f6147e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f614808dca0 0x7f61480c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f614f200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61480c7cd0 0x7f614814e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f614f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f614815cf20 0x7f614814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f614f200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61480c74d0 con 0x7f614808dca0 2024-04-25T10:26:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f0079a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f006c0495e0 0x7f006c0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f0079a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f006c050050 0x7f006c0d8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f0079a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f006c0e38a0 con 0x7f006c007910 2024-04-25T10:26:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f0079a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f006c04f420 con 0x7f006c050050 2024-04-25T10:26:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f0079a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f006c00f1c0 con 0x7f006c0495e0 2024-04-25T10:26:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f614f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f61480c71f0 con 0x7f614815cf20 2024-04-25T10:26:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f614f200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f61480ccbd0 con 0x7f61480c7cd0 2024-04-25T10:26:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f6147e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f614808dca0 0x7f61480c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52532/0 (socket says 172.21.15.19:52532) 2024-04-25T10:26:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f89ed200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89e8152b40 0x7f89e8158820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f6147e00640 1 -- 172.21.15.19:0/15584340 learned_addr learned my addr 172.21.15.19:0/15584340 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.826+0000 7f0073400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f006c050050 0x7f006c0d8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f0073400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f006c050050 0x7f006c0d8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39688/0 (socket says 172.21.15.19:39688) 2024-04-25T10:26:15.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f0073400640 1 -- 172.21.15.19:0/2462110055 learned_addr learned my addr 172.21.15.19:0/2462110055 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f0072000640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f006c0495e0 0x7f006c0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f89ed200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e8074b80 con 0x7f89e80735b0 2024-04-25T10:26:15.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f89ed200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f89e8158d60 con 0x7f89e8152b40 2024-04-25T10:26:15.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f89ed200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f89e80ca7a0 con 0x7f89e80ca280 2024-04-25T10:26:15.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f614d200640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f614815cf20 0x7f614814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f6147400640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61480c7cd0 0x7f614814e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f0072a00640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006c007910 0x7f006c053720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f89e6800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f89e80735b0 0x7f89e80c84a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:40832/0 (socket says 172.21.15.19:40832) 2024-04-25T10:26:15.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f89e6800640 1 -- 172.21.15.19:0/646741927 learned_addr learned my addr 172.21.15.19:0/646741927 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:15.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.828+0000 7f6147400640 1 -- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f614815cf20 msgr2=0x7f614814c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.828+0000 7f6147400640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f614815cf20 0x7f614814c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.828+0000 7f6147400640 1 -- 172.21.15.19:0/15584340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f614808dca0 msgr2=0x7f61480c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.828+0000 7f6147400640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f614808dca0 0x7f61480c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.828+0000 7f6147400640 1 -- 172.21.15.19:0/15584340 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61480c9e40 con 0x7f61480c7cd0 2024-04-25T10:26:15.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.827+0000 7f89e5e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80ca280 0x7f89e815c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.828+0000 7f89dd400640 1 --2- 172.21.15.19:0/646741927 >> v2:172.21.15.19:3300/0 conn(0x7f89e8152b40 0x7f89e8158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.828+0000 7f6147400640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61480c7cd0 0x7f614814e190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6140039000 tx=0x7f6140004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.829+0000 7f613fe00640 1 -- 172.21.15.19:0/15584340 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614004b070 con 0x7f61480c7cd0 2024-04-25T10:26:15.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.829+0000 7f613fe00640 1 -- 172.21.15.19:0/15584340 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6140045920 con 0x7f61480c7cd0 2024-04-25T10:26:15.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.829+0000 7f89e5e00640 1 -- 172.21.15.19:0/646741927 >> v2:172.21.15.19:3300/0 conn(0x7f89e8152b40 msgr2=0x7f89e8158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:15.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.829+0000 7f89e5e00640 1 --2- 172.21.15.19:0/646741927 >> v2:172.21.15.19:3300/0 conn(0x7f89e8152b40 0x7f89e8158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.829+0000 7f614f200640 1 -- 172.21.15.19:0/15584340 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614815a1c0 con 0x7f61480c7cd0 2024-04-25T10:26:15.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.829+0000 7f614f200640 1 -- 172.21.15.19:0/15584340 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f61480c8b40 con 0x7f61480c7cd0 2024-04-25T10:26:15.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.825+0000 7fbe05000640 1 -- 172.21.15.19:0/1063669321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe000c3ad0 con 0x7fbe000c9850 2024-04-25T10:26:15.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.829+0000 7f0072a00640 1 -- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f006c0495e0 msgr2=0x7f006c0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.829+0000 7f0072a00640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f006c0495e0 0x7f006c0cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.829+0000 7f0072a00640 1 -- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f006c050050 msgr2=0x7f006c0d8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.829+0000 7f0072a00640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f006c050050 0x7f006c0d8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.829+0000 7f0072a00640 1 -- 172.21.15.19:0/2462110055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c0e2620 con 0x7f006c007910 2024-04-25T10:26:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.830+0000 7f0072a00640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006c007910 0x7f006c053720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0060031000 tx=0x7f00600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.830+0000 7f9a0f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08073400 0x7f9a08156a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.830+0000 7f613fe00640 1 -- 172.21.15.19:0/15584340 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140045d10 con 0x7f61480c7cd0 2024-04-25T10:26:15.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.831+0000 7f9a0f400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a08160600 0x7f9a080af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.831+0000 7f9a0ca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08073400 0x7f9a08156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.831+0000 7f9a0ca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08073400 0x7f9a08156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60458/0 (socket says 172.21.15.19:60458) 2024-04-25T10:26:15.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.831+0000 7f9a0ca00640 1 -- 172.21.15.19:0/3781022811 learned_addr learned my addr 172.21.15.19:0/3781022811 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.831+0000 7f006aa00640 1 -- 172.21.15.19:0/2462110055 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060041020 con 0x7f006c007910 2024-04-25T10:26:15.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.832+0000 7f9a0f400640 1 -- 172.21.15.19:0/3781022811 --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a0815c8b0 con 0x7f9a080af580 2024-04-25T10:26:15.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.831+0000 7f89e5e00640 1 -- 172.21.15.19:0/646741927 >> v1:172.21.15.112:6789/0 conn(0x7f89e80735b0 legacy=0x7f89e80c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.831+0000 7f89e5e00640 1 -- 172.21.15.19:0/646741927 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e80caa80 con 0x7f89e80ca280 2024-04-25T10:26:15.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.832+0000 7f9a0f400640 1 -- 172.21.15.19:0/3781022811 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f9a0815c650 con 0x7f9a08160600 2024-04-25T10:26:15.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.832+0000 7f9a0f400640 1 -- 172.21.15.19:0/3781022811 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9a08160a10 con 0x7f9a08073400 2024-04-25T10:26:15.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.832+0000 7f89e5e00640 1 --2- 172.21.15.19:0/646741927 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80ca280 0x7f89e815c910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f89d0007b70 tx=0x7f89d002e530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d7a33672da24950 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.832+0000 7f9a07e00640 1 --2- 172.21.15.19:0/3781022811 >> v2:172.21.15.19:3300/0 conn(0x7f9a08160600 0x7f9a080af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.833+0000 7f89e5400640 1 -- 172.21.15.19:0/646741927 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d003a070 con 0x7f89e80ca280 2024-04-25T10:26:15.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.833+0000 7f9a0ca00640 1 -- 172.21.15.19:0/3781022811 >> v2:172.21.15.19:3300/0 conn(0x7f9a08160600 msgr2=0x7f9a080af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.834+0000 7f89e5400640 1 -- 172.21.15.19:0/646741927 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d00070d0 con 0x7f89e80ca280 2024-04-25T10:26:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.834+0000 7f89e5400640 1 -- 172.21.15.19:0/646741927 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d00074e0 con 0x7f89e80ca280 2024-04-25T10:26:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.834+0000 7f613fe00640 1 -- 172.21.15.19:0/15584340 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f614004e070 con 0x7f61480c7cd0 2024-04-25T10:26:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.833+0000 7f0079a00640 1 -- 172.21.15.19:0/2462110055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006c053230 con 0x7f006c007910 2024-04-25T10:26:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.833+0000 7f0079a00640 1 -- 172.21.15.19:0/2462110055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f006c0d2b80 con 0x7f006c007910 2024-04-25T10:26:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.835+0000 7f613fe00640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f61280745b0 0x7f6128076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.835+0000 7f89ed200640 1 -- 172.21.15.19:0/646741927 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80ca280 msgr2=0x7f89e815c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.835+0000 7f89ed200640 1 --2- 172.21.15.19:0/646741927 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80ca280 0x7f89e815c910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f89d0007b70 tx=0x7f89d002e530 comp rx=0 tx=0).stop 2024-04-25T10:26:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.834+0000 7f006aa00640 1 -- 172.21.15.19:0/2462110055 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0060030770 con 0x7f006c007910 2024-04-25T10:26:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.834+0000 7f006aa00640 1 -- 172.21.15.19:0/2462110055 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060037040 con 0x7f006c007910 2024-04-25T10:26:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.835+0000 7f0079a00640 1 -- 172.21.15.19:0/2462110055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f006c0d5120 con 0x7f006c007910 2024-04-25T10:26:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.836+0000 7f613fe00640 1 -- 172.21.15.19:0/15584340 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f61400bf1f0 con 0x7f61480c7cd0 2024-04-25T10:26:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.836+0000 7f89ed200640 1 -- 172.21.15.19:0/646741927 shutdown_connections 2024-04-25T10:26:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.836+0000 7f89ed200640 1 --2- 172.21.15.19:0/646741927 >> v2:172.21.15.19:3300/0 conn(0x7f89e8152b40 0x7f89e8158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.836+0000 7f89ed200640 1 --2- 172.21.15.19:0/646741927 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80ca280 0x7f89e815c910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.836+0000 7f89ed200640 1 -- 172.21.15.19:0/646741927 >> 172.21.15.19:0/646741927 conn(0x7f89e806f1f0 msgr2=0x7f89e806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.836+0000 7f6147e00640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f61280745b0 0x7f6128076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.836+0000 7f89ed200640 1 -- 172.21.15.19:0/646741927 shutdown_connections 2024-04-25T10:26:15.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.837+0000 7f89ed200640 1 -- 172.21.15.19:0/646741927 wait complete. 2024-04-25T10:26:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.835+0000 7f9a0ca00640 1 --2- 172.21.15.19:0/3781022811 >> v2:172.21.15.19:3300/0 conn(0x7f9a08160600 0x7f9a080af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.835+0000 7f9a0ca00640 1 -- 172.21.15.19:0/3781022811 >> v1:172.21.15.112:6789/0 conn(0x7f9a080af580 legacy=0x7f9a08073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.835+0000 7f9a0ca00640 1 -- 172.21.15.19:0/3781022811 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0815cb70 con 0x7f9a08073400 2024-04-25T10:26:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.837+0000 7f9a07e00640 1 --2- 172.21.15.19:0/3781022811 >> v2:172.21.15.19:3300/0 conn(0x7f9a08160600 0x7f9a080af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:26:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.836+0000 7fbdf7400640 1 -- 172.21.15.19:0/1063669321 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbdec044020 con 0x7fbe000c9850 2024-04-25T10:26:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.838+0000 7fbdf7400640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbde00744b0 0x7fbde00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.838+0000 7fbdf7400640 1 -- 172.21.15.19:0/1063669321 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbdec0b5760 con 0x7fbe000c9850 2024-04-25T10:26:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.838+0000 7f6147e00640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f61280745b0 0x7f6128076ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6134009960 tx=0x7f61340090e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.839+0000 7f006aa00640 1 -- 172.21.15.19:0/2462110055 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0060044020 con 0x7f006c007910 2024-04-25T10:26:15.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.839+0000 7fbdf7400640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] conn(0x7fbde007dc70 0x7fbde0080100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.839+0000 7f9a0ca00640 1 --2- 172.21.15.19:0/3781022811 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08073400 0x7f9a08156a50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009870 tx=0x7f99fc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81ea6c7103437c78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.839+0000 7fbdff400640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbde00744b0 0x7fbde00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.839+0000 7f614f200640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] conn(0x7f6120001650 0x7f6120003b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.839+0000 7f614f200640 1 -- 172.21.15.19:0/15584340 --> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6120006c00 con 0x7f6120001650 2024-04-25T10:26:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.840+0000 7fbdf7400640 1 -- 172.21.15.19:0/1063669321 --> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbdec007e80 con 0x7fbde007dc70 2024-04-25T10:26:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.840+0000 7fbdf7400640 1 -- 172.21.15.19:0/1063669321 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbdec0b5b50 con 0x7fbe000c9850 2024-04-25T10:26:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.840+0000 7f614d200640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] conn(0x7f6120001650 0x7f6120003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.840+0000 7fbdff400640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbde00744b0 0x7fbde00769c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe00071e70 tx=0x7fbdf8007c50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.841+0000 7f006aa00640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f00540744b0 0x7f00540769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.841+0000 7f89ed200640 1 Processor -- start 2024-04-25T10:26:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.841+0000 7f89ed200640 1 -- start start 2024-04-25T10:26:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.841+0000 7f006aa00640 1 -- 172.21.15.19:0/2462110055 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f00600b64b0 con 0x7f006c007910 2024-04-25T10:26:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.841+0000 7f006aa00640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] conn(0x7f005407dc70 0x7f0054080100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.841+0000 7f006aa00640 1 -- 172.21.15.19:0/2462110055 --> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0060032640 con 0x7f005407dc70 2024-04-25T10:26:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.841+0000 7f006aa00640 1 -- 172.21.15.19:0/2462110055 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f00600b68a0 con 0x7f006c007910 2024-04-25T10:26:15.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.841+0000 7f0072000640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f00540744b0 0x7f00540769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.842+0000 7f614d200640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] conn(0x7f6120001650 0x7f6120003b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.842+0000 7fbdfea00640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] conn(0x7fbde007dc70 0x7fbde0080100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.842+0000 7f9a07400640 1 -- 172.21.15.19:0/3781022811 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc037070 con 0x7f9a08073400 2024-04-25T10:26:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.842+0000 7f9a07400640 1 -- 172.21.15.19:0/3781022811 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99fc032440 con 0x7f9a08073400 2024-04-25T10:26:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.843+0000 7fbdfea00640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] conn(0x7fbde007dc70 0x7fbde0080100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.842+0000 7f0073400640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] conn(0x7f005407dc70 0x7f0054080100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.842+0000 7f9a07400640 1 -- 172.21.15.19:0/3781022811 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc032850 con 0x7f9a08073400 2024-04-25T10:26:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.843+0000 7f89ed200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80735b0 0x7f89e8153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.843+0000 7f89ed200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80ca280 0x7f89e81fa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.844+0000 7f89e5e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80735b0 0x7f89e8153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.844+0000 7f9a0f400640 1 -- 172.21.15.19:0/3781022811 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08073400 msgr2=0x7f9a08156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.844+0000 7f9a0f400640 1 --2- 172.21.15.19:0/3781022811 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08073400 0x7f9a08156a50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009870 tx=0x7f99fc02a210 comp rx=0 tx=0).stop 2024-04-25T10:26:15.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.844+0000 7f613fe00640 1 -- 172.21.15.19:0/15584340 <== osd.2 v2:172.21.15.19:6816/1878337170 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6120006c00 con 0x7f6120001650 2024-04-25T10:26:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.844+0000 7f0072000640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f00540744b0 0x7f00540769c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f007406b740 tx=0x7f00740696b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.844+0000 7f9a0f400640 1 -- 172.21.15.19:0/3781022811 shutdown_connections 2024-04-25T10:26:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.844+0000 7f9a0f400640 1 --2- 172.21.15.19:0/3781022811 >> v2:172.21.15.19:3300/0 conn(0x7f9a08160600 0x7f9a080af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.844+0000 7f9a0f400640 1 --2- 172.21.15.19:0/3781022811 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08073400 0x7f9a08156a50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.844+0000 7f9a0f400640 1 -- 172.21.15.19:0/3781022811 >> 172.21.15.19:0/3781022811 conn(0x7f9a0806f1f0 msgr2=0x7f9a0806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.845+0000 7fbdf7400640 1 -- 172.21.15.19:0/1063669321 <== osd.0 v2:172.21.15.19:6824/3943322367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbdec007e80 con 0x7fbde007dc70 2024-04-25T10:26:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.845+0000 7f9a0f400640 1 -- 172.21.15.19:0/3781022811 shutdown_connections 2024-04-25T10:26:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.845+0000 7f9a0f400640 1 -- 172.21.15.19:0/3781022811 wait complete. 2024-04-25T10:26:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.846+0000 7f0073400640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] conn(0x7f005407dc70 0x7f0054080100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.844+0000 7f89e5e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80735b0 0x7f89e8153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60462/0 (socket says 172.21.15.19:60462) 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.846+0000 7f89e5e00640 1 -- 172.21.15.19:0/3471753095 learned_addr learned my addr 172.21.15.19:0/3471753095 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.846+0000 7f89ed200640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89e8152b40 0x7f89e81fa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.846+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89e815c110 con 0x7f89e80ca280 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.846+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f89e815be30 con 0x7f89e8152b40 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.846+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f89e815c3f0 con 0x7f89e80735b0 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.845+0000 7f89dd400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80ca280 0x7f89e81fa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.846+0000 7f89e6800640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89e8152b40 0x7f89e81fa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.847+0000 7f89e5e00640 1 -- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89e8152b40 msgr2=0x7f89e81fa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.847+0000 7f89e5e00640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89e8152b40 0x7f89e81fa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.847+0000 7f89e5e00640 1 -- 172.21.15.19:0/3471753095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80ca280 msgr2=0x7f89e81fa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.847+0000 7f89e5e00640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80ca280 0x7f89e81fa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.847+0000 7f89e5e00640 1 -- 172.21.15.19:0/3471753095 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e8155a30 con 0x7f89e80735b0 2024-04-25T10:26:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.848+0000 7f006aa00640 1 -- 172.21.15.19:0/2462110055 <== osd.4 v2:172.21.15.112:6800/2833374228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0060032640 con 0x7f005407dc70 2024-04-25T10:26:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.848+0000 7f89dd400640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80ca280 0x7f89e81fa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.848+0000 7f89e5e00640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80735b0 0x7f89e8153f10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89d002eb20 tx=0x7f89d00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.848+0000 7f9a0f400640 1 Processor -- start 2024-04-25T10:26:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.849+0000 7f9a0f400640 1 -- start start 2024-04-25T10:26:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.851+0000 7f89dea00640 1 -- 172.21.15.19:0/3471753095 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d003a030 con 0x7f89e80735b0 2024-04-25T10:26:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.851+0000 7f89dea00640 1 -- 172.21.15.19:0/3471753095 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d003c070 con 0x7f89e80735b0 2024-04-25T10:26:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.851+0000 7f89dea00640 1 -- 172.21.15.19:0/3471753095 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0035810 con 0x7f89e80735b0 2024-04-25T10:26:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.851+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e80b2ad0 con 0x7f89e80735b0 2024-04-25T10:26:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.851+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e80b1780 con 0x7f89e80735b0 2024-04-25T10:26:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.852+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f89c0001030 con 0x7f89e80735b0 2024-04-25T10:26:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.853+0000 7f9a0f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a08073400 0x7f9a08150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.854+0000 7f9a0f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a080af580 0x7f9a08155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.854+0000 7f9a0ca00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a08073400 0x7f9a08150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.854+0000 7f9a0ca00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a08073400 0x7f9a08150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52588/0 (socket says 172.21.15.19:52588) 2024-04-25T10:26:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.854+0000 7f9a0ca00640 1 -- 172.21.15.19:0/463121143 learned_addr learned my addr 172.21.15.19:0/463121143 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.854+0000 7f9a0f400640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a08160600 0x7f9a08155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.854+0000 7f9a07e00640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a080af580 0x7f9a08155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.854+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0815d410 con 0x7f9a08073400 2024-04-25T10:26:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.855+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0815d130 con 0x7f9a08160600 2024-04-25T10:26:15.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.855+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9a080afd30 con 0x7f9a080af580 2024-04-25T10:26:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.855+0000 7f9a0d400640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a08160600 0x7f9a08155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.855+0000 7f89dea00640 1 -- 172.21.15.19:0/3471753095 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f89d0047060 con 0x7f89e80735b0 2024-04-25T10:26:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.856+0000 7f9a0ca00640 1 -- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a080af580 msgr2=0x7f9a08155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.856+0000 7f9a0ca00640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a080af580 0x7f9a08155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.856+0000 7f9a0ca00640 1 -- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a08160600 msgr2=0x7f9a08155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.856+0000 7f9a0ca00640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a08160600 0x7f9a08155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.856+0000 7f9a0ca00640 1 -- 172.21.15.19:0/463121143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a080ac550 con 0x7f9a08073400 2024-04-25T10:26:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.856+0000 7f9a0d400640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a08160600 0x7f9a08155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:15.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.857+0000 7f9a0ca00640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a08073400 0x7f9a08150000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0090b0 tx=0x7f99fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.857+0000 7f89dea00640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f89c4074500 0x7f89c4076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.857+0000 7f89dea00640 1 -- 172.21.15.19:0/3471753095 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f89d00b58d0 con 0x7f89e80735b0 2024-04-25T10:26:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.858+0000 7f89dea00640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] conn(0x7f89c407dc40 0x7f89c40800d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.858+0000 7f89dea00640 1 -- 172.21.15.19:0/3471753095 --> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89d0030ea0 con 0x7f89c407dc40 2024-04-25T10:26:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.858+0000 7f89dea00640 1 -- 172.21.15.19:0/3471753095 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f89d007be20 con 0x7f89e80735b0 2024-04-25T10:26:15.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.858+0000 7f89dd400640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f89c4074500 0x7f89c4076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.859+0000 7f89e6800640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] conn(0x7f89c407dc40 0x7f89c40800d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.859+0000 7f7ecda00640 1 Processor -- start 2024-04-25T10:26:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.859+0000 7f7ecda00640 1 -- start start 2024-04-25T10:26:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.860+0000 7f9a04c00640 1 -- 172.21.15.19:0/463121143 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc041020 con 0x7f9a08073400 2024-04-25T10:26:15.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.860+0000 7f9a04c00640 1 -- 172.21.15.19:0/463121143 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99fc030700 con 0x7f9a08073400 2024-04-25T10:26:15.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.860+0000 7f89dd400640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f89c4074500 0x7f89c4076a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89e80cd320 tx=0x7f89d8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.860+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a080ac810 con 0x7f9a08073400 2024-04-25T10:26:15.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.860+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a080acdd0 con 0x7f9a08073400 2024-04-25T10:26:15.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.860+0000 7f9a04c00640 1 -- 172.21.15.19:0/463121143 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc037040 con 0x7f9a08073400 2024-04-25T10:26:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.860+0000 7f89e6800640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] conn(0x7f89c407dc40 0x7f89c40800d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.861+0000 7f89dea00640 1 -- 172.21.15.19:0/3471753095 <== osd.7 v2:172.21.15.112:6802/1243256197 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f89d0030ea0 con 0x7f89c407dc40 2024-04-25T10:26:15.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.861+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99e4001030 con 0x7f9a08073400 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.862+0000 7f7ecda00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7ec815ad60 0x7f7ec80c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.862+0000 7f7ecda00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 0x7f7ec80ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.862+0000 7f7ecda00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec8074260 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.862+0000 7f7ecda00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec80cd3f0 con 0x7f7ec815ad60 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.862+0000 7f7ecda00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec80c4160 con 0x7f7ec80c8db0 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.863+0000 7f7ec7400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 0x7f7ec80ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.863+0000 7f7ec7400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 0x7f7ec80ca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60480/0 (socket says 172.21.15.19:60480) 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.863+0000 7f7ec7400640 1 -- 172.21.15.19:0/3589395361 learned_addr learned my addr 172.21.15.19:0/3589395361 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.863+0000 7f7ec7e00640 1 --2- 172.21.15.19:0/3589395361 >> v2:172.21.15.112:3300/0 conn(0x7f7ec815ad60 0x7f7ec80c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.863+0000 7f7ec7400640 1 -- 172.21.15.19:0/3589395361 >> v2:172.21.15.112:3300/0 conn(0x7f7ec815ad60 msgr2=0x7f7ec80c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.863+0000 7f7ec6a00640 1 -- 172.21.15.19:0/3589395361 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315532711 0 0) 0x7f7ec8074260 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.863+0000 7f7ec7400640 1 --2- 172.21.15.19:0/3589395361 >> v2:172.21.15.112:3300/0 conn(0x7f7ec815ad60 0x7f7ec80c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.864+0000 7f7ec7400640 1 -- 172.21.15.19:0/3589395361 >> v1:172.21.15.19:6789/0 conn(0x7f7ec80ca9c0 legacy=0x7f7ec80cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.864+0000 7f7ec7400640 1 -- 172.21.15.19:0/3589395361 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec80c4440 con 0x7f7ec80c8db0 2024-04-25T10:26:15.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.865+0000 7f9a04c00640 1 -- 172.21.15.19:0/463121143 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f99fc044020 con 0x7f9a08073400 2024-04-25T10:26:15.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.867+0000 7f9a04c00640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f99e80745b0 0x7f99e8076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.867+0000 7f9a04c00640 1 -- 172.21.15.19:0/463121143 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f99fc0b6020 con 0x7f9a08073400 2024-04-25T10:26:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.868+0000 7f9a04c00640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] conn(0x7f99e807dd70 0x7f99e8080200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.868+0000 7f9a04c00640 1 -- 172.21.15.19:0/463121143 --> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99fc032440 con 0x7f99e807dd70 2024-04-25T10:26:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.868+0000 7f9a04c00640 1 -- 172.21.15.19:0/463121143 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f99fc0b6410 con 0x7f9a08073400 2024-04-25T10:26:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.868+0000 7f9a0d400640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] conn(0x7f99e807dd70 0x7f99e8080200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.868+0000 7f7ec7400640 1 --2- 172.21.15.19:0/3589395361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 0x7f7ec80ca480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009870 tx=0x7f7eb802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=134f8544462ee8c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.869+0000 7f9a07e00640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f99e80745b0 0x7f99e8076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.869+0000 7f7ec6a00640 1 -- 172.21.15.19:0/3589395361 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8037070 con 0x7f7ec80c8db0 2024-04-25T10:26:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.869+0000 7f7ec6a00640 1 -- 172.21.15.19:0/3589395361 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb802ae50 con 0x7f7ec80c8db0 2024-04-25T10:26:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.869+0000 7f7ec6a00640 1 -- 172.21.15.19:0/3589395361 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8032860 con 0x7f7ec80c8db0 2024-04-25T10:26:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.870+0000 7f7ecda00640 1 -- 172.21.15.19:0/3589395361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 msgr2=0x7f7ec80ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.870+0000 7f7ecda00640 1 --2- 172.21.15.19:0/3589395361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 0x7f7ec80ca480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009870 tx=0x7f7eb802a300 comp rx=0 tx=0).stop 2024-04-25T10:26:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.871+0000 7f7ecda00640 1 -- 172.21.15.19:0/3589395361 shutdown_connections 2024-04-25T10:26:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.871+0000 7f7ecda00640 1 --2- 172.21.15.19:0/3589395361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 0x7f7ec80ca480 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.871+0000 7f7ecda00640 1 --2- 172.21.15.19:0/3589395361 >> v2:172.21.15.112:3300/0 conn(0x7f7ec815ad60 0x7f7ec80c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.871+0000 7f7ecda00640 1 -- 172.21.15.19:0/3589395361 >> 172.21.15.19:0/3589395361 conn(0x7f7ec8070d10 msgr2=0x7f7ec8071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.871+0000 7f7ecda00640 1 -- 172.21.15.19:0/3589395361 shutdown_connections 2024-04-25T10:26:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.870+0000 7f9a07e00640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f99e80745b0 0x7f99e8076ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9a080aace0 tx=0x7f99f4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.872+0000 7f9a0d400640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] conn(0x7f99e807dd70 0x7f99e8080200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.873+0000 7f9a04c00640 1 -- 172.21.15.19:0/463121143 <== osd.5 v2:172.21.15.112:6817/667240234 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f99fc032440 con 0x7f99e807dd70 2024-04-25T10:26:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.872+0000 7f7ecda00640 1 -- 172.21.15.19:0/3589395361 wait complete. 2024-04-25T10:26:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.875+0000 7f6541000640 1 Processor -- start 2024-04-25T10:26:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.876+0000 7f7ecda00640 1 Processor -- start 2024-04-25T10:26:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.876+0000 7f6541000640 1 -- start start 2024-04-25T10:26:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.876+0000 7f7ecda00640 1 -- start start 2024-04-25T10:26:15.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.879+0000 7f7ecda00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 0x7f7ec81554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.880+0000 7f7ecda00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ec80ca9c0 0x7f7ec81505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.879+0000 7f6541000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6534006a90 0x7f6534045e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.880+0000 7f7ec7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 0x7f7ec81554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.880+0000 7f653b400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f65340334e0 0x7f6534046d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47094/0 (socket says 172.21.15.19:47094) 2024-04-25T10:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.880+0000 7f653b400640 1 -- 172.21.15.19:0/3836194238 learned_addr learned my addr 172.21.15.19:0/3836194238 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.880+0000 7f7ec7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 0x7f7ec81554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60492/0 (socket says 172.21.15.19:60492) 2024-04-25T10:26:15.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.880+0000 7f653aa00640 1 --2- 172.21.15.19:0/3836194238 >> v2:172.21.15.112:3300/0 conn(0x7f6534006a90 0x7f6534045e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.881+0000 7f6541000640 1 --2- 172.21.15.19:0/3836194238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6534050ed0 0x7f65340d56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.881+0000 7f6541000640 1 -- 172.21.15.19:0/3836194238 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6534047540 con 0x7f65340334e0 2024-04-25T10:26:15.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.881+0000 7f7ec7e00640 1 -- 172.21.15.19:0/4223985751 learned_addr learned my addr 172.21.15.19:0/4223985751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.881+0000 7f653be00640 1 --2- 172.21.15.19:0/3836194238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6534050ed0 0x7f65340d56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.881+0000 7f7ecda00640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec815ad60 0x7f7ec8150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.881+0000 7f6541000640 1 -- 172.21.15.19:0/3836194238 --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f65340d5c30 con 0x7f6534006a90 2024-04-25T10:26:15.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.882+0000 7f6541000640 1 -- 172.21.15.19:0/3836194238 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6534034fe0 con 0x7f6534050ed0 2024-04-25T10:26:15.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.881+0000 7f7ec7400640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ec80ca9c0 0x7f7ec81505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.882+0000 7f653a000640 1 -- 172.21.15.19:0/3836194238 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418372350 0 0) 0x7f6534047540 con 0x7f65340334e0 2024-04-25T10:26:15.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.882+0000 7f653be00640 1 -- 172.21.15.19:0/3836194238 >> v2:172.21.15.112:3300/0 conn(0x7f6534006a90 msgr2=0x7f6534045e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:15.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.883+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec8074a00 con 0x7f7ec815ad60 2024-04-25T10:26:15.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.883+0000 7f653be00640 1 --2- 172.21.15.19:0/3836194238 >> v2:172.21.15.112:3300/0 conn(0x7f6534006a90 0x7f6534045e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.883+0000 7f653be00640 1 -- 172.21.15.19:0/3836194238 >> v1:172.21.15.19:6789/0 conn(0x7f65340334e0 legacy=0x7f6534046d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.883+0000 7f653be00640 1 -- 172.21.15.19:0/3836194238 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6534035840 con 0x7f6534050ed0 2024-04-25T10:26:15.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.883+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec8073f80 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.883+0000 7f653aa00640 1 --2- 172.21.15.19:0/3836194238 >> v2:172.21.15.112:3300/0 conn(0x7f6534006a90 0x7f6534045e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:15.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.883+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec8074b80 con 0x7f7ec80c8db0 2024-04-25T10:26:15.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.883+0000 7f7ecd000640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec815ad60 0x7f7ec8150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.884+0000 7f7ec7400640 1 -- 172.21.15.19:0/4223985751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 msgr2=0x7f7ec81554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.884+0000 7f7ec7400640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ec80c8db0 0x7f7ec81554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.884+0000 7f7ec7400640 1 -- 172.21.15.19:0/4223985751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec815ad60 msgr2=0x7f7ec8150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.885+0000 7f7ec7400640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec815ad60 0x7f7ec8150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.885+0000 7f7ec7400640 1 -- 172.21.15.19:0/4223985751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec8161960 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.885+0000 7f7ecd000640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec815ad60 0x7f7ec8150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:15.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.885+0000 7f7ec7400640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ec80ca9c0 0x7f7ec81505b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8031000 tx=0x7f7eb80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.885+0000 7f614f200640 1 -- 172.21.15.19:0/15584340 --> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6120005ce0 con 0x7f6120001650 2024-04-25T10:26:15.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.886+0000 7f7ebfe00640 1 -- 172.21.15.19:0/4223985751 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8041070 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.886+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec8155f30 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.886+0000 7f613fe00640 1 -- 172.21.15.19:0/15584340 <== osd.2 v2:172.21.15.19:6816/1878337170 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6120005ce0 con 0x7f6120001650 2024-04-25T10:26:15.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.886+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec8076340 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.886+0000 7f7ebfe00640 1 -- 172.21.15.19:0/4223985751 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb803c680 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.886+0000 7f7ebfe00640 1 -- 172.21.15.19:0/4223985751 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8037040 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.887+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ec81579a0 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.887+0000 7fbe05000640 1 -- 172.21.15.19:0/1063669321 --> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe0015a8e0 con 0x7fbde007dc70 2024-04-25T10:26:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.886+0000 7f653be00640 1 --2- 172.21.15.19:0/3836194238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6534050ed0 0x7f65340d56f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f653c0520f0 tx=0x7f653c0a77a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b0a1fd11f35d4dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.887+0000 7f653a000640 1 -- 172.21.15.19:0/3836194238 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c0b3070 con 0x7f6534050ed0 2024-04-25T10:26:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.887+0000 7f653a000640 1 -- 172.21.15.19:0/3836194238 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653c0ae600 con 0x7f6534050ed0 2024-04-25T10:26:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.887+0000 7f653a000640 1 -- 172.21.15.19:0/3836194238 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c0aea10 con 0x7f6534050ed0 2024-04-25T10:26:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.888+0000 7f614f200640 1 -- 172.21.15.19:0/15584340 >> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] conn(0x7f6120001650 msgr2=0x7f6120003b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.888+0000 7f614f200640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] conn(0x7f6120001650 0x7f6120003b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.888+0000 7f6541000640 1 -- 172.21.15.19:0/3836194238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6534050ed0 msgr2=0x7f65340d56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.888+0000 7f6541000640 1 --2- 172.21.15.19:0/3836194238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6534050ed0 0x7f65340d56f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f653c0520f0 tx=0x7f653c0a77a0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.888+0000 7f6541000640 1 -- 172.21.15.19:0/3836194238 shutdown_connections 2024-04-25T10:26:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.888+0000 7f6541000640 1 --2- 172.21.15.19:0/3836194238 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6534050ed0 0x7f65340d56f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.888+0000 7f6541000640 1 --2- 172.21.15.19:0/3836194238 >> v2:172.21.15.112:3300/0 conn(0x7f6534006a90 0x7f6534045e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.888+0000 7f6541000640 1 -- 172.21.15.19:0/3836194238 >> 172.21.15.19:0/3836194238 conn(0x7f65340503b0 msgr2=0x7f65340507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.889+0000 7f614f200640 1 -- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f61280745b0 msgr2=0x7f6128076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.889+0000 7f614f200640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f61280745b0 0x7f6128076ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6134009960 tx=0x7f61340090e0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.889+0000 7f614f200640 1 -- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61480c7cd0 msgr2=0x7f614814e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.889+0000 7f614f200640 1 --2- 172.21.15.19:0/15584340 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61480c7cd0 0x7f614814e190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6140039000 tx=0x7f6140004a40 comp rx=0 tx=0).stop 2024-04-25T10:26:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.889+0000 7f614d200640 1 -- 172.21.15.19:0/15584340 reap_dead start 2024-04-25T10:26:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.889+0000 7f614f200640 1 -- 172.21.15.19:0/15584340 shutdown_connections 2024-04-25T10:26:15.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.889+0000 7f614f200640 1 -- 172.21.15.19:0/15584340 >> 172.21.15.19:0/15584340 conn(0x7f614806f2e0 msgr2=0x7f61480cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.889+0000 7f6541000640 1 -- 172.21.15.19:0/3836194238 shutdown_connections 2024-04-25T10:26:15.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.890+0000 7f614f200640 1 -- 172.21.15.19:0/15584340 shutdown_connections 2024-04-25T10:26:15.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.889+0000 7f6541000640 1 -- 172.21.15.19:0/3836194238 wait complete. 2024-04-25T10:26:15.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.890+0000 7f7ebfe00640 1 -- 172.21.15.19:0/4223985751 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7eb8044070 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.890+0000 7f614f200640 1 -- 172.21.15.19:0/15584340 wait complete. 2024-04-25T10:26:15.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.889+0000 7fbdf7400640 1 -- 172.21.15.19:0/1063669321 <== osd.0 v2:172.21.15.19:6824/3943322367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbe0015a8e0 con 0x7fbde007dc70 2024-04-25T10:26:15.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.892+0000 7fbe05000640 1 -- 172.21.15.19:0/1063669321 >> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] conn(0x7fbde007dc70 msgr2=0x7fbde0080100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.892+0000 7fbe05000640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] conn(0x7fbde007dc70 0x7fbde0080100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.892+0000 7f7ebfe00640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f7ea80744b0 0x7f7ea80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.892+0000 7f7ebfe00640 1 -- 172.21.15.19:0/4223985751 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7eb80b6670 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.893+0000 7fbe05000640 1 -- 172.21.15.19:0/1063669321 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbde00744b0 msgr2=0x7fbde00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.893+0000 7fbe05000640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbde00744b0 0x7fbde00769c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe00071e70 tx=0x7fbdf8007c50 comp rx=0 tx=0).stop 2024-04-25T10:26:15.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.893+0000 7fbe05000640 1 -- 172.21.15.19:0/1063669321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe000c9850 msgr2=0x7fbe0015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.893+0000 7fbe05000640 1 --2- 172.21.15.19:0/1063669321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe000c9850 0x7fbe0015a350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009890 tx=0x7fbdec0046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.893+0000 7f7ebfe00640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] conn(0x7f7ea807dc70 0x7f7ea8080100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.893+0000 7f7ebfe00640 1 -- 172.21.15.19:0/4223985751 --> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ea80807d0 con 0x7f7ea807dc70 2024-04-25T10:26:15.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.893+0000 7f7ebfe00640 1 -- 172.21.15.19:0/4223985751 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7eb80b6a60 con 0x7f7ec80ca9c0 2024-04-25T10:26:15.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.893+0000 7fbdffe00640 1 -- 172.21.15.19:0/1063669321 reap_dead start 2024-04-25T10:26:15.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.893+0000 7fbe05000640 1 -- 172.21.15.19:0/1063669321 shutdown_connections 2024-04-25T10:26:15.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.893+0000 7fbe05000640 1 -- 172.21.15.19:0/1063669321 >> 172.21.15.19:0/1063669321 conn(0x7fbe00070d10 msgr2=0x7fbe0015e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.893+0000 7f7ec7e00640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f7ea80744b0 0x7f7ea80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.894+0000 7f7ecd000640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] conn(0x7f7ea807dc70 0x7f7ea8080100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.894+0000 7f6541000640 1 Processor -- start 2024-04-25T10:26:15.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.894+0000 7fbe05000640 1 -- 172.21.15.19:0/1063669321 shutdown_connections 2024-04-25T10:26:15.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.894+0000 7fbe05000640 1 -- 172.21.15.19:0/1063669321 wait complete. 2024-04-25T10:26:15.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.896+0000 7f7ec7e00640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f7ea80744b0 0x7f7ea80769c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009b60 tx=0x7f7eb4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.896+0000 7f7ecd000640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] conn(0x7f7ea807dc70 0x7f7ea8080100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.894+0000 7f6541000640 1 -- start start 2024-04-25T10:26:15.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.895+0000 7f0079a00640 1 -- 172.21.15.19:0/2462110055 --> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f006c053ec0 con 0x7f005407dc70 2024-04-25T10:26:15.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.896+0000 7f006aa00640 1 -- 172.21.15.19:0/2462110055 <== osd.4 v2:172.21.15.112:6800/2833374228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f006c053ec0 con 0x7f005407dc70 2024-04-25T10:26:15.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.897+0000 7f6541000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6534006a90 0x7f65340dab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.898+0000 7f6541000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65340334e0 0x7f65340d9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.898+0000 7f0079a00640 1 -- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] conn(0x7f005407dc70 msgr2=0x7f0054080100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.898+0000 7f7ebfe00640 1 -- 172.21.15.19:0/4223985751 <== osd.1 v2:172.21.15.19:6808/2909216045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ea80807d0 con 0x7f7ea807dc70 2024-04-25T10:26:15.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.898+0000 7f6541000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6534050ed0 0x7f65340c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.898+0000 7f0079a00640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] conn(0x7f005407dc70 0x7f0054080100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.898+0000 7f0079a00640 1 -- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f00540744b0 msgr2=0x7f00540769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.898+0000 7f6541000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6534006570 con 0x7f6534006a90 2024-04-25T10:26:15.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.898+0000 7f0079a00640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f00540744b0 0x7f00540769c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f007406b740 tx=0x7f00740696b0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f6541000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6534035560 con 0x7f65340334e0 2024-04-25T10:26:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f0079a00640 1 -- 172.21.15.19:0/2462110055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006c007910 msgr2=0x7f006c053720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f0079a00640 1 --2- 172.21.15.19:0/2462110055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006c007910 0x7f006c053720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0060031000 tx=0x7f00600046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f653aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65340334e0 0x7f65340d9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f653aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65340334e0 0x7f65340d9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39748/0 (socket says 172.21.15.19:39748) 2024-04-25T10:26:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f653aa00640 1 -- 172.21.15.19:0/3496630525 learned_addr learned my addr 172.21.15.19:0/3496630525 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6534045350 con 0x7f6534050ed0 2024-04-25T10:26:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f653be00640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6534050ed0 0x7f65340c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f653b400640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6534006a90 0x7f65340dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f0073400640 1 -- 172.21.15.19:0/2462110055 reap_dead start 2024-04-25T10:26:15.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f0079a00640 1 -- 172.21.15.19:0/2462110055 shutdown_connections 2024-04-25T10:26:15.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.899+0000 7f0079a00640 1 -- 172.21.15.19:0/2462110055 >> 172.21.15.19:0/2462110055 conn(0x7f006c00e380 msgr2=0x7f006c0d4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.900+0000 7f0079a00640 1 -- 172.21.15.19:0/2462110055 shutdown_connections 2024-04-25T10:26:15.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.900+0000 7f0079a00640 1 -- 172.21.15.19:0/2462110055 wait complete. 2024-04-25T10:26:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.901+0000 7f653be00640 1 -- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65340334e0 msgr2=0x7f65340d9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.901+0000 7f653be00640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65340334e0 0x7f65340d9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.901+0000 7f653be00640 1 -- 172.21.15.19:0/3496630525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6534006a90 msgr2=0x7f65340dab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.901+0000 7f653be00640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6534006a90 0x7f65340dab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.901+0000 7f653be00640 1 -- 172.21.15.19:0/3496630525 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65340db080 con 0x7f6534050ed0 2024-04-25T10:26:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.901+0000 7f653aa00640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65340334e0 0x7f65340d9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.901+0000 7f653b400640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6534006a90 0x7f65340dab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.902+0000 7f653be00640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6534050ed0 0x7f65340c6c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f653c06b030 tx=0x7f653c06a980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.904+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 --> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f89c0002dd0 con 0x7f89c407dc40 2024-04-25T10:26:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.905+0000 7f89dea00640 1 -- 172.21.15.19:0/3471753095 <== osd.7 v2:172.21.15.112:6802/1243256197 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f89c0002dd0 con 0x7f89c407dc40 2024-04-25T10:26:15.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.905+0000 7f652f400640 1 -- 172.21.15.19:0/3496630525 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c0b3050 con 0x7f6534050ed0 2024-04-25T10:26:15.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.908+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] conn(0x7f89c407dc40 msgr2=0x7f89c40800d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.908+0000 7f89ed200640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] conn(0x7f89c407dc40 0x7f89c40800d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.908+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f89c4074500 msgr2=0x7f89c4076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.908+0000 7f89ed200640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f89c4074500 0x7f89c4076a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89e80cd320 tx=0x7f89d8008040 comp rx=0 tx=0).stop 2024-04-25T10:26:15.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.909+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80735b0 msgr2=0x7f89e8153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.909+0000 7f89ed200640 1 --2- 172.21.15.19:0/3471753095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89e80735b0 0x7f89e8153f10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89d002eb20 tx=0x7f89d00046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.909+0000 7f89e6800640 1 -- 172.21.15.19:0/3471753095 reap_dead start 2024-04-25T10:26:15.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.910+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 shutdown_connections 2024-04-25T10:26:15.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.910+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 >> 172.21.15.19:0/3471753095 conn(0x7f89e806f1f0 msgr2=0x7f89e80cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.905+0000 7f652f400640 1 -- 172.21.15.19:0/3496630525 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653c0b4040 con 0x7f6534050ed0 2024-04-25T10:26:15.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.905+0000 7f652f400640 1 -- 172.21.15.19:0/3496630525 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c0ad9e0 con 0x7f6534050ed0 2024-04-25T10:26:15.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.905+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65340dbe40 con 0x7f6534050ed0 2024-04-25T10:26:15.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.906+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6534163a30 con 0x7f6534050ed0 2024-04-25T10:26:15.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.912+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 shutdown_connections 2024-04-25T10:26:15.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.912+0000 7f89ed200640 1 -- 172.21.15.19:0/3471753095 wait complete. 2024-04-25T10:26:15.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.913+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6518001030 con 0x7f6534050ed0 2024-04-25T10:26:15.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.918+0000 7f652f400640 1 -- 172.21.15.19:0/3496630525 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f653c0c1030 con 0x7f6534050ed0 2024-04-25T10:26:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.919+0000 7f652f400640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f651c074580 0x7f651c076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.920+0000 7f652f400640 1 -- 172.21.15.19:0/3496630525 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f653c132510 con 0x7f6534050ed0 2024-04-25T10:26:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.920+0000 7f652f400640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] conn(0x7f651c07dcc0 0x7f651c080150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.920+0000 7f652f400640 1 -- 172.21.15.19:0/3496630525 --> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f651c080820 con 0x7f651c07dcc0 2024-04-25T10:26:15.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.921+0000 7f653b400640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f651c074580 0x7f651c076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.921+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 --> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f99e4002dd0 con 0x7f99e807dd70 2024-04-25T10:26:15.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.921+0000 7f652f400640 1 -- 172.21.15.19:0/3496630525 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f653c139050 con 0x7f6534050ed0 2024-04-25T10:26:15.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.921+0000 7f653b400640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f651c074580 0x7f651c076a90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6528007fd0 tx=0x7f6528007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.923+0000 7f653aa00640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] conn(0x7f651c07dcc0 0x7f651c080150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.927 INFO:teuthology.orchestra.run.smithi019.stdout:55834574863 2024-04-25T10:26:15.928 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T10:26:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.924+0000 7f9a04c00640 1 -- 172.21.15.19:0/463121143 <== osd.5 v2:172.21.15.112:6817/667240234 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f99e4002dd0 con 0x7f99e807dd70 2024-04-25T10:26:15.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.925+0000 7f653aa00640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] conn(0x7f651c07dcc0 0x7f651c080150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.925+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] conn(0x7f99e807dd70 msgr2=0x7f99e8080200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.925+0000 7f9a0f400640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] conn(0x7f99e807dd70 0x7f99e8080200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.925+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f99e80745b0 msgr2=0x7f99e8076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.925+0000 7f9a0f400640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f99e80745b0 0x7f99e8076ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9a080aace0 tx=0x7f99f4008040 comp rx=0 tx=0).stop 2024-04-25T10:26:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.925+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a08073400 msgr2=0x7f9a08150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.925+0000 7f9a0f400640 1 --2- 172.21.15.19:0/463121143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a08073400 0x7f9a08150000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0090b0 tx=0x7f99fc0046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.925+0000 7f9a0d400640 1 -- 172.21.15.19:0/463121143 reap_dead start 2024-04-25T10:26:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.926+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 shutdown_connections 2024-04-25T10:26:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.926+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 >> 172.21.15.19:0/463121143 conn(0x7f9a0806f1f0 msgr2=0x7f9a080cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.926+0000 7f652f400640 1 -- 172.21.15.19:0/3496630525 <== osd.3 v2:172.21.15.19:6800/2283064072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f651c080820 con 0x7f651c07dcc0 2024-04-25T10:26:15.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.926+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 shutdown_connections 2024-04-25T10:26:15.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.926+0000 7f9a0f400640 1 -- 172.21.15.19:0/463121143 wait complete. 2024-04-25T10:26:15.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.939+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 --> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ec8050740 con 0x7f7ea807dc70 2024-04-25T10:26:15.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.940+0000 7f7ebfe00640 1 -- 172.21.15.19:0/4223985751 <== osd.1 v2:172.21.15.19:6808/2909216045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7ec8050740 con 0x7f7ea807dc70 2024-04-25T10:26:15.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.941+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 >> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] conn(0x7f7ea807dc70 msgr2=0x7f7ea8080100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.941+0000 7f7ecda00640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] conn(0x7f7ea807dc70 0x7f7ea8080100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.942+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f7ea80744b0 msgr2=0x7f7ea80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.942+0000 7f7ecda00640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f7ea80744b0 0x7f7ea80769c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009b60 tx=0x7f7eb4009190 comp rx=0 tx=0).stop 2024-04-25T10:26:15.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.942+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ec80ca9c0 msgr2=0x7f7ec81505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.942+0000 7f7ecda00640 1 --2- 172.21.15.19:0/4223985751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ec80ca9c0 0x7f7ec81505b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8031000 tx=0x7f7eb80046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.942+0000 7f7ecd000640 1 -- 172.21.15.19:0/4223985751 reap_dead start 2024-04-25T10:26:15.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.942+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 shutdown_connections 2024-04-25T10:26:15.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.942+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 >> 172.21.15.19:0/4223985751 conn(0x7f7ec8070d10 msgr2=0x7f7ec80c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.942+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 shutdown_connections 2024-04-25T10:26:15.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.943+0000 7f7ecda00640 1 -- 172.21.15.19:0/4223985751 wait complete. 2024-04-25T10:26:15.951 INFO:teuthology.orchestra.run.smithi019.stdout:55834574863 2024-04-25T10:26:15.951 INFO:teuthology.orchestra.run.smithi019.stdout:55834574863 2024-04-25T10:26:15.952 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T10:26:15.952 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T10:26:15.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.949+0000 7f0787200640 1 Processor -- start 2024-04-25T10:26:15.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.950+0000 7f0787200640 1 -- start start 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.952+0000 7f0787200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f078815ad80 0x7f07880c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.952+0000 7f0787200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07880c8e40 0x7f07880c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.952+0000 7f0787200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880ca090 0x7f07880ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.952+0000 7f0787200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0788161830 con 0x7f07880c8e40 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.952+0000 7f0787200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0788074080 con 0x7f078815ad80 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.952+0000 7f0787200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f07881612b0 con 0x7f07880ca090 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.953+0000 7f0785e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f078815ad80 0x7f07880c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.953+0000 7f0785e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f078815ad80 0x7f07880c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39754/0 (socket says 172.21.15.19:39754) 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.953+0000 7f0785e00640 1 -- 172.21.15.19:0/176104691 learned_addr learned my addr 172.21.15.19:0/176104691 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.953+0000 7f0786800640 1 --2- 172.21.15.19:0/176104691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880ca090 0x7f07880ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.954+0000 7f0786800640 1 -- 172.21.15.19:0/176104691 >> v2:172.21.15.112:3300/0 conn(0x7f078815ad80 msgr2=0x7f07880c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.954+0000 7f0786800640 1 --2- 172.21.15.19:0/176104691 >> v2:172.21.15.112:3300/0 conn(0x7f078815ad80 0x7f07880c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.954+0000 7f0786800640 1 -- 172.21.15.19:0/176104691 >> v2:172.21.15.19:3300/0 conn(0x7f07880c8e40 msgr2=0x7f07880c9420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:26:15.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.954+0000 7f0786800640 1 --2- 172.21.15.19:0/176104691 >> v2:172.21.15.19:3300/0 conn(0x7f07880c8e40 0x7f07880c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.954+0000 7f0786800640 1 -- 172.21.15.19:0/176104691 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0788161550 con 0x7f07880ca090 2024-04-25T10:26:15.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.956+0000 7f0785e00640 1 --2- 172.21.15.19:0/176104691 >> v2:172.21.15.112:3300/0 conn(0x7f078815ad80 0x7f07880c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:15.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.956+0000 7f0786800640 1 --2- 172.21.15.19:0/176104691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880ca090 0x7f07880ca4a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0788072710 tx=0x7f078002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40f94d5a5aa8c08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.961 INFO:teuthology.orchestra.run.smithi019.stdout:55834574863 2024-04-25T10:26:15.961 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T10:26:15.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.957+0000 7f0784a00640 1 -- 172.21.15.19:0/176104691 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0780007740 con 0x7f07880ca090 2024-04-25T10:26:15.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.959+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 --> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6518002dd0 con 0x7f651c07dcc0 2024-04-25T10:26:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.960+0000 7f652f400640 1 -- 172.21.15.19:0/3496630525 <== osd.3 v2:172.21.15.19:6800/2283064072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6518002dd0 con 0x7f651c07dcc0 2024-04-25T10:26:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.957+0000 7f0784a00640 1 -- 172.21.15.19:0/176104691 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07800078e0 con 0x7f07880ca090 2024-04-25T10:26:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.957+0000 7f0784a00640 1 -- 172.21.15.19:0/176104691 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0780007cf0 con 0x7f07880ca090 2024-04-25T10:26:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.959+0000 7f0787200640 1 -- 172.21.15.19:0/176104691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880ca090 msgr2=0x7f07880ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.959+0000 7f0787200640 1 --2- 172.21.15.19:0/176104691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880ca090 0x7f07880ca4a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0788072710 tx=0x7f078002a680 comp rx=0 tx=0).stop 2024-04-25T10:26:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.959+0000 7f0787200640 1 -- 172.21.15.19:0/176104691 shutdown_connections 2024-04-25T10:26:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.959+0000 7f0787200640 1 --2- 172.21.15.19:0/176104691 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880ca090 0x7f07880ca4a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.959+0000 7f0787200640 1 --2- 172.21.15.19:0/176104691 >> v2:172.21.15.19:3300/0 conn(0x7f07880c8e40 0x7f07880c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.959+0000 7f0787200640 1 --2- 172.21.15.19:0/176104691 >> v2:172.21.15.112:3300/0 conn(0x7f078815ad80 0x7f07880c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.960+0000 7f0787200640 1 -- 172.21.15.19:0/176104691 >> 172.21.15.19:0/176104691 conn(0x7f0788070d10 msgr2=0x7f0788071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.960+0000 7f0787200640 1 -- 172.21.15.19:0/176104691 shutdown_connections 2024-04-25T10:26:15.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.960+0000 7f0787200640 1 -- 172.21.15.19:0/176104691 wait complete. 2024-04-25T10:26:15.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.960+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 >> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] conn(0x7f651c07dcc0 msgr2=0x7f651c080150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.960+0000 7f6541000640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] conn(0x7f651c07dcc0 0x7f651c080150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.961+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f651c074580 msgr2=0x7f651c076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.961+0000 7f6541000640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f651c074580 0x7f651c076a90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6528007fd0 tx=0x7f6528007de0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.961+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6534050ed0 msgr2=0x7f65340c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.961+0000 7f6541000640 1 --2- 172.21.15.19:0/3496630525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6534050ed0 0x7f65340c6c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f653c06b030 tx=0x7f653c06a980 comp rx=0 tx=0).stop 2024-04-25T10:26:15.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.961+0000 7f653be00640 1 -- 172.21.15.19:0/3496630525 reap_dead start 2024-04-25T10:26:15.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.962+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 shutdown_connections 2024-04-25T10:26:15.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.962+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 >> 172.21.15.19:0/3496630525 conn(0x7f65340503b0 msgr2=0x7f653404d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:15.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.962+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 shutdown_connections 2024-04-25T10:26:15.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.962+0000 7f6541000640 1 -- 172.21.15.19:0/3496630525 wait complete. 2024-04-25T10:26:15.976 INFO:teuthology.orchestra.run.smithi019.stdout:55834574862 2024-04-25T10:26:15.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.965+0000 7f0787200640 1 Processor -- start 2024-04-25T10:26:15.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.965+0000 7f0787200640 1 -- start start 2024-04-25T10:26:15.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.968+0000 7f0787200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880c8e40 0x7f078815d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.968+0000 7f0787200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07880ca090 0x7f07880c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.968+0000 7f0785e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880c8e40 0x7f078815d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.969+0000 7f0785e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880c8e40 0x7f078815d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60542/0 (socket says 172.21.15.19:60542) 2024-04-25T10:26:15.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.969+0000 7f0785400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07880ca090 0x7f07880c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.969+0000 7f0785400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07880ca090 0x7f07880c6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39764/0 (socket says 172.21.15.19:39764) 2024-04-25T10:26:15.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.969+0000 7f0785e00640 1 -- 172.21.15.19:0/400777284 learned_addr learned my addr 172.21.15.19:0/400777284 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:15.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.969+0000 7f0787200640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078815ad80 0x7f07880c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.969+0000 7f0786800640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078815ad80 0x7f07880c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.970+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0788073d10 con 0x7f078815ad80 2024-04-25T10:26:15.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.970+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f07880c4440 con 0x7f07880ca090 2024-04-25T10:26:15.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.970+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f07880cd260 con 0x7f07880c8e40 2024-04-25T10:26:15.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.970+0000 7f0785e00640 1 -- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07880ca090 msgr2=0x7f07880c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.971+0000 7f0785e00640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07880ca090 0x7f07880c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.971+0000 7f0785e00640 1 -- 172.21.15.19:0/400777284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078815ad80 msgr2=0x7f07880c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:15.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.971+0000 7f0785e00640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078815ad80 0x7f07880c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:15.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.971+0000 7f0785e00640 1 -- 172.21.15.19:0/400777284 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078815d780 con 0x7f07880c8e40 2024-04-25T10:26:15.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.971+0000 7f0785400640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07880ca090 0x7f07880c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:15.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.971+0000 7f0785e00640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880c8e40 0x7f078815d240 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f077800e9e0 tx=0x7f077800eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.972+0000 7f077e000640 1 -- 172.21.15.19:0/400777284 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778017070 con 0x7f07880c8e40 2024-04-25T10:26:15.979 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T10:26:15.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.972+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07881f78b0 con 0x7f07880c8e40 2024-04-25T10:26:15.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.972+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f07881f7b50 con 0x7f07880c8e40 2024-04-25T10:26:15.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.973+0000 7f077e000640 1 -- 172.21.15.19:0/400777284 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f077800c9d0 con 0x7f07880c8e40 2024-04-25T10:26:15.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.973+0000 7f077e000640 1 -- 172.21.15.19:0/400777284 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778017070 con 0x7f07880c8e40 2024-04-25T10:26:15.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.975+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0760001030 con 0x7f07880c8e40 2024-04-25T10:26:15.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.977+0000 7f077e000640 1 -- 172.21.15.19:0/400777284 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f077801a070 con 0x7f07880c8e40 2024-04-25T10:26:15.987 INFO:teuthology.orchestra.run.smithi019.stdout:55834574861 2024-04-25T10:26:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.979+0000 7f077e000640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f07680746b0 0x7f0768076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.979+0000 7f077e000640 1 -- 172.21.15.19:0/400777284 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f07780952b0 con 0x7f07880c8e40 2024-04-25T10:26:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.980+0000 7f077e000640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] conn(0x7f076807de70 0x7f0768080300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.980+0000 7f077e000640 1 -- 172.21.15.19:0/400777284 --> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0778016ec0 con 0x7f076807de70 2024-04-25T10:26:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.980+0000 7f077e000640 1 -- 172.21.15.19:0/400777284 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f07780956a0 con 0x7f07880c8e40 2024-04-25T10:26:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.980+0000 7f0785400640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f07680746b0 0x7f0768076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.981+0000 7f0786800640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] conn(0x7f076807de70 0x7f0768080300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.982+0000 7f0786800640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] conn(0x7f076807de70 0x7f0768080300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.982+0000 7f0785400640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f07680746b0 0x7f0768076bc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f07880736e0 tx=0x7f0774009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:15.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:15.983+0000 7f077e000640 1 -- 172.21.15.19:0/400777284 <== osd.6 v2:172.21.15.112:6816/1243277585 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0778016ec0 con 0x7f076807de70 2024-04-25T10:26:15.988 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T10:26:16.013 INFO:teuthology.orchestra.run.smithi019.stdout:55834574863 2024-04-25T10:26:16.014 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T10:26:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.019+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 --> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0760002dd0 con 0x7f076807de70 2024-04-25T10:26:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.020+0000 7f077e000640 1 -- 172.21.15.19:0/400777284 <== osd.6 v2:172.21.15.112:6816/1243277585 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0760002dd0 con 0x7f076807de70 2024-04-25T10:26:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.020+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] conn(0x7f076807de70 msgr2=0x7f0768080300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.020+0000 7f0787200640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] conn(0x7f076807de70 0x7f0768080300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.021+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f07680746b0 msgr2=0x7f0768076bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.021+0000 7f0787200640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f07680746b0 0x7f0768076bc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f07880736e0 tx=0x7f0774009060 comp rx=0 tx=0).stop 2024-04-25T10:26:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.021+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880c8e40 msgr2=0x7f078815d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.021+0000 7f0787200640 1 --2- 172.21.15.19:0/400777284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880c8e40 0x7f078815d240 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f077800e9e0 tx=0x7f077800eea0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.021+0000 7f0786800640 1 -- 172.21.15.19:0/400777284 reap_dead start 2024-04-25T10:26:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.021+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 shutdown_connections 2024-04-25T10:26:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.021+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 >> 172.21.15.19:0/400777284 conn(0x7f0788070d10 msgr2=0x7f07880cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.022+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 shutdown_connections 2024-04-25T10:26:16.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.022+0000 7f0787200640 1 -- 172.21.15.19:0/400777284 wait complete. 2024-04-25T10:26:16.070 INFO:teuthology.orchestra.run.smithi019.stdout:55834574862 2024-04-25T10:26:16.070 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T10:26:16.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.387+0000 7f8779e00640 1 Processor -- start 2024-04-25T10:26:16.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.387+0000 7f8779e00640 1 -- start start 2024-04-25T10:26:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.392+0000 7f8779e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f87740c3800 0x7f87741584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.392+0000 7f8779e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f87740cd910 0x7f87740cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.392+0000 7f669fe00640 1 Processor -- start 2024-04-25T10:26:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.392+0000 7f669fe00640 1 -- start start 2024-04-25T10:26:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.392+0000 7f8779e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8774155f80 con 0x7f87740745c0 2024-04-25T10:26:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.392+0000 7ff20ca00640 1 Processor -- start 2024-04-25T10:26:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.393+0000 7ff20ca00640 1 -- start start 2024-04-25T10:26:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.393+0000 7f8773e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f87740cd910 0x7f87740cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.393+0000 7f8773e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f87740cd910 0x7f87740cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39774/0 (socket says 172.21.15.19:39774) 2024-04-25T10:26:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.393+0000 7f8773e00640 1 -- 172.21.15.19:0/731323399 learned_addr learned my addr 172.21.15.19:0/731323399 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.393+0000 7f8779e00640 1 -- 172.21.15.19:0/731323399 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f87740c8cb0 con 0x7f87740c3800 2024-04-25T10:26:16.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.393+0000 7f8779e00640 1 -- 172.21.15.19:0/731323399 --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f87740c4720 con 0x7f87740cd910 2024-04-25T10:26:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.395+0000 7f8771600640 1 -- 172.21.15.19:0/731323399 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983533193 0 0) 0x7f8774155f80 con 0x7f87740745c0 2024-04-25T10:26:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.395+0000 7f8771600640 1 -- 172.21.15.19:0/731323399 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8758005730 con 0x7f87740745c0 2024-04-25T10:26:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.395+0000 7f669fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66a0152690 0x7f66a00c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.396+0000 7ff207400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff20806ffd0 0x7ff20806ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:40854/0 (socket says 172.21.15.19:40854) 2024-04-25T10:26:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.396+0000 7ff20ca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff20816dfa0 0x7ff208073010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.396+0000 7ff20ca00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2080c85e0 con 0x7ff2080c2640 2024-04-25T10:26:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.396+0000 7ff20ca00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2080c8020 con 0x7ff20806ffd0 2024-04-25T10:26:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.396+0000 7ff20ca00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff2080c8300 con 0x7ff20816dfa0 2024-04-25T10:26:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.397+0000 7ff207400640 1 -- 172.21.15.19:0/3613438431 learned_addr learned my addr 172.21.15.19:0/3613438431 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.397+0000 7ff207e00640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff20816dfa0 0x7ff208073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.398+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3922865495 0 0) 0x7ff2080c85e0 con 0x7ff2080c2640 2024-04-25T10:26:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.398+0000 7f669fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f66a00c8850 0x7f66a015bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.396+0000 7f8773e00640 1 -- 172.21.15.19:0/731323399 >> v2:172.21.15.19:3300/0 conn(0x7f87740c3800 msgr2=0x7f87741584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.398+0000 7f669fe00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a00c9210 con 0x7f66a015c4d0 2024-04-25T10:26:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.398+0000 7f669fe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f66a00c9d90 con 0x7f66a00c8850 2024-04-25T10:26:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.398+0000 7f669fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f66a00c94f0 con 0x7f66a0152690 2024-04-25T10:26:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.398+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1ec003520 con 0x7ff2080c2640 2024-04-25T10:26:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.398+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 220250736 0 0) 0x7ff2080c8020 con 0x7ff20806ffd0 2024-04-25T10:26:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.398+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2080c85e0 con 0x7ff20806ffd0 2024-04-25T10:26:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.396+0000 7f8773e00640 1 --2- 172.21.15.19:0/731323399 >> v2:172.21.15.19:3300/0 conn(0x7f87740c3800 0x7f87741584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.396+0000 7f8773e00640 1 -- 172.21.15.19:0/731323399 >> v1:172.21.15.19:6789/0 conn(0x7f87740745c0 legacy=0x7f87740c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.398+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 <== mon.1 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2108287496 0 0) 0x7ff2080c85e0 con 0x7ff20806ffd0 2024-04-25T10:26:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff20816dfa0 msgr2=0x7ff208073010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff20816dfa0 0x7ff208073010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 >> v1:172.21.15.19:6789/0 conn(0x7ff2080c2640 legacy=0x7ff208175c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20816d4c0 con 0x7ff20806ffd0 2024-04-25T10:26:16.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.396+0000 7f8773e00640 1 -- 172.21.15.19:0/731323399 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87740c4a00 con 0x7f87740cd910 2024-04-25T10:26:16.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.398+0000 7f669e000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f66a00c8850 0x7f66a015bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 <== mon.1 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2140478945 0 0) 0x7ff1f8001670 con 0x7ff20806ffd0 2024-04-25T10:26:16.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 >> v1:172.21.15.112:6789/0 conn(0x7ff20806ffd0 legacy=0x7ff20806ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec004ba0 0x7ff1ec005010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1ec0037a0 0x7ff1ec003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1ec004140 0x7ff1ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff2080c8300 con 0x7ff1ec004ba0 2024-04-25T10:26:16.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec00c0c0 con 0x7ff1ec004140 2024-04-25T10:26:16.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ec00c2c0 con 0x7ff1ec0037a0 2024-04-25T10:26:16.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7f8773e00640 1 --2- 172.21.15.19:0/731323399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87740cd910 0x7f87740cdd20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f87740c4d10 tx=0x7f876c02ab10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93930caee8295b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.400+0000 7f8771600640 1 -- 172.21.15.19:0/731323399 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c032070 con 0x7f87740cd910 2024-04-25T10:26:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7f669e000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f66a00c8850 0x7f66a015bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39788/0 (socket says 172.21.15.19:39788) 2024-04-25T10:26:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7f669e000640 1 -- 172.21.15.19:0/692706325 learned_addr learned my addr 172.21.15.19:0/692706325 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.399+0000 7f669ea00640 1 --2- 172.21.15.19:0/692706325 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66a0152690 0x7f66a00c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.400+0000 7ff207e00640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff20816dfa0 0x7ff208073010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.400+0000 7f8771600640 1 -- 172.21.15.19:0/731323399 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876c00a4e0 con 0x7f87740cd910 2024-04-25T10:26:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.400+0000 7f8771600640 1 -- 172.21.15.19:0/731323399 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c00a8f0 con 0x7f87740cd910 2024-04-25T10:26:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.400+0000 7f669ea00640 1 -- 172.21.15.19:0/692706325 >> v2:172.21.15.112:3300/0 conn(0x7f66a00c8850 msgr2=0x7f66a015bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.400+0000 7f669ea00640 1 --2- 172.21.15.19:0/692706325 >> v2:172.21.15.112:3300/0 conn(0x7f66a00c8850 0x7f66a015bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.400+0000 7f669ea00640 1 -- 172.21.15.19:0/692706325 >> v1:172.21.15.19:6789/0 conn(0x7f66a015c4d0 legacy=0x7f66a0073440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.400+0000 7ff207400640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec004ba0 0x7ff1ec005010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.400+0000 7ff206a00640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1ec0037a0 0x7ff1ec003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.401+0000 7ff207e00640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1ec004140 0x7ff1ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.401+0000 7f669ea00640 1 -- 172.21.15.19:0/692706325 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a00c97d0 con 0x7f66a0152690 2024-04-25T10:26:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.402+0000 7ff206a00640 1 -- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1ec004140 msgr2=0x7ff1ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.402+0000 7ff206a00640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1ec004140 0x7ff1ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.402+0000 7ff206a00640 1 -- 172.21.15.19:0/3613438431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec004ba0 msgr2=0x7ff1ec005010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.402+0000 7ff206a00640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec004ba0 0x7ff1ec005010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.402+0000 7ff206a00640 1 -- 172.21.15.19:0/3613438431 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ec003520 con 0x7ff1ec0037a0 2024-04-25T10:26:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.402+0000 7f8779e00640 1 -- 172.21.15.19:0/731323399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87740cd910 msgr2=0x7f87740cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.402+0000 7f8779e00640 1 --2- 172.21.15.19:0/731323399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87740cd910 0x7f87740cdd20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f87740c4d10 tx=0x7f876c02ab10 comp rx=0 tx=0).stop 2024-04-25T10:26:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.402+0000 7ff207e00640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1ec004140 0x7ff1ec00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.403+0000 7f8779e00640 1 -- 172.21.15.19:0/731323399 shutdown_connections 2024-04-25T10:26:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.403+0000 7f8779e00640 1 --2- 172.21.15.19:0/731323399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87740cd910 0x7f87740cdd20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.403+0000 7f8779e00640 1 --2- 172.21.15.19:0/731323399 >> v2:172.21.15.19:3300/0 conn(0x7f87740c3800 0x7f87741584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.403+0000 7f8779e00640 1 -- 172.21.15.19:0/731323399 >> 172.21.15.19:0/731323399 conn(0x7f877406f560 msgr2=0x7f877406c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.403+0000 7f669ea00640 1 --2- 172.21.15.19:0/692706325 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66a0152690 0x7f66a00c8310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f668c0097a0 tx=0x7f668c02c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c905da0a1a869a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.404+0000 7f8779e00640 1 -- 172.21.15.19:0/731323399 shutdown_connections 2024-04-25T10:26:16.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.404+0000 7f8779e00640 1 -- 172.21.15.19:0/731323399 wait complete. 2024-04-25T10:26:16.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.404+0000 7f669d600640 1 -- 172.21.15.19:0/692706325 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c039070 con 0x7f66a0152690 2024-04-25T10:26:16.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.404+0000 7f669d600640 1 -- 172.21.15.19:0/692706325 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668c034640 con 0x7f66a0152690 2024-04-25T10:26:16.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.404+0000 7f669d600640 1 -- 172.21.15.19:0/692706325 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c034a50 con 0x7f66a0152690 2024-04-25T10:26:16.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.404+0000 7ff206a00640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1ec0037a0 0x7ff1ec003bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4001940 tx=0x7ff1ec005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23e46a2042594c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.404+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4037070 con 0x7ff1ec0037a0 2024-04-25T10:26:16.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.405+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f402ac90 con 0x7ff1ec0037a0 2024-04-25T10:26:16.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.406+0000 7ff206000640 1 -- 172.21.15.19:0/3613438431 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4001540 con 0x7ff1ec0037a0 2024-04-25T10:26:16.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.406+0000 7f669fe00640 1 -- 172.21.15.19:0/692706325 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66a0152690 msgr2=0x7f66a00c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.406+0000 7f669fe00640 1 --2- 172.21.15.19:0/692706325 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66a0152690 0x7f66a00c8310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f668c0097a0 tx=0x7f668c02c3b0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.406+0000 7f669fe00640 1 -- 172.21.15.19:0/692706325 shutdown_connections 2024-04-25T10:26:16.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.406+0000 7f669fe00640 1 --2- 172.21.15.19:0/692706325 >> v2:172.21.15.112:3300/0 conn(0x7f66a00c8850 0x7f66a015bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.406+0000 7f669fe00640 1 --2- 172.21.15.19:0/692706325 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66a0152690 0x7f66a00c8310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.406+0000 7f669fe00640 1 -- 172.21.15.19:0/692706325 >> 172.21.15.19:0/692706325 conn(0x7f66a006d120 msgr2=0x7f66a00cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.406+0000 7ff20ca00640 1 -- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1ec0037a0 msgr2=0x7ff1ec003bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.406+0000 7ff20ca00640 1 --2- 172.21.15.19:0/3613438431 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1ec0037a0 0x7ff1ec003bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4001940 tx=0x7ff1ec005830 comp rx=0 tx=0).stop 2024-04-25T10:26:16.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.406+0000 7ff207e00640 1 -- 172.21.15.19:0/3613438431 reap_dead start 2024-04-25T10:26:16.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.407+0000 7f669fe00640 1 -- 172.21.15.19:0/692706325 shutdown_connections 2024-04-25T10:26:16.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.407+0000 7f8b5fe00640 1 Processor -- start 2024-04-25T10:26:16.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.407+0000 7f669fe00640 1 -- 172.21.15.19:0/692706325 wait complete. 2024-04-25T10:26:16.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.407+0000 7f8b5fe00640 1 -- start start 2024-04-25T10:26:16.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.408+0000 7fb2ac800640 1 Processor -- start 2024-04-25T10:26:16.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.408+0000 7fb2ac800640 1 -- start start 2024-04-25T10:26:16.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.409+0000 7f8779e00640 1 Processor -- start 2024-04-25T10:26:16.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.409+0000 7f8779e00640 1 -- start start 2024-04-25T10:26:16.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.407+0000 7ff20ca00640 1 -- 172.21.15.19:0/3613438431 shutdown_connections 2024-04-25T10:26:16.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.410+0000 7ff20ca00640 1 -- 172.21.15.19:0/3613438431 >> 172.21.15.19:0/3613438431 conn(0x7ff2080ca120 msgr2=0x7ff2080ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7fb2ac800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2a40cde30 0x7fb2a40c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7ff20ca00640 1 -- 172.21.15.19:0/3613438431 shutdown_connections 2024-04-25T10:26:16.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7fb2ac800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2a40b74a0 0x7fb2a406dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7fb2ac800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a40b4650 con 0x7fb2a406e230 2024-04-25T10:26:16.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7fb2ac800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb2a40b5f40 con 0x7fb2a40b74a0 2024-04-25T10:26:16.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7fb2ac800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a415cfc0 con 0x7fb2a40cde30 2024-04-25T10:26:16.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7ff20ca00640 1 -- 172.21.15.19:0/3613438431 wait complete. 2024-04-25T10:26:16.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7fb2a9e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2a40cde30 0x7fb2a40c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7fb2a9e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2a40cde30 0x7fb2a40c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60592/0 (socket says 172.21.15.19:60592) 2024-04-25T10:26:16.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7fb2a9e00640 1 -- 172.21.15.19:0/3182881977 learned_addr learned my addr 172.21.15.19:0/3182881977 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.412+0000 7fb2a9400640 1 --2- 172.21.15.19:0/3182881977 >> v2:172.21.15.112:3300/0 conn(0x7fb2a40b74a0 0x7fb2a406dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.410+0000 7f8b5fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 0x7f8b600b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.410+0000 7f8b5fe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b60156770 0x7f8b600cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.410+0000 7f8b5fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8b600cdb20 0x7f8b6015ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.410+0000 7f8b5fe00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8b600b76d0 con 0x7f8b60156770 2024-04-25T10:26:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.410+0000 7f8b5fe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8b6015f6d0 con 0x7f8b600cdb20 2024-04-25T10:26:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.410+0000 7f8b5fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6015d2f0 con 0x7f8b600ccfb0 2024-04-25T10:26:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7f8b5ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 0x7f8b600b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7f8b5f400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8b600cdb20 0x7f8b6015ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7f8b5f400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8b600cdb20 0x7f8b6015ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39804/0 (socket says 172.21.15.19:39804) 2024-04-25T10:26:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7f8b5f400640 1 -- 172.21.15.19:0/3147690600 learned_addr learned my addr 172.21.15.19:0/3147690600 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.411+0000 7f8b5e000640 1 --2- 172.21.15.19:0/3147690600 >> v2:172.21.15.19:3300/0 conn(0x7f8b60156770 0x7f8b600cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.412+0000 7f8b5f400640 1 -- 172.21.15.19:0/3147690600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 msgr2=0x7f8b600b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.412+0000 7f8b5f400640 1 --2- 172.21.15.19:0/3147690600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 0x7f8b600b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.412+0000 7f8b5f400640 1 -- 172.21.15.19:0/3147690600 >> v2:172.21.15.19:3300/0 conn(0x7f8b60156770 msgr2=0x7f8b600cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.412+0000 7f8b5f400640 1 --2- 172.21.15.19:0/3147690600 >> v2:172.21.15.19:3300/0 conn(0x7f8b60156770 0x7f8b600cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.412+0000 7f8b5f400640 1 -- 172.21.15.19:0/3147690600 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6015c7b0 con 0x7f8b600cdb20 2024-04-25T10:26:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.413+0000 7f8779e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87740745c0 0x7f87741ee750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.413+0000 7f8772a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87740745c0 0x7f87741ee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.413+0000 7f8772a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87740745c0 0x7f87741ee750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39824/0 (socket says 172.21.15.19:39824) 2024-04-25T10:26:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.414+0000 7f669fe00640 1 Processor -- start 2024-04-25T10:26:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.413+0000 7f8772a00640 1 -- 172.21.15.19:0/2043732981 learned_addr learned my addr 172.21.15.19:0/2043732981 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.414+0000 7f8779e00640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87740c3800 0x7f87741e2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.414+0000 7f8779e00640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87740cd910 0x7f8774151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.414+0000 7f669fe00640 1 -- start start 2024-04-25T10:26:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.414+0000 7f8b5f400640 1 --2- 172.21.15.19:0/3147690600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b600cdb20 0x7f8b6015ff40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b600cc3a0 tx=0x7f8b5802a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5690a1ee88ad39d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.414+0000 7f8b5d600640 1 -- 172.21.15.19:0/3147690600 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58036070 con 0x7f8b600cdb20 2024-04-25T10:26:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f87740c8940 con 0x7f87740cd910 2024-04-25T10:26:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f87740c8660 con 0x7f87740745c0 2024-04-25T10:26:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f87740c9140 con 0x7f87740c3800 2024-04-25T10:26:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7f8b5d600640 1 -- 172.21.15.19:0/3147690600 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b58031600 con 0x7f8b600cdb20 2024-04-25T10:26:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7f8772a00640 1 -- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87740c3800 msgr2=0x7f87741e2350 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T10:26:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7f8772a00640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87740c3800 0x7f87741e2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7f8772a00640 1 -- 172.21.15.19:0/2043732981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87740cd910 msgr2=0x7f8774151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7f8772a00640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87740cd910 0x7f8774151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7f8772a00640 1 -- 172.21.15.19:0/2043732981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87741eec90 con 0x7f87740745c0 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7f8772a00640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87740745c0 0x7f87741ee750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f876000c390 tx=0x7f876000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.413+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056125451 0 0) 0x7fb2a40b4650 con 0x7fb2a406e230 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.413+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb28c003520 con 0x7fb2a406e230 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.414+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2337213771 0 0) 0x7fb28c003520 con 0x7fb2a406e230 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.414+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2a40cde30 msgr2=0x7fb2a40c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.414+0000 7fb2a8a00640 1 --2- 172.21.15.19:0/3182881977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2a40cde30 0x7fb2a40c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 >> v2:172.21.15.112:3300/0 conn(0x7fb2a40b74a0 msgr2=0x7fb2a406dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7fb2a8a00640 1 --2- 172.21.15.19:0/3182881977 >> v2:172.21.15.112:3300/0 conn(0x7fb2a40b74a0 0x7fb2a406dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a415d2a0 con 0x7fb2a406e230 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2140478945 0 0) 0x7fb298001670 con 0x7fb2a406e230 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 >> v1:172.21.15.19:6789/0 conn(0x7fb2a406e230 legacy=0x7fb2a40b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7fb2a8a00640 1 --2- 172.21.15.19:0/3182881977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0039b0 0x7fb28c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7fb2a8a00640 1 --2- 172.21.15.19:0/3182881977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb28c004800 0x7fb28c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7fb2a8a00640 1 --2- 172.21.15.19:0/3182881977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28c005150 0x7fb28c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a40b5f40 con 0x7fb28c0039b0 2024-04-25T10:26:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a415cfc0 con 0x7fb28c004800 2024-04-25T10:26:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb28c00c030 con 0x7fb28c005150 2024-04-25T10:26:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7fb2a9400640 1 --2- 172.21.15.19:0/3182881977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb28c004800 0x7fb28c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7f669fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66a00c8850 0x7f66a01f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7f669fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a0152690 0x7f66a0146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7f669fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66a015c4d0 0x7f66a015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7f669fe00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f66a0073130 con 0x7f66a015c4d0 2024-04-25T10:26:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7f669fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f66a015ba70 con 0x7f66a0152690 2024-04-25T10:26:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.416+0000 7f669fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f66a0073b50 con 0x7f66a00c8850 2024-04-25T10:26:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7f669e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a0152690 0x7f66a0146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7f669e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a0152690 0x7f66a0146a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39844/0 (socket says 172.21.15.19:39844) 2024-04-25T10:26:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7f669e000640 1 -- 172.21.15.19:0/3385516265 learned_addr learned my addr 172.21.15.19:0/3385516265 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7f669ea00640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66a00c8850 0x7f66a01f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7f669f400640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66a015c4d0 0x7f66a015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.415+0000 7f8b5d600640 1 -- 172.21.15.19:0/3147690600 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58031a10 con 0x7f8b600cdb20 2024-04-25T10:26:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7f8b5fe00640 1 -- 172.21.15.19:0/3147690600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b600cdb20 msgr2=0x7f8b6015ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/3147690600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b600cdb20 0x7f8b6015ff40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b600cc3a0 tx=0x7f8b5802a760 comp rx=0 tx=0).stop 2024-04-25T10:26:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.418+0000 7f8b5fe00640 1 -- 172.21.15.19:0/3147690600 shutdown_connections 2024-04-25T10:26:16.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7ff20ca00640 1 Processor -- start 2024-04-25T10:26:16.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7fb2a9400640 1 -- 172.21.15.19:0/3182881977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28c005150 msgr2=0x7fb28c00b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T10:26:16.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7fb2a9400640 1 --2- 172.21.15.19:0/3182881977 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb28c005150 0x7fb28c00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.419+0000 7f669f400640 1 -- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66a00c8850 msgr2=0x7f66a01f6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.419+0000 7f669f400640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66a00c8850 0x7f66a01f6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.419+0000 7f669f400640 1 -- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a0152690 msgr2=0x7f66a0146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.419+0000 7f669f400640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a0152690 0x7f66a0146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.419+0000 7f669f400640 1 -- 172.21.15.19:0/3385516265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a015a780 con 0x7f66a015c4d0 2024-04-25T10:26:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7f876b400640 1 -- 172.21.15.19:0/2043732981 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760017070 con 0x7f87740745c0 2024-04-25T10:26:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.419+0000 7f876b400640 1 -- 172.21.15.19:0/2043732981 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87600052d0 con 0x7f87740745c0 2024-04-25T10:26:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.419+0000 7f876b400640 1 -- 172.21.15.19:0/2043732981 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760011870 con 0x7f87740745c0 2024-04-25T10:26:16.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7fb2a9400640 1 -- 172.21.15.19:0/3182881977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0039b0 msgr2=0x7fb28c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7fb2a9400640 1 --2- 172.21.15.19:0/3182881977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0039b0 0x7fb28c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.417+0000 7fb2a9400640 1 -- 172.21.15.19:0/3182881977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a415d2a0 con 0x7fb28c004800 2024-04-25T10:26:16.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.419+0000 7f669f400640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66a015c4d0 0x7f66a015aed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f66a0074d70 tx=0x7f669000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.420+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87741e0bd0 con 0x7f87740745c0 2024-04-25T10:26:16.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.420+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87741e1460 con 0x7f87740745c0 2024-04-25T10:26:16.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.420+0000 7f6696a00640 1 -- 172.21.15.19:0/3385516265 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900052d0 con 0x7f66a015c4d0 2024-04-25T10:26:16.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.420+0000 7f669fe00640 1 -- 172.21.15.19:0/3385516265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a01fa6b0 con 0x7f66a015c4d0 2024-04-25T10:26:16.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.420+0000 7f669fe00640 1 -- 172.21.15.19:0/3385516265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a01fac70 con 0x7f66a015c4d0 2024-04-25T10:26:16.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.420+0000 7f6696a00640 1 -- 172.21.15.19:0/3385516265 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6690005470 con 0x7f66a015c4d0 2024-04-25T10:26:16.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.420+0000 7fb2a9400640 1 --2- 172.21.15.19:0/3182881977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb28c004800 0x7fb28c004c10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb2a408eaf0 tx=0x7fb28c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3cb577f069113eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.418+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/3147690600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b600cdb20 0x7f8b6015ff40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.418+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/3147690600 >> v2:172.21.15.19:3300/0 conn(0x7f8b60156770 0x7f8b600cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.418+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/3147690600 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 0x7f8b600b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.418+0000 7f8b5fe00640 1 -- 172.21.15.19:0/3147690600 >> 172.21.15.19:0/3147690600 conn(0x7f8b60068880 msgr2=0x7f8b60068c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.421+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0033070 con 0x7fb28c004800 2024-04-25T10:26:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.421+0000 7f8b5fe00640 1 -- 172.21.15.19:0/3147690600 shutdown_connections 2024-04-25T10:26:16.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.421+0000 7f8b5fe00640 1 -- 172.21.15.19:0/3147690600 wait complete. 2024-04-25T10:26:16.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.418+0000 7ff20ca00640 1 -- start start 2024-04-25T10:26:16.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.421+0000 7ff20ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1ec0037a0 0x7ff2080c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.421+0000 7ff20ca00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff20816d000 0x7ff208213660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.421+0000 7ff20ca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff208213ba0 0x7ff2081fa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.421+0000 7ff20ca00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff208074990 con 0x7ff20816d000 2024-04-25T10:26:16.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.421+0000 7ff207e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff208213ba0 0x7ff2081fa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.422+0000 7ff207e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff208213ba0 0x7ff2081fa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60628/0 (socket says 172.21.15.19:60628) 2024-04-25T10:26:16.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.422+0000 7ff207e00640 1 -- 172.21.15.19:0/3909293142 learned_addr learned my addr 172.21.15.19:0/3909293142 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.422+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff20816da80 con 0x7ff1ec0037a0 2024-04-25T10:26:16.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.422+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff2080743f0 con 0x7ff208213ba0 2024-04-25T10:26:16.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.421+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a002f630 con 0x7fb28c004800 2024-04-25T10:26:16.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.422+0000 7f6696a00640 1 -- 172.21.15.19:0/3385516265 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900052d0 con 0x7f66a015c4d0 2024-04-25T10:26:16.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.422+0000 7fb2a8a00640 1 -- 172.21.15.19:0/3182881977 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0009be0 con 0x7fb28c004800 2024-04-25T10:26:16.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.424+0000 7ff207400640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1ec0037a0 0x7ff2080c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.425+0000 7ff206a00640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff20816d000 0x7ff208213660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.425+0000 7f669fe00640 1 -- 172.21.15.19:0/3385516265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6678005290 con 0x7f66a015c4d0 2024-04-25T10:26:16.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.425+0000 7ff207e00640 1 -- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1ec0037a0 msgr2=0x7ff2080c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.426+0000 7ff207e00640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1ec0037a0 0x7ff2080c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.426+0000 7ff207e00640 1 -- 172.21.15.19:0/3909293142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff20816d000 msgr2=0x7ff208213660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.426+0000 7ff207e00640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff20816d000 0x7ff208213660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.421+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8774076520 con 0x7f87740745c0 2024-04-25T10:26:16.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.425+0000 7f876b400640 1 -- 172.21.15.19:0/2043732981 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f876001a070 con 0x7f87740745c0 2024-04-25T10:26:16.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.426+0000 7fb2ac800640 1 -- 172.21.15.19:0/3182881977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb28c004800 msgr2=0x7fb28c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.426+0000 7fb2ac800640 1 --2- 172.21.15.19:0/3182881977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb28c004800 0x7fb28c004c10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb2a408eaf0 tx=0x7fb28c005830 comp rx=0 tx=0).stop 2024-04-25T10:26:16.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.426+0000 7ff207e00640 1 -- 172.21.15.19:0/3909293142 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff208163de0 con 0x7ff208213ba0 2024-04-25T10:26:16.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.426+0000 7ff206a00640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff20816d000 0x7ff208213660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:16.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.426+0000 7fb2aa800640 1 -- 172.21.15.19:0/3182881977 reap_dead start 2024-04-25T10:26:16.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.426+0000 7fb2ac800640 1 -- 172.21.15.19:0/3182881977 shutdown_connections 2024-04-25T10:26:16.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.426+0000 7fb2ac800640 1 -- 172.21.15.19:0/3182881977 >> 172.21.15.19:0/3182881977 conn(0x7fb2a4068da0 msgr2=0x7fb2a40d17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.427+0000 7ff207e00640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff208213ba0 0x7ff2081fa980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff208074310 tx=0x7ff20000f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.427+0000 7fb2ac800640 1 -- 172.21.15.19:0/3182881977 shutdown_connections 2024-04-25T10:26:16.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.427+0000 7fb2ac800640 1 -- 172.21.15.19:0/3182881977 wait complete. 2024-04-25T10:26:16.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.427+0000 7f8b5fe00640 1 Processor -- start 2024-04-25T10:26:16.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.427+0000 7f876b400640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f87540745b0 0x7f8754076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.428+0000 7ff1ff400640 1 -- 172.21.15.19:0/3909293142 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200007b70 con 0x7ff208213ba0 2024-04-25T10:26:16.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.428+0000 7ff1ff400640 1 -- 172.21.15.19:0/3909293142 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20001a070 con 0x7ff208213ba0 2024-04-25T10:26:16.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.428+0000 7ff1ff400640 1 -- 172.21.15.19:0/3909293142 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200008680 con 0x7ff208213ba0 2024-04-25T10:26:16.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.427+0000 7f876b400640 1 -- 172.21.15.19:0/2043732981 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8760095000 con 0x7f87740745c0 2024-04-25T10:26:16.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.428+0000 7f876b400640 1 -- 172.21.15.19:0/2043732981 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f876005ede0 con 0x7f87740745c0 2024-04-25T10:26:16.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.428+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2081640c0 con 0x7ff208213ba0 2024-04-25T10:26:16.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.428+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff208164680 con 0x7ff208213ba0 2024-04-25T10:26:16.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.428+0000 7f8b5fe00640 1 -- start start 2024-04-25T10:26:16.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.429+0000 7f8772000640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f87540745b0 0x7f8754076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.430+0000 7f8772000640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f87540745b0 0x7f8754076ac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f87741559f0 tx=0x7f8764006b80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.430+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff208076520 con 0x7ff208213ba0 2024-04-25T10:26:16.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.432+0000 7ff1ff400640 1 -- 172.21.15.19:0/3909293142 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff200005d10 con 0x7ff208213ba0 2024-04-25T10:26:16.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.431+0000 7f6696a00640 1 -- 172.21.15.19:0/3385516265 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f66900035f0 con 0x7f66a015c4d0 2024-04-25T10:26:16.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.433+0000 7f6696a00640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66800746b0 0x7f6680076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.433+0000 7f6696a00640 1 -- 172.21.15.19:0/3385516265 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6690094410 con 0x7f66a015c4d0 2024-04-25T10:26:16.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.434+0000 7f669ea00640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66800746b0 0x7f6680076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.435+0000 7ff1ff400640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff1e8074580 0x7ff1e8076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.435+0000 7fb2ac800640 1 Processor -- start 2024-04-25T10:26:16.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.435+0000 7ff1ff400640 1 -- 172.21.15.19:0/3909293142 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff200095a00 con 0x7ff208213ba0 2024-04-25T10:26:16.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.436+0000 7ff207400640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff1e8074580 0x7ff1e8076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.435+0000 7fb2ac800640 1 -- start start 2024-04-25T10:26:16.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.436+0000 7f669ea00640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66800746b0 0x7f6680076bc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f668c036000 tx=0x7f668c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.437+0000 7f8b5fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 0x7f8b600ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.437+0000 7ff207400640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff1e8074580 0x7ff1e8076a90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8001eb0 tx=0x7ff1f8001e20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.437+0000 7f8b5ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 0x7f8b600ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.437+0000 7f8b5ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 0x7f8b600ad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60636/0 (socket says 172.21.15.19:60636) 2024-04-25T10:26:16.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.437+0000 7f8b5ea00640 1 -- 172.21.15.19:0/869307715 learned_addr learned my addr 172.21.15.19:0/869307715 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.438+0000 7ff1ff400640 1 -- 172.21.15.19:0/3909293142 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff200024020 con 0x7ff208213ba0 2024-04-25T10:26:16.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.439+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b600cdb20 0x7f8b60158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.439+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b60156770 0x7f8b60155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.439+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6015d010 con 0x7f8b600cdb20 2024-04-25T10:26:16.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.440+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6015cd30 con 0x7f8b60156770 2024-04-25T10:26:16.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.440+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6015fa20 con 0x7f8b600ccfb0 2024-04-25T10:26:16.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.441+0000 7fb2ac800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c004800 0x7fb2a41f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.441+0000 7fb2ac800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2a4155bd0 0x7fb2a41f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.441+0000 7fb2a9e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c004800 0x7fb2a41f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.442+0000 7fb2a9e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c004800 0x7fb2a41f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52750/0 (socket says 172.21.15.19:52750) 2024-04-25T10:26:16.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.442+0000 7fb2a9e00640 1 -- 172.21.15.19:0/74805286 learned_addr learned my addr 172.21.15.19:0/74805286 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.442+0000 7fb2a9400640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2a4155bd0 0x7fb2a41f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.442+0000 7fb2ac800640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a41e7bc0 0x7fb2a4158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.443+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a4156aa0 con 0x7fb28c004800 2024-04-25T10:26:16.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.443+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a40b4910 con 0x7fb2a41e7bc0 2024-04-25T10:26:16.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.443+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a4156c20 con 0x7fb2a4155bd0 2024-04-25T10:26:16.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.444+0000 7fb2a9400640 1 -- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a41e7bc0 msgr2=0x7fb2a4158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.444+0000 7fb2aa800640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a41e7bc0 0x7fb2a4158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.445+0000 7fb2a9400640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a41e7bc0 0x7fb2a4158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.445+0000 7fb2a9400640 1 -- 172.21.15.19:0/74805286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c004800 msgr2=0x7fb2a41f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.445+0000 7fb2a9400640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c004800 0x7fb2a41f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.445+0000 7fb2a9400640 1 -- 172.21.15.19:0/74805286 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a4158670 con 0x7fb2a4155bd0 2024-04-25T10:26:16.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.445+0000 7fb2aa800640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a41e7bc0 0x7fb2a4158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:16.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.446+0000 7fb2a9400640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2a4155bd0 0x7fb2a41f30e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0032000 tx=0x7fb2a0004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.445+0000 7f6696a00640 1 -- 172.21.15.19:0/3385516265 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f669005e180 con 0x7f66a015c4d0 2024-04-25T10:26:16.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.446+0000 7fb29e000640 1 -- 172.21.15.19:0/74805286 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0033040 con 0x7fb2a4155bd0 2024-04-25T10:26:16.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.446+0000 7fb29e000640 1 -- 172.21.15.19:0/74805286 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a002f430 con 0x7fb2a4155bd0 2024-04-25T10:26:16.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.446+0000 7fb29e000640 1 -- 172.21.15.19:0/74805286 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0009be0 con 0x7fb2a4155bd0 2024-04-25T10:26:16.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.446+0000 7f8b5e000640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b600cdb20 0x7f8b60158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.446+0000 7f8b5f400640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b60156770 0x7f8b60155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.447+0000 7f8b5ea00640 1 -- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b60156770 msgr2=0x7f8b60155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.447+0000 7f8b5ea00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b60156770 0x7f8b60155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.447+0000 7f8b5ea00640 1 -- 172.21.15.19:0/869307715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b600cdb20 msgr2=0x7f8b60158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.447+0000 7f8b5ea00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b600cdb20 0x7f8b60158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.448+0000 7f8b5ea00640 1 -- 172.21.15.19:0/869307715 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b60159520 con 0x7f8b600ccfb0 2024-04-25T10:26:16.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.446+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a41f3620 con 0x7fb2a4155bd0 2024-04-25T10:26:16.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.446+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a41f65d0 con 0x7fb2a4155bd0 2024-04-25T10:26:16.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.448+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb280005290 con 0x7fb2a4155bd0 2024-04-25T10:26:16.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.448+0000 7f8b5ea00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 0x7f8b600ad110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b5001f580 tx=0x7f8b5001fa40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.449+0000 7f8b56a00640 1 -- 172.21.15.19:0/869307715 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50028070 con 0x7f8b600ccfb0 2024-04-25T10:26:16.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.449+0000 7f8b56a00640 1 -- 172.21.15.19:0/869307715 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b50024890 con 0x7f8b600ccfb0 2024-04-25T10:26:16.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.449+0000 7f8b56a00640 1 -- 172.21.15.19:0/869307715 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50024c80 con 0x7f8b600ccfb0 2024-04-25T10:26:16.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.449+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b60159730 con 0x7f8b600ccfb0 2024-04-25T10:26:16.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.450+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b60158220 con 0x7f8b600ccfb0 2024-04-25T10:26:16.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.452+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b60076520 con 0x7f8b600ccfb0 2024-04-25T10:26:16.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.455+0000 7f0c23200640 1 Processor -- start 2024-04-25T10:26:16.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.455+0000 7f0c23200640 1 -- start start 2024-04-25T10:26:16.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.455+0000 7fb29e000640 1 -- 172.21.15.19:0/74805286 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb2a0005d10 con 0x7fb2a4155bd0 2024-04-25T10:26:16.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.457+0000 7fb29e000640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2880744e0 0x7fb2880769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.458+0000 7fb29e000640 1 -- 172.21.15.19:0/74805286 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb2a00b60b0 con 0x7fb2a4155bd0 2024-04-25T10:26:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.458+0000 7f0c23200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c2406fd20 0x7f0c240c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.459+0000 7f0c23200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2415af60 con 0x7f0c240c77a0 2024-04-25T10:26:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.459+0000 7f0c23200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c240c61c0 con 0x7f0c2406ef40 2024-04-25T10:26:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.459+0000 7f0c23200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f0c240c64a0 con 0x7f0c2406fd20 2024-04-25T10:26:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.458+0000 7fb29e000640 1 -- 172.21.15.19:0/74805286 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2a00b6570 con 0x7fb2a4155bd0 2024-04-25T10:26:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.459+0000 7fb2a9e00640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2880744e0 0x7fb2880769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.460+0000 7f8b56a00640 1 -- 172.21.15.19:0/869307715 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8b5002b070 con 0x7f8b600ccfb0 2024-04-25T10:26:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.461+0000 7fb2a9e00640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2880744e0 0x7fb2880769f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb294009b30 tx=0x7fb2940094a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.462+0000 7f0c22800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0c2406ef40 0x7f0c2406f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:40868/0 (socket says 172.21.15.19:40868) 2024-04-25T10:26:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.462+0000 7f0c22800640 1 -- 172.21.15.19:0/2792046736 learned_addr learned my addr 172.21.15.19:0/2792046736 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.462+0000 7f8b56a00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8b40074580 0x7f8b40076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154463598 0 0) 0x7f0c240c61c0 con 0x7f0c2406ef40 2024-04-25T10:26:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c08003520 con 0x7f0c2406ef40 2024-04-25T10:26:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 <== mon.1 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3015477017 0 0) 0x7f0c08003520 con 0x7f0c2406ef40 2024-04-25T10:26:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 >> v2:172.21.15.19:3300/0 conn(0x7f0c2406fd20 msgr2=0x7f0c240c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 --2- 172.21.15.19:0/2792046736 >> v2:172.21.15.19:3300/0 conn(0x7f0c2406fd20 0x7f0c240c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 >> v1:172.21.15.19:6789/0 conn(0x7f0c240c77a0 legacy=0x7f0c24153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240c6780 con 0x7f0c2406ef40 2024-04-25T10:26:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 <== mon.1 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2140478945 0 0) 0x7f0c1c0019d0 con 0x7f0c2406ef40 2024-04-25T10:26:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 >> v1:172.21.15.112:6789/0 conn(0x7f0c2406ef40 legacy=0x7f0c2406f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c080039d0 0x7f0c08003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c08004800 0x7f0c08004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c080053c0 0x7f0c0800ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.463+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0c240c64a0 con 0x7f0c080053c0 2024-04-25T10:26:16.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.464+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0800c340 con 0x7f0c08004800 2024-04-25T10:26:16.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.464+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0c0800c540 con 0x7f0c080039d0 2024-04-25T10:26:16.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.464+0000 7f0c21400640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c08004800 0x7f0c08004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.464+0000 7f0c21e00640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c080039d0 0x7f0c08003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.465+0000 7f8b56a00640 1 -- 172.21.15.19:0/869307715 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8b500a6910 con 0x7f8b600ccfb0 2024-04-25T10:26:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.465+0000 7f8b5e000640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8b40074580 0x7f8b40076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.465+0000 7f0c21e00640 1 -- 172.21.15.19:0/2792046736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c08004800 msgr2=0x7f0c08004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.465+0000 7f0c21e00640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c08004800 0x7f0c08004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.465+0000 7f0c21e00640 1 -- 172.21.15.19:0/2792046736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c080053c0 msgr2=0x7f0c0800ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.465+0000 7f0c22800640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c080053c0 0x7f0c0800ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.465+0000 7f0c21e00640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c080053c0 0x7f0c0800ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.465+0000 7f0c21e00640 1 -- 172.21.15.19:0/2792046736 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240c6780 con 0x7f0c080039d0 2024-04-25T10:26:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.466+0000 7f8b56a00640 1 -- 172.21.15.19:0/869307715 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8b500d4c20 con 0x7f8b600ccfb0 2024-04-25T10:26:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.466+0000 7f0c22800640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c080053c0 0x7f0c0800ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.466+0000 7f0c22800640 1 -- 172.21.15.19:0/2792046736 reap_dead start 2024-04-25T10:26:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.467+0000 7f0c21e00640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c080039d0 0x7f0c08003e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400fa10 tx=0x7f0c08005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d8fae85b1d7751f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.471+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400f610 con 0x7f0c080039d0 2024-04-25T10:26:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.471+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1400f310 con 0x7f0c080039d0 2024-04-25T10:26:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.472+0000 7f0c23200640 1 -- 172.21.15.19:0/2792046736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c080039d0 msgr2=0x7f0c08003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.472+0000 7f0c20a00640 1 -- 172.21.15.19:0/2792046736 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400f610 con 0x7f0c080039d0 2024-04-25T10:26:16.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.472+0000 7f0c23200640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c080039d0 0x7f0c08003e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400fa10 tx=0x7f0c08005830 comp rx=0 tx=0).stop 2024-04-25T10:26:16.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.475+0000 7f0c23200640 1 -- 172.21.15.19:0/2792046736 shutdown_connections 2024-04-25T10:26:16.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.475+0000 7f0c23200640 1 --2- 172.21.15.19:0/2792046736 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c080039d0 0x7f0c08003e60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.477+0000 7f8b5e000640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8b40074580 0x7f8b40076a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b6015a850 tx=0x7f8b4c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.475+0000 7f0c23200640 1 -- 172.21.15.19:0/2792046736 >> 172.21.15.19:0/2792046736 conn(0x7f0c240ca120 msgr2=0x7f0c240ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.475+0000 7f0c23200640 1 -- 172.21.15.19:0/2792046736 shutdown_connections 2024-04-25T10:26:16.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.475+0000 7f0c23200640 1 -- 172.21.15.19:0/2792046736 wait complete. 2024-04-25T10:26:16.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.478+0000 7fd3c4e00640 1 Processor -- start 2024-04-25T10:26:16.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.478+0000 7fd3c4e00640 1 -- start start 2024-04-25T10:26:16.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.482+0000 7fd3c4e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd3c01537b0 0x7fd3c00ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.482+0000 7fd3c4e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c00c5bf0 con 0x7fd3c00b3c40 2024-04-25T10:26:16.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.483+0000 7fd3c4e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c00cbf40 con 0x7fd3c00cee90 2024-04-25T10:26:16.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.483+0000 7fd3c4e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c015d310 con 0x7fd3c01537b0 2024-04-25T10:26:16.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.483+0000 7fd3be800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd3c00cee90 0x7fd3c0163de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:40884/0 (socket says 172.21.15.19:40884) 2024-04-25T10:26:16.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.483+0000 7fd3be800640 1 -- 172.21.15.19:0/964943097 learned_addr learned my addr 172.21.15.19:0/964943097 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:16.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.483+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571172978 0 0) 0x7fd3c00cbf40 con 0x7fd3c00cee90 2024-04-25T10:26:16.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.483+0000 7fd3bd400640 1 --2- 172.21.15.19:0/964943097 >> v2:172.21.15.112:3300/0 conn(0x7fd3c01537b0 0x7fd3c00ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7f0c23200640 1 Processor -- start 2024-04-25T10:26:16.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.484+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3a4003520 con 0x7fd3c00cee90 2024-04-25T10:26:16.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.484+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339890191 0 0) 0x7fd3c00c5bf0 con 0x7fd3c00b3c40 2024-04-25T10:26:16.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.484+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3c00cbf40 con 0x7fd3c00b3c40 2024-04-25T10:26:16.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 <== mon.1 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4108514224 0 0) 0x7fd3a4003520 con 0x7fd3c00cee90 2024-04-25T10:26:16.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 >> v2:172.21.15.112:3300/0 conn(0x7fd3c01537b0 msgr2=0x7fd3c00ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 --2- 172.21.15.19:0/964943097 >> v2:172.21.15.112:3300/0 conn(0x7fd3c01537b0 0x7fd3c00ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 >> v1:172.21.15.19:6789/0 conn(0x7fd3c00b3c40 legacy=0x7fd3c0159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c00cc220 con 0x7fd3c00cee90 2024-04-25T10:26:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 <== mon.1 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2140478945 0 0) 0x7fd3ac001670 con 0x7fd3c00cee90 2024-04-25T10:26:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 >> v1:172.21.15.112:6789/0 conn(0x7fd3c00cee90 legacy=0x7fd3c0163de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 --2- 172.21.15.19:0/964943097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a4003b40 0x7fd3a4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 --2- 172.21.15.19:0/964943097 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3a4004800 0x7fd3a4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 --2- 172.21.15.19:0/964943097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a4005270 0x7fd3a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c015d310 con 0x7fd3a4005270 2024-04-25T10:26:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a400c0f0 con 0x7fd3a4003b40 2024-04-25T10:26:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.485+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a400c2f0 con 0x7fd3a4004800 2024-04-25T10:26:16.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.486+0000 7fd3bd400640 1 --2- 172.21.15.19:0/964943097 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3a4004800 0x7fd3a4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.486+0000 7fd3bde00640 1 --2- 172.21.15.19:0/964943097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a4003b40 0x7fd3a4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.487+0000 7fd3be800640 1 --2- 172.21.15.19:0/964943097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a4005270 0x7fd3a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.487+0000 7fd3bd400640 1 -- 172.21.15.19:0/964943097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a4003b40 msgr2=0x7fd3a4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.487+0000 7fd3bd400640 1 --2- 172.21.15.19:0/964943097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a4003b40 0x7fd3a4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.487+0000 7fd3bd400640 1 -- 172.21.15.19:0/964943097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a4005270 msgr2=0x7fd3a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.488+0000 7fd3bd400640 1 --2- 172.21.15.19:0/964943097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3a4005270 0x7fd3a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.488+0000 7fd3bd400640 1 -- 172.21.15.19:0/964943097 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c00cc220 con 0x7fd3a4004800 2024-04-25T10:26:16.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.488+0000 7fd3be800640 1 -- 172.21.15.19:0/964943097 reap_dead start 2024-04-25T10:26:16.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.486+0000 7f0c23200640 1 -- start start 2024-04-25T10:26:16.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.488+0000 7f0c23200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c080039d0 0x7f0c240c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.488+0000 7f0c23200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c24150c60 0x7f0c241451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.488+0000 7f0c23200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c24073820 0x7f0c24073c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.488+0000 7f0c23200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0c24073190 con 0x7f0c080039d0 2024-04-25T10:26:16.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.488+0000 7f0c23200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0c24073010 con 0x7f0c24150c60 2024-04-25T10:26:16.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.488+0000 7f0c23200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2415ab40 con 0x7f0c24073820 2024-04-25T10:26:16.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.489+0000 7f0c21400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c24150c60 0x7f0c241451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.489+0000 7f0c21400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c24150c60 0x7f0c241451e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39882/0 (socket says 172.21.15.19:39882) 2024-04-25T10:26:16.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.489+0000 7f0c21400640 1 -- 172.21.15.19:0/439785420 learned_addr learned my addr 172.21.15.19:0/439785420 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.489+0000 7f0c22800640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c24073820 0x7f0c24073c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.490+0000 7f0c21400640 1 -- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c24073820 msgr2=0x7f0c24073c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.490+0000 7f0c21400640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c24073820 0x7f0c24073c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.490+0000 7fd3bd400640 1 --2- 172.21.15.19:0/964943097 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3a4004800 0x7fd3a4004c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000ba30 tx=0x7fd3a4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f21e1a1b6412e5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.491+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0030070 con 0x7fd3a4004800 2024-04-25T10:26:16.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.491+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b002ade0 con 0x7fd3a4004800 2024-04-25T10:26:16.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.491+0000 7fd3bca00640 1 -- 172.21.15.19:0/964943097 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000b600 con 0x7fd3a4004800 2024-04-25T10:26:16.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.492+0000 7fd3c4e00640 1 -- 172.21.15.19:0/964943097 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3a4004800 msgr2=0x7fd3a4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.492+0000 7fd3c4e00640 1 --2- 172.21.15.19:0/964943097 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3a4004800 0x7fd3a4004c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000ba30 tx=0x7fd3a4005830 comp rx=0 tx=0).stop 2024-04-25T10:26:16.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.492+0000 7fd3c4e00640 1 -- 172.21.15.19:0/964943097 shutdown_connections 2024-04-25T10:26:16.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.492+0000 7fd3c4e00640 1 --2- 172.21.15.19:0/964943097 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3a4004800 0x7fd3a4004c10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.492+0000 7fd3c4e00640 1 -- 172.21.15.19:0/964943097 >> 172.21.15.19:0/964943097 conn(0x7fd3c0074640 msgr2=0x7fd3c0070070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.492+0000 7fd3c4e00640 1 -- 172.21.15.19:0/964943097 shutdown_connections 2024-04-25T10:26:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.490+0000 7f0c21400640 1 -- 172.21.15.19:0/439785420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c080039d0 msgr2=0x7f0c240c9bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:26:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.492+0000 7f0c21e00640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c080039d0 0x7f0c240c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.493+0000 7f0c21400640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c080039d0 0x7f0c240c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.493+0000 7f0c21400640 1 -- 172.21.15.19:0/439785420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240c86b0 con 0x7f0c24150c60 2024-04-25T10:26:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.493+0000 7f0c22800640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c24073820 0x7f0c24073c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.493+0000 7f0c21e00640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c080039d0 0x7f0c240c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:16.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.494+0000 7f0c21400640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c24150c60 0x7f0c241451e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000f610 tx=0x7f0c1000fad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.494+0000 7f0c1a000640 1 -- 172.21.15.19:0/439785420 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c100052e0 con 0x7f0c24150c60 2024-04-25T10:26:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.495+0000 7f0c1a000640 1 -- 172.21.15.19:0/439785420 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c10018070 con 0x7f0c24150c60 2024-04-25T10:26:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.495+0000 7f0c1a000640 1 -- 172.21.15.19:0/439785420 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c10003830 con 0x7f0c24150c60 2024-04-25T10:26:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.495+0000 7f0c23200640 1 -- 172.21.15.19:0/439785420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c24148c60 con 0x7f0c24150c60 2024-04-25T10:26:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.495+0000 7f0c23200640 1 -- 172.21.15.19:0/439785420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2414f2b0 con 0x7f0c24150c60 2024-04-25T10:26:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.493+0000 7fd3c4e00640 1 -- 172.21.15.19:0/964943097 wait complete. 2024-04-25T10:26:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.497+0000 7fd3c4e00640 1 Processor -- start 2024-04-25T10:26:16.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.497+0000 7fd3c4e00640 1 -- start start 2024-04-25T10:26:16.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.499+0000 7f0c23200640 1 -- 172.21.15.19:0/439785420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c24076520 con 0x7f0c24150c60 2024-04-25T10:26:16.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.500+0000 7fd3c4e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a4004800 0x7fd3c00c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.500+0000 7fd3c4e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c014b4e0 0x7fd3c014c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.500+0000 7fd3c4e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3c014cd60 0x7fd3c014f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.501+0000 7fd3c4e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c00cbbe0 con 0x7fd3c014b4e0 2024-04-25T10:26:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.501+0000 7fd3c4e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c015cfa0 con 0x7fd3a4004800 2024-04-25T10:26:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.501+0000 7fd3c4e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c0153bc0 con 0x7fd3c014cd60 2024-04-25T10:26:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.501+0000 7fd3be800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3c014cd60 0x7fd3c014f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.502+0000 7fd3be800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3c014cd60 0x7fd3c014f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60672/0 (socket says 172.21.15.19:60672) 2024-04-25T10:26:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.502+0000 7fd3be800640 1 -- 172.21.15.19:0/2951669828 learned_addr learned my addr 172.21.15.19:0/2951669828 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.502+0000 7fd3bde00640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a4004800 0x7fd3c00c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.503+0000 7fd3be800640 1 -- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a4004800 msgr2=0x7fd3c00c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.503+0000 7fd3be800640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a4004800 0x7fd3c00c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.503+0000 7fd3be800640 1 -- 172.21.15.19:0/2951669828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c014b4e0 msgr2=0x7fd3c014c820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:26:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.503+0000 7fd3be800640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c014b4e0 0x7fd3c014c820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.503+0000 7fd3be800640 1 -- 172.21.15.19:0/2951669828 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c00c8870 con 0x7fd3c014cd60 2024-04-25T10:26:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.503+0000 7fd3bde00640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a4004800 0x7fd3c00c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.503+0000 7fd3be800640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3c014cd60 0x7fd3c014f0b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00739f0 tx=0x7fd3ac007720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.505+0000 7f0c1a000640 1 -- 172.21.15.19:0/439785420 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0c100039d0 con 0x7f0c24150c60 2024-04-25T10:26:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.505+0000 7fd3b6000640 1 -- 172.21.15.19:0/2951669828 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac01a070 con 0x7fd3c014cd60 2024-04-25T10:26:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.505+0000 7fd3c4e00640 1 -- 172.21.15.19:0/2951669828 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c01f56e0 con 0x7fd3c014cd60 2024-04-25T10:26:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.505+0000 7fd3c4e00640 1 -- 172.21.15.19:0/2951669828 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c01f5ca0 con 0x7fd3c014cd60 2024-04-25T10:26:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.507+0000 7fd3b6000640 1 -- 172.21.15.19:0/2951669828 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00f9d0 con 0x7fd3c014cd60 2024-04-25T10:26:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.507+0000 7fd3c4e00640 1 -- 172.21.15.19:0/2951669828 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c01f5450 con 0x7fd3c014cd60 2024-04-25T10:26:16.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.507+0000 7fd3b6000640 1 -- 172.21.15.19:0/2951669828 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac01a070 con 0x7fd3c014cd60 2024-04-25T10:26:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.509+0000 7f0c1a000640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0c04074500 0x7f0c04076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.510+0000 7f0c1a000640 1 -- 172.21.15.19:0/439785420 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0c10095cf0 con 0x7f0c24150c60 2024-04-25T10:26:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.510+0000 7f0c1a000640 1 -- 172.21.15.19:0/439785420 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c10096220 con 0x7f0c24150c60 2024-04-25T10:26:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.510+0000 7f0c21e00640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0c04074500 0x7f0c04076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.512+0000 7fd3b6000640 1 -- 172.21.15.19:0/2951669828 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd3ac01d070 con 0x7fd3c014cd60 2024-04-25T10:26:16.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.513+0000 7f0c21e00640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0c04074500 0x7f0c04076a10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c1403a000 tx=0x7f0c1403c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.514+0000 7fd3b6000640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3a0074680 0x7fd3a0076b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.514+0000 7fd3b6000640 1 -- 172.21.15.19:0/2951669828 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd3ac094d70 con 0x7fd3c014cd60 2024-04-25T10:26:16.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.515+0000 7fd3b6000640 1 -- 172.21.15.19:0/2951669828 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd3c00c8870 con 0x7fd3c014cd60 2024-04-25T10:26:16.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.515+0000 7fd3bde00640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3a0074680 0x7fd3a0076b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.516+0000 7fd3bde00640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3a0074680 0x7fd3a0076b90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8000f80 tx=0x7fd3b8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.694+0000 7f3857200640 1 Processor -- start 2024-04-25T10:26:16.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.694+0000 7f3857200640 1 -- start start 2024-04-25T10:26:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.711+0000 7f3857200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38580c2640 0x7f385815d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.711+0000 7f3857200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38581569f0 0x7f38580cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.711+0000 7f3857200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38580c4010 con 0x7f38580cd820 2024-04-25T10:26:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.711+0000 7f3857200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f38580c7870 con 0x7f38580c2640 2024-04-25T10:26:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.711+0000 7f3857200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f38580c4560 con 0x7f38581569f0 2024-04-25T10:26:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.711+0000 7f3856800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f38580cd820 0x7f38580735c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47172/0 (socket says 172.21.15.19:47172) 2024-04-25T10:26:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.711+0000 7f3855400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38581569f0 0x7f38580cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.711+0000 7f3856800640 1 -- 172.21.15.19:0/3138385260 learned_addr learned my addr 172.21.15.19:0/3138385260 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:16.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.713+0000 7f3855400640 1 -- 172.21.15.19:0/3138385260 >> v2:172.21.15.19:3300/0 conn(0x7f38580c2640 msgr2=0x7f385815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:16.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.713+0000 7f3855400640 1 --2- 172.21.15.19:0/3138385260 >> v2:172.21.15.19:3300/0 conn(0x7f38580c2640 0x7f385815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.713+0000 7f3855400640 1 -- 172.21.15.19:0/3138385260 >> v1:172.21.15.19:6789/0 conn(0x7f38580cd820 legacy=0x7f38580735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.713+0000 7f3855400640 1 -- 172.21.15.19:0/3138385260 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38580c4280 con 0x7f38581569f0 2024-04-25T10:26:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.722+0000 7f3855400640 1 --2- 172.21.15.19:0/3138385260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38581569f0 0x7f38580cd2e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f38580c9e70 tx=0x7f384802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b31ebd03019df0ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.724+0000 7f3854a00640 1 -- 172.21.15.19:0/3138385260 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848037070 con 0x7f38581569f0 2024-04-25T10:26:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.724+0000 7f3854a00640 1 -- 172.21.15.19:0/3138385260 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3848032440 con 0x7f38581569f0 2024-04-25T10:26:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.724+0000 7f3854a00640 1 -- 172.21.15.19:0/3138385260 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848032850 con 0x7f38581569f0 2024-04-25T10:26:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.725+0000 7f3857200640 1 -- 172.21.15.19:0/3138385260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38581569f0 msgr2=0x7f38580cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.725+0000 7f3857200640 1 --2- 172.21.15.19:0/3138385260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38581569f0 0x7f38580cd2e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f38580c9e70 tx=0x7f384802a1c0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.735+0000 7f3857200640 1 -- 172.21.15.19:0/3138385260 shutdown_connections 2024-04-25T10:26:16.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.735+0000 7f3857200640 1 --2- 172.21.15.19:0/3138385260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38581569f0 0x7f38580cd2e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.735+0000 7f3857200640 1 --2- 172.21.15.19:0/3138385260 >> v2:172.21.15.19:3300/0 conn(0x7f38580c2640 0x7f385815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.735+0000 7f3857200640 1 -- 172.21.15.19:0/3138385260 >> 172.21.15.19:0/3138385260 conn(0x7f3858070d10 msgr2=0x7f3858071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.735+0000 7f3857200640 1 -- 172.21.15.19:0/3138385260 shutdown_connections 2024-04-25T10:26:16.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.735+0000 7f3857200640 1 -- 172.21.15.19:0/3138385260 wait complete. 2024-04-25T10:26:16.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.756+0000 7f3857200640 1 Processor -- start 2024-04-25T10:26:16.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.756+0000 7f3857200640 1 -- start start 2024-04-25T10:26:16.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.760+0000 7f3857200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38580c2640 0x7f38581f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.760+0000 7f3857200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38580cd820 0x7f38580cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.760+0000 7f3857200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38581569f0 0x7f38581506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.760+0000 7f3857200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3858074ab0 con 0x7f38580cd820 2024-04-25T10:26:16.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.760+0000 7f3857200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38580c7590 con 0x7f38581569f0 2024-04-25T10:26:16.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.760+0000 7f3857200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3858073cd0 con 0x7f38580c2640 2024-04-25T10:26:16.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.763+0000 7f3855400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38580cd820 0x7f38580cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.763+0000 7f3855400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38580cd820 0x7f38580cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52798/0 (socket says 172.21.15.19:52798) 2024-04-25T10:26:16.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.763+0000 7f3855400640 1 -- 172.21.15.19:0/2240324707 learned_addr learned my addr 172.21.15.19:0/2240324707 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:16.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.766+0000 7f3855400640 1 -- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38580c2640 msgr2=0x7f38581f7e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T10:26:16.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.766+0000 7f3855400640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38580c2640 0x7f38581f7e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.766+0000 7f3855400640 1 -- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38581569f0 msgr2=0x7f38581506b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:26:16.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.766+0000 7f3855400640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38581569f0 0x7f38581506b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.766+0000 7f3855400640 1 -- 172.21.15.19:0/2240324707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38581f83b0 con 0x7f38580cd820 2024-04-25T10:26:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.770+0000 7f3855400640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38580cd820 0x7f38580cb3e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3848009860 tx=0x7f38480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.778+0000 7f384e000640 1 -- 172.21.15.19:0/2240324707 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848042020 con 0x7f38580cd820 2024-04-25T10:26:16.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.778+0000 7f384e000640 1 -- 172.21.15.19:0/2240324707 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3848030c20 con 0x7f38580cd820 2024-04-25T10:26:16.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.778+0000 7f384e000640 1 -- 172.21.15.19:0/2240324707 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848037040 con 0x7f38580cd820 2024-04-25T10:26:16.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.782+0000 7f3857200640 1 -- 172.21.15.19:0/2240324707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385815ff20 con 0x7f38580cd820 2024-04-25T10:26:16.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.782+0000 7f3857200640 1 -- 172.21.15.19:0/2240324707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38581f6b10 con 0x7f38580cd820 2024-04-25T10:26:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.794+0000 7f3857200640 1 -- 172.21.15.19:0/2240324707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3830005290 con 0x7f38580cd820 2024-04-25T10:26:16.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.805+0000 7f384e000640 1 -- 172.21.15.19:0/2240324707 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3848045020 con 0x7f38580cd820 2024-04-25T10:26:16.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.807+0000 7f384e000640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3838074500 0x7f3838076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:16.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.807+0000 7f384e000640 1 -- 172.21.15.19:0/2240324707 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f38480b6460 con 0x7f38580cd820 2024-04-25T10:26:16.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.811+0000 7f3855e00640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3838074500 0x7f3838076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:16.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.815+0000 7f3855e00640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3838074500 0x7f3838076a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f385000ab90 tx=0x7f3850009250 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:16.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.832+0000 7f384e000640 1 -- 172.21.15.19:0/2240324707 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f38480809a0 con 0x7f38580cd820 2024-04-25T10:26:16.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.863+0000 7f669fe00640 1 -- 172.21.15.19:0/3385516265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6678005580 con 0x7f66a015c4d0 2024-04-25T10:26:16.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.864+0000 7f6696a00640 1 -- 172.21.15.19:0/3385516265 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6690062480 con 0x7f66a015c4d0 2024-04-25T10:26:16.867 INFO:teuthology.orchestra.run.smithi019.stdout:55834574861 2024-04-25T10:26:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.867+0000 7f669fe00640 1 -- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66800746b0 msgr2=0x7f6680076bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.867+0000 7f669fe00640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66800746b0 0x7f6680076bc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f668c036000 tx=0x7f668c030000 comp rx=0 tx=0).stop 2024-04-25T10:26:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.867+0000 7f669fe00640 1 -- 172.21.15.19:0/3385516265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66a015c4d0 msgr2=0x7f66a015aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.867+0000 7f669fe00640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66a015c4d0 0x7f66a015aed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f66a0074d70 tx=0x7f669000c820 comp rx=0 tx=0).stop 2024-04-25T10:26:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.868+0000 7f669fe00640 1 -- 172.21.15.19:0/3385516265 shutdown_connections 2024-04-25T10:26:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.868+0000 7f669fe00640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66a015c4d0 0x7f66a015aed0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.868+0000 7f669fe00640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66a0152690 0x7f66a0146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.868+0000 7f669fe00640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66800746b0 0x7f6680076bc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.868+0000 7f669fe00640 1 --2- 172.21.15.19:0/3385516265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66a00c8850 0x7f66a01f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.868+0000 7f669fe00640 1 -- 172.21.15.19:0/3385516265 >> 172.21.15.19:0/3385516265 conn(0x7f66a006d120 msgr2=0x7f66a00ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.871+0000 7f669fe00640 1 -- 172.21.15.19:0/3385516265 shutdown_connections 2024-04-25T10:26:16.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.871+0000 7f669fe00640 1 -- 172.21.15.19:0/3385516265 wait complete. 2024-04-25T10:26:16.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.906+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8774155f80 con 0x7f87740745c0 2024-04-25T10:26:16.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.906+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff208074770 con 0x7ff208213ba0 2024-04-25T10:26:16.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.906+0000 7f876b400640 1 -- 172.21.15.19:0/2043732981 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f87600630e0 con 0x7f87740745c0 2024-04-25T10:26:16.909 INFO:teuthology.orchestra.run.smithi019.stdout:55834574861 2024-04-25T10:26:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.911+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f87540745b0 msgr2=0x7f8754076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.911+0000 7f8779e00640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f87540745b0 0x7f8754076ac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f87741559f0 tx=0x7f8764006b80 comp rx=0 tx=0).stop 2024-04-25T10:26:16.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.911+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87740745c0 msgr2=0x7f87741ee750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.911+0000 7f8779e00640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87740745c0 0x7f87741ee750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f876000c390 tx=0x7f876000c850 comp rx=0 tx=0).stop 2024-04-25T10:26:16.917 INFO:teuthology.orchestra.run.smithi019.stdout:55834574861 2024-04-25T10:26:16.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.910+0000 7ff1ff400640 1 -- 172.21.15.19:0/3909293142 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff20005fe30 con 0x7ff208213ba0 2024-04-25T10:26:16.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.914+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 shutdown_connections 2024-04-25T10:26:16.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.914+0000 7f8779e00640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87740cd910 0x7f8774151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.914+0000 7f8779e00640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f87540745b0 0x7f8754076ac0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.914+0000 7f8779e00640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87740c3800 0x7f87741e2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.914+0000 7f8779e00640 1 --2- 172.21.15.19:0/2043732981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87740745c0 0x7f87741ee750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.914+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 >> 172.21.15.19:0/2043732981 conn(0x7f877406f560 msgr2=0x7f87740cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.915+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 shutdown_connections 2024-04-25T10:26:16.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.915+0000 7f8779e00640 1 -- 172.21.15.19:0/2043732981 wait complete. 2024-04-25T10:26:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.916+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff1e8074580 msgr2=0x7ff1e8076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.916+0000 7ff20ca00640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff1e8074580 0x7ff1e8076a90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8001eb0 tx=0x7ff1f8001e20 comp rx=0 tx=0).stop 2024-04-25T10:26:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.916+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff208213ba0 msgr2=0x7ff2081fa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.916+0000 7ff20ca00640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff208213ba0 0x7ff2081fa980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff208074310 tx=0x7ff20000f6a0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.916+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 shutdown_connections 2024-04-25T10:26:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.916+0000 7ff20ca00640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff1e8074580 0x7ff1e8076a90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.916+0000 7ff20ca00640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff208213ba0 0x7ff2081fa980 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.916+0000 7ff20ca00640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff20816d000 0x7ff208213660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.916+0000 7ff20ca00640 1 --2- 172.21.15.19:0/3909293142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1ec0037a0 0x7ff2080c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.916+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 >> 172.21.15.19:0/3909293142 conn(0x7ff2080ca120 msgr2=0x7ff2080ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.918+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 shutdown_connections 2024-04-25T10:26:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.918+0000 7ff20ca00640 1 -- 172.21.15.19:0/3909293142 wait complete. 2024-04-25T10:26:16.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.931+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb280005850 con 0x7fb2a4155bd0 2024-04-25T10:26:16.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.932+0000 7fb29e000640 1 -- 172.21.15.19:0/74805286 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb2a00804e0 con 0x7fb2a4155bd0 2024-04-25T10:26:16.935 INFO:teuthology.orchestra.run.smithi019.stdout:55834574861 2024-04-25T10:26:16.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.937+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2880744e0 msgr2=0x7fb2880769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.937+0000 7fb2ac800640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2880744e0 0x7fb2880769f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb294009b30 tx=0x7fb2940094a0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.937+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2a4155bd0 msgr2=0x7fb2a41f30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.937+0000 7fb2ac800640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2a4155bd0 0x7fb2a41f30e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0032000 tx=0x7fb2a0004ab0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.937+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 shutdown_connections 2024-04-25T10:26:16.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.937+0000 7fb2ac800640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a41e7bc0 0x7fb2a4158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.937+0000 7fb2ac800640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2880744e0 0x7fb2880769f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.937+0000 7fb2ac800640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2a4155bd0 0x7fb2a41f30e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.937+0000 7fb2ac800640 1 --2- 172.21.15.19:0/74805286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c004800 0x7fb2a41f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.937+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 >> 172.21.15.19:0/74805286 conn(0x7fb2a4068da0 msgr2=0x7fb2a41e88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.938+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 shutdown_connections 2024-04-25T10:26:16.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.938+0000 7fb2ac800640 1 -- 172.21.15.19:0/74805286 wait complete. 2024-04-25T10:26:16.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574861 for osd.2 2024-04-25T10:26:16.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574861 for osd.4 2024-04-25T10:26:16.966 INFO:teuthology.orchestra.run.smithi019.stdout:55834574860 2024-04-25T10:26:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.962+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8b600ccd90 con 0x7f8b600ccfb0 2024-04-25T10:26:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.963+0000 7f8b56a00640 1 -- 172.21.15.19:0/869307715 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8b50024e20 con 0x7f8b600ccfb0 2024-04-25T10:26:16.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574861 for osd.0 2024-04-25T10:26:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.965+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8b40074580 msgr2=0x7f8b40076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.965+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8b40074580 0x7f8b40076a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b6015a850 tx=0x7f8b4c008040 comp rx=0 tx=0).stop 2024-04-25T10:26:16.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.965+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 msgr2=0x7f8b600ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.965+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 0x7f8b600ad110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b5001f580 tx=0x7f8b5001fa40 comp rx=0 tx=0).stop 2024-04-25T10:26:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.966+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 shutdown_connections 2024-04-25T10:26:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.966+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b60156770 0x7f8b60155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.966+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b600cdb20 0x7f8b60158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.966+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8b40074580 0x7f8b40076a90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.966+0000 7f8b5fe00640 1 --2- 172.21.15.19:0/869307715 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b600ccfb0 0x7f8b600ad110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.966+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 >> 172.21.15.19:0/869307715 conn(0x7f8b60068880 msgr2=0x7f8b6015b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.966+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 shutdown_connections 2024-04-25T10:26:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.967+0000 7f8b5fe00640 1 -- 172.21.15.19:0/869307715 wait complete. 2024-04-25T10:26:16.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574861 for osd.7 2024-04-25T10:26:16.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.984+0000 7f0c23200640 1 -- 172.21.15.19:0/439785420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0c2414e4b0 con 0x7f0c24150c60 2024-04-25T10:26:16.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.985+0000 7f0c1a000640 1 -- 172.21.15.19:0/439785420 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c10060340 con 0x7f0c24150c60 2024-04-25T10:26:16.987 INFO:teuthology.orchestra.run.smithi019.stdout:55834574861 2024-04-25T10:26:16.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 -- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0c04074500 msgr2=0x7f0c04076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0c04074500 0x7f0c04076a10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c1403a000 tx=0x7f0c1403c040 comp rx=0 tx=0).stop 2024-04-25T10:26:16.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 -- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c24150c60 msgr2=0x7f0c241451e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:16.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c24150c60 0x7f0c241451e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000f610 tx=0x7f0c1000fad0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 -- 172.21.15.19:0/439785420 shutdown_connections 2024-04-25T10:26:16.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0c04074500 0x7f0c04076a10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c24073820 0x7f0c24073c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c24150c60 0x7f0c241451e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 --2- 172.21.15.19:0/439785420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c080039d0 0x7f0c240c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:16.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 -- 172.21.15.19:0/439785420 >> 172.21.15.19:0/439785420 conn(0x7f0c240ca120 msgr2=0x7f0c24151700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:16.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 -- 172.21.15.19:0/439785420 shutdown_connections 2024-04-25T10:26:16.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:16.988+0000 7f0c23200640 1 -- 172.21.15.19:0/439785420 wait complete. 2024-04-25T10:26:17.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574860 for osd.5 2024-04-25T10:26:17.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574861 for osd.3 2024-04-25T10:26:17.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.025+0000 7fd3c4e00640 1 -- 172.21.15.19:0/2951669828 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd3c0076520 con 0x7fd3c014cd60 2024-04-25T10:26:17.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.026+0000 7fd3b6000640 1 -- 172.21.15.19:0/2951669828 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd3ac067320 con 0x7fd3c014cd60 2024-04-25T10:26:17.029 INFO:teuthology.orchestra.run.smithi019.stdout:55834574859 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.029+0000 7fd3c4e00640 1 -- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3a0074680 msgr2=0x7fd3a0076b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.029+0000 7fd3c4e00640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3a0074680 0x7fd3a0076b90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8000f80 tx=0x7fd3b8009040 comp rx=0 tx=0).stop 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.029+0000 7fd3c4e00640 1 -- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3c014cd60 msgr2=0x7fd3c014f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.029+0000 7fd3c4e00640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3c014cd60 0x7fd3c014f0b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00739f0 tx=0x7fd3ac007720 comp rx=0 tx=0).stop 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.030+0000 7fd3c4e00640 1 -- 172.21.15.19:0/2951669828 shutdown_connections 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.030+0000 7fd3c4e00640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd3a0074680 0x7fd3a0076b90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.030+0000 7fd3c4e00640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3c014cd60 0x7fd3c014f0b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.030+0000 7fd3c4e00640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c014b4e0 0x7fd3c014c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.030+0000 7fd3c4e00640 1 --2- 172.21.15.19:0/2951669828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a4004800 0x7fd3c00c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.030+0000 7fd3c4e00640 1 -- 172.21.15.19:0/2951669828 >> 172.21.15.19:0/2951669828 conn(0x7fd3c0074640 msgr2=0x7fd3c01505f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.030+0000 7fd3c4e00640 1 -- 172.21.15.19:0/2951669828 shutdown_connections 2024-04-25T10:26:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.030+0000 7fd3c4e00640 1 -- 172.21.15.19:0/2951669828 wait complete. 2024-04-25T10:26:17.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.1 2024-04-25T10:26:17.126 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-04-25T10:26:17.124+0000 7fb28c600640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T10:26:17.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.151+0000 7f3857200640 1 -- 172.21.15.19:0/2240324707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3830005850 con 0x7f38580cd820 2024-04-25T10:26:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.152+0000 7f384e000640 1 -- 172.21.15.19:0/2240324707 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38480802a0 con 0x7f38580cd820 2024-04-25T10:26:17.155 INFO:teuthology.orchestra.run.smithi019.stdout:55834574860 2024-04-25T10:26:17.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.154+0000 7f3857200640 1 -- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3838074500 msgr2=0x7f3838076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:17.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.154+0000 7f3857200640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3838074500 0x7f3838076a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f385000ab90 tx=0x7f3850009250 comp rx=0 tx=0).stop 2024-04-25T10:26:17.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.154+0000 7f3857200640 1 -- 172.21.15.19:0/2240324707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38580cd820 msgr2=0x7f38580cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:17.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.154+0000 7f3857200640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38580cd820 0x7f38580cb3e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3848009860 tx=0x7f38480046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.154+0000 7f3857200640 1 -- 172.21.15.19:0/2240324707 shutdown_connections 2024-04-25T10:26:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.154+0000 7f3857200640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38581569f0 0x7f38581506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.154+0000 7f3857200640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38580cd820 0x7f38580cb3e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.154+0000 7f3857200640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3838074500 0x7f3838076a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.154+0000 7f3857200640 1 --2- 172.21.15.19:0/2240324707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38580c2640 0x7f38581f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.154+0000 7f3857200640 1 -- 172.21.15.19:0/2240324707 >> 172.21.15.19:0/2240324707 conn(0x7f3858070d10 msgr2=0x7f38580cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:17.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.155+0000 7f3857200640 1 -- 172.21.15.19:0/2240324707 shutdown_connections 2024-04-25T10:26:17.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:17.155+0000 7f3857200640 1 -- 172.21.15.19:0/2240324707 wait complete. 2024-04-25T10:26:17.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574860 for osd.6 2024-04-25T10:26:17.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T10:26:17.959 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T10:26:17.970 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T10:26:17.982 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T10:26:18.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T10:26:18.023 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T10:26:18.068 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T10:26:18.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T10:26:18.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.365+0000 7f5dabe00640 1 Processor -- start 2024-04-25T10:26:18.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.365+0000 7f5dabe00640 1 -- start start 2024-04-25T10:26:18.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.368+0000 7f5dabe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5dac0c2640 0x7f5dac15d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.368+0000 7f5dabe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0735c0 0x7f5dac0739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.368+0000 7f5daaa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5dac0c2640 0x7f5dac15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.369+0000 7f5daaa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5dac0c2640 0x7f5dac15d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41492/0 (socket says 172.21.15.19:41492) 2024-04-25T10:26:18.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.372+0000 7f5daa000640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5dac1569f0 0x7f5dac0cd2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39758/0 (socket says 172.21.15.19:39758) 2024-04-25T10:26:18.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.383+0000 7f5daaa00640 1 -- 172.21.15.19:0/3091936646 learned_addr learned my addr 172.21.15.19:0/3091936646 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.383+0000 7f5dabe00640 1 -- 172.21.15.19:0/3091936646 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dac0c4010 con 0x7f5dac1569f0 2024-04-25T10:26:18.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.383+0000 7f5dabe00640 1 -- 172.21.15.19:0/3091936646 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5dac0c7870 con 0x7f5dac0c2640 2024-04-25T10:26:18.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.383+0000 7f5dabe00640 1 -- 172.21.15.19:0/3091936646 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5dac0c4560 con 0x7f5dac0735c0 2024-04-25T10:26:18.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.383+0000 7f5dab400640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0735c0 0x7f5dac0739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.384+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812471652 0 0) 0x7f5dac0c4010 con 0x7f5dac1569f0 2024-04-25T10:26:18.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.384+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d9000bd30 con 0x7f5dac1569f0 2024-04-25T10:26:18.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3172302334 0 0) 0x7f5d9000bd30 con 0x7f5dac1569f0 2024-04-25T10:26:18.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0735c0 msgr2=0x7f5dac0739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:18.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0735c0 0x7f5dac0739d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 >> v2:172.21.15.19:3300/0 conn(0x7f5dac0c2640 msgr2=0x7f5dac15d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:18.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 --2- 172.21.15.19:0/3091936646 >> v2:172.21.15.19:3300/0 conn(0x7f5dac0c2640 0x7f5dac15d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac0c4280 con 0x7f5dac1569f0 2024-04-25T10:26:18.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2140478945 0 0) 0x7f5d9c001670 con 0x7f5dac1569f0 2024-04-25T10:26:18.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 >> v1:172.21.15.19:6789/0 conn(0x7f5dac1569f0 legacy=0x7f5dac0cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9000c1c0 0x7f5d9000c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d9000d010 0x7f5d9000d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d9000d960 0x7f5d900141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac0c7870 con 0x7f5d9000c1c0 2024-04-25T10:26:18.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac0c4560 con 0x7f5d9000d010 2024-04-25T10:26:18.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5d90014840 con 0x7f5d9000d960 2024-04-25T10:26:18.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5dab400640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0735c0 0x7f5dac0739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:18.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.387+0000 7f5daaa00640 1 --2- 172.21.15.19:0/3091936646 >> v2:172.21.15.19:3300/0 conn(0x7f5dac0c2640 0x7f5dac15d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:26:18.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.388+0000 7f5dab400640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d9000d960 0x7f5d900141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.388+0000 7f5daa000640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d9000d010 0x7f5d9000d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.388+0000 7f5dab400640 1 -- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d9000d010 msgr2=0x7f5d9000d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:18.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.388+0000 7f5dab400640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d9000d010 0x7f5d9000d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.388+0000 7f5dab400640 1 -- 172.21.15.19:0/3091936646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9000c1c0 msgr2=0x7f5d9000c630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:26:18.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.389+0000 7f5daaa00640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9000c1c0 0x7f5d9000c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.390+0000 7f5dab400640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9000c1c0 0x7f5d9000c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.390+0000 7f5dab400640 1 -- 172.21.15.19:0/3091936646 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac0c4280 con 0x7f5d9000d960 2024-04-25T10:26:18.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.391+0000 7f5daaa00640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9000c1c0 0x7f5d9000c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:18.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.393+0000 7f5dab400640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d9000d960 0x7f5d900141d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0707b0 tx=0x7f5d9000e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc47f3ccfe91d2b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.394+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da4036070 con 0x7f5d9000d960 2024-04-25T10:26:18.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.394+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da4003c50 con 0x7f5d9000d960 2024-04-25T10:26:18.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.394+0000 7f5da9600640 1 -- 172.21.15.19:0/3091936646 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da4009d60 con 0x7f5d9000d960 2024-04-25T10:26:18.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.395+0000 7fae91400640 1 Processor -- start 2024-04-25T10:26:18.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.395+0000 7fae91400640 1 -- start start 2024-04-25T10:26:18.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.396+0000 7f5dabe00640 1 -- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d9000d960 msgr2=0x7f5d900141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.396+0000 7f5dabe00640 1 --2- 172.21.15.19:0/3091936646 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d9000d960 0x7f5d900141d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0707b0 tx=0x7f5d9000e040 comp rx=0 tx=0).stop 2024-04-25T10:26:18.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.396+0000 7f5dab400640 1 -- 172.21.15.19:0/3091936646 reap_dead start 2024-04-25T10:26:18.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.397+0000 7f5dabe00640 1 -- 172.21.15.19:0/3091936646 shutdown_connections 2024-04-25T10:26:18.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.397+0000 7f5dabe00640 1 -- 172.21.15.19:0/3091936646 >> 172.21.15.19:0/3091936646 conn(0x7f5dac070d10 msgr2=0x7f5dac071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.397+0000 7f5dabe00640 1 -- 172.21.15.19:0/3091936646 shutdown_connections 2024-04-25T10:26:18.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.397+0000 7f5dabe00640 1 -- 172.21.15.19:0/3091936646 wait complete. 2024-04-25T10:26:18.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.399+0000 7f3a0fc00640 1 Processor -- start 2024-04-25T10:26:18.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.400+0000 7fae91400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fae8404c900 0x7fae84006050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.400+0000 7fae91400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fae84047170 0x7fae840d52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.400+0000 7fae8a800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fae8404c900 0x7fae84006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.400+0000 7fae8a800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fae8404c900 0x7fae84006050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:36952/0 (socket says 172.21.15.19:36952) 2024-04-25T10:26:18.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.400+0000 7fae8a800640 1 -- 172.21.15.19:0/721684113 learned_addr learned my addr 172.21.15.19:0/721684113 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.400+0000 7fae91400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae840df6a0 con 0x7fae840de8d0 2024-04-25T10:26:18.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.401+0000 7fae91400640 1 -- 172.21.15.19:0/721684113 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fae84046a00 con 0x7fae84047170 2024-04-25T10:26:18.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.401+0000 7fae91400640 1 -- 172.21.15.19:0/721684113 --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fae84033530 con 0x7fae8404c900 2024-04-25T10:26:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.401+0000 7fae89e00640 1 --2- 172.21.15.19:0/721684113 >> v2:172.21.15.19:3300/0 conn(0x7fae84047170 0x7fae840d52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.402+0000 7fae8a800640 1 -- 172.21.15.19:0/721684113 >> v2:172.21.15.19:3300/0 conn(0x7fae84047170 msgr2=0x7fae840d52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.402+0000 7fae8a800640 1 --2- 172.21.15.19:0/721684113 >> v2:172.21.15.19:3300/0 conn(0x7fae84047170 0x7fae840d52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.402+0000 7fae8a800640 1 -- 172.21.15.19:0/721684113 >> v1:172.21.15.19:6789/0 conn(0x7fae840de8d0 legacy=0x7fae840db2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.402+0000 7fae8a800640 1 -- 172.21.15.19:0/721684113 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae840df400 con 0x7fae8404c900 2024-04-25T10:26:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.403+0000 7fae89e00640 1 --2- 172.21.15.19:0/721684113 >> v2:172.21.15.19:3300/0 conn(0x7fae84047170 0x7fae840d52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:26:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.406+0000 7fae8a800640 1 --2- 172.21.15.19:0/721684113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae8404c900 0x7fae84006050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fae8c02e0e0 tx=0x7fae8c0b0000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6df797297c16af5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.407+0000 7fae89400640 1 -- 172.21.15.19:0/721684113 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0bd070 con 0x7fae8404c900 2024-04-25T10:26:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.407+0000 7fae89400640 1 -- 172.21.15.19:0/721684113 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae8c0b0c00 con 0x7fae8404c900 2024-04-25T10:26:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.408+0000 7fae91400640 1 -- 172.21.15.19:0/721684113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae8404c900 msgr2=0x7fae84006050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.408+0000 7fae91400640 1 --2- 172.21.15.19:0/721684113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae8404c900 0x7fae84006050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fae8c02e0e0 tx=0x7fae8c0b0000 comp rx=0 tx=0).stop 2024-04-25T10:26:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.408+0000 7fae91400640 1 -- 172.21.15.19:0/721684113 shutdown_connections 2024-04-25T10:26:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.408+0000 7fae91400640 1 --2- 172.21.15.19:0/721684113 >> v2:172.21.15.19:3300/0 conn(0x7fae84047170 0x7fae840d52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.408+0000 7fae91400640 1 --2- 172.21.15.19:0/721684113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae8404c900 0x7fae84006050 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.408+0000 7fae91400640 1 -- 172.21.15.19:0/721684113 >> 172.21.15.19:0/721684113 conn(0x7fae84050370 msgr2=0x7fae84050780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.408+0000 7fae91400640 1 -- 172.21.15.19:0/721684113 shutdown_connections 2024-04-25T10:26:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.408+0000 7fae91400640 1 -- 172.21.15.19:0/721684113 wait complete. 2024-04-25T10:26:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.405+0000 7f5dabe00640 1 Processor -- start 2024-04-25T10:26:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.402+0000 7f3a0fc00640 1 -- start start 2024-04-25T10:26:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.413+0000 7f3a0fc00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a00006a80 0x7f3a00045e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.413+0000 7f3a0fc00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a00047530 con 0x7f3a000d56e0 2024-04-25T10:26:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.413+0000 7f3a0fc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a00034fd0 con 0x7f3a000334d0 2024-04-25T10:26:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.413+0000 7f3a0fc00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3a00035830 con 0x7f3a00006a80 2024-04-25T10:26:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.416+0000 7fae91400640 1 Processor -- start 2024-04-25T10:26:18.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.416+0000 7f3a07e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a00006a80 0x7f3a00045e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.416+0000 7f3a07e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a00006a80 0x7f3a00045e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41508/0 (socket says 172.21.15.19:41508) 2024-04-25T10:26:18.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.417+0000 7f3a07e00640 1 -- 172.21.15.19:0/1499219283 learned_addr learned my addr 172.21.15.19:0/1499219283 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.411+0000 7f5dabe00640 1 -- start start 2024-04-25T10:26:18.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.414+0000 7f5dabe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9000d960 0x7f5dac159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.414+0000 7f5dabe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0ccd80 0x7f5dac150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.414+0000 7f5dabe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dac151040 0x7f5dac202060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.416+0000 7fae91400640 1 -- start start 2024-04-25T10:26:18.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.418+0000 7f3a07e00640 1 -- 172.21.15.19:0/1499219283 >> v1:172.21.15.112:6789/0 conn(0x7f3a000334d0 legacy=0x7f3a00046d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T10:26:18.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.418+0000 7f3a07e00640 1 -- 172.21.15.19:0/1499219283 >> v1:172.21.15.19:6789/0 conn(0x7f3a000d56e0 legacy=0x7f3a0004c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.418+0000 7f5daaa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9000d960 0x7f5dac159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.418+0000 7f5daa000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0ccd80 0x7f5dac150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.418+0000 7f5dab400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dac151040 0x7f5dac202060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.418+0000 7f5dab400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dac151040 0x7f5dac202060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:36960/0 (socket says 172.21.15.19:36960) 2024-04-25T10:26:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.418+0000 7f5daa000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0ccd80 0x7f5dac150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:59902/0 (socket says 172.21.15.19:59902) 2024-04-25T10:26:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.418+0000 7f5dab400640 1 -- 172.21.15.19:0/3316931332 learned_addr learned my addr 172.21.15.19:0/3316931332 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.418+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac074ab0 con 0x7f5d9000d960 2024-04-25T10:26:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.418+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac0c7590 con 0x7f5dac151040 2024-04-25T10:26:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.418+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5dac0cd9f0 con 0x7f5dac0ccd80 2024-04-25T10:26:18.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.419+0000 7fae91400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae84047170 0x7fae840cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.420+0000 7fae91400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae8404c900 0x7fae84166f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.420+0000 7fae8a800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae84047170 0x7fae840cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.420+0000 7fae8a800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae84047170 0x7fae840cf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:59906/0 (socket says 172.21.15.19:59906) 2024-04-25T10:26:18.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.420+0000 7fae8a800640 1 -- 172.21.15.19:0/2036620147 learned_addr learned my addr 172.21.15.19:0/2036620147 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.420+0000 7f5daa000640 1 -- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dac151040 msgr2=0x7f5dac202060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.420+0000 7f5daa000640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dac151040 0x7f5dac202060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.420+0000 7f5daa000640 1 -- 172.21.15.19:0/3316931332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9000d960 msgr2=0x7f5dac159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.420+0000 7f5daa000640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9000d960 0x7f5dac159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.420+0000 7f5daa000640 1 -- 172.21.15.19:0/3316931332 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac159970 con 0x7f5dac0ccd80 2024-04-25T10:26:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.420+0000 7f5dab400640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dac151040 0x7f5dac202060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.421+0000 7f5daaa00640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9000d960 0x7f5dac159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.421+0000 7f5daa000640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0ccd80 0x7f5dac150b00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c007340 tx=0x7f5d9c007800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.421+0000 7fae91400640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae840de8d0 0x7fae840cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.421+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fae84046c50 con 0x7fae8404c900 2024-04-25T10:26:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.421+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fae8404bf40 con 0x7fae840de8d0 2024-04-25T10:26:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.421+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fae84034440 con 0x7fae84047170 2024-04-25T10:26:18.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.421+0000 7f3a07e00640 1 -- 172.21.15.19:0/1499219283 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a00035270 con 0x7f3a00006a80 2024-04-25T10:26:18.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.422+0000 7fda88a00640 1 Processor -- start 2024-04-25T10:26:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.422+0000 7fae8b200640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae840de8d0 0x7fae840cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.422+0000 7fae8a800640 1 -- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae840de8d0 msgr2=0x7fae840cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.423+0000 7fae8a800640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae840de8d0 0x7fae840cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.423+0000 7fae8a800640 1 -- 172.21.15.19:0/2036620147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae8404c900 msgr2=0x7fae84166f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.423+0000 7fae89e00640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae8404c900 0x7fae84166f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.423+0000 7fae8a800640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae8404c900 0x7fae84166f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.423+0000 7fae8a800640 1 -- 172.21.15.19:0/2036620147 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8404fec0 con 0x7fae84047170 2024-04-25T10:26:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.424+0000 7f3a07e00640 1 --2- 172.21.15.19:0/1499219283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00006a80 0x7f3a00045e60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f39f4007360 tx=0x7f39f402b250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4baa3da3fcff9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.425+0000 7f5da2a00640 1 -- 172.21.15.19:0/3316931332 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c01a070 con 0x7f5dac0ccd80 2024-04-25T10:26:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.425+0000 7f5da2a00640 1 -- 172.21.15.19:0/3316931332 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9c00f940 con 0x7f5dac0ccd80 2024-04-25T10:26:18.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.425+0000 7f5da2a00640 1 -- 172.21.15.19:0/3316931332 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00fd10 con 0x7f5dac0ccd80 2024-04-25T10:26:18.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.424+0000 7fae89e00640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae8404c900 0x7fae84166f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:18.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.425+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dac157860 con 0x7f5dac0ccd80 2024-04-25T10:26:18.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.426+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dac158c30 con 0x7f5dac0ccd80 2024-04-25T10:26:18.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.427+0000 7f3a07400640 1 -- 172.21.15.19:0/1499219283 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f40089e0 con 0x7f3a00006a80 2024-04-25T10:26:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.427+0000 7f3a07400640 1 -- 172.21.15.19:0/1499219283 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f4008b80 con 0x7f3a00006a80 2024-04-25T10:26:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.427+0000 7f3a07400640 1 -- 172.21.15.19:0/1499219283 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f400a0d0 con 0x7f3a00006a80 2024-04-25T10:26:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.428+0000 7f3a0fc00640 1 -- 172.21.15.19:0/1499219283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00006a80 msgr2=0x7f3a00045e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.428+0000 7f3a0fc00640 1 --2- 172.21.15.19:0/1499219283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00006a80 0x7f3a00045e60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f39f4007360 tx=0x7f39f402b250 comp rx=0 tx=0).stop 2024-04-25T10:26:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.428+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dac050740 con 0x7f5dac0ccd80 2024-04-25T10:26:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.427+0000 7fda88a00640 1 -- start start 2024-04-25T10:26:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.429+0000 7f3a0fc00640 1 -- 172.21.15.19:0/1499219283 shutdown_connections 2024-04-25T10:26:18.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.429+0000 7f3a0fc00640 1 --2- 172.21.15.19:0/1499219283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00006a80 0x7f3a00045e60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.429+0000 7f5da2a00640 1 -- 172.21.15.19:0/3316931332 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5d9c01d070 con 0x7f5dac0ccd80 2024-04-25T10:26:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.430+0000 7f5da2a00640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5d8c0745b0 0x7f5d8c076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.430+0000 7f5da2a00640 1 -- 172.21.15.19:0/3316931332 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f5d9c094f60 con 0x7f5dac0ccd80 2024-04-25T10:26:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.430+0000 7f5daaa00640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5d8c0745b0 0x7f5d8c076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.429+0000 7fae8a800640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae84047170 0x7fae840cf6e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae8c077a40 tx=0x7fae8c06a980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.429+0000 7f3a0fc00640 1 -- 172.21.15.19:0/1499219283 >> 172.21.15.19:0/1499219283 conn(0x7f3a000503a0 msgr2=0x7f3a000507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.431+0000 7f5daaa00640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5d8c0745b0 0x7f5d8c076ac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5d98006a50 tx=0x7f5d98008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.430+0000 7fae82a00640 1 -- 172.21.15.19:0/2036620147 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0bd050 con 0x7fae84047170 2024-04-25T10:26:18.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.431+0000 7fae82a00640 1 -- 172.21.15.19:0/2036620147 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae8c0be040 con 0x7fae84047170 2024-04-25T10:26:18.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.431+0000 7fae82a00640 1 -- 172.21.15.19:0/2036620147 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0b7ae0 con 0x7fae84047170 2024-04-25T10:26:18.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.431+0000 7f3a0fc00640 1 -- 172.21.15.19:0/1499219283 shutdown_connections 2024-04-25T10:26:18.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.432+0000 7f3a0fc00640 1 -- 172.21.15.19:0/1499219283 wait complete. 2024-04-25T10:26:18.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.433+0000 7fda88a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fda840731f0 0x7fda8415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.433+0000 7fda88a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda840c34b0 con 0x7fda840c4260 2024-04-25T10:26:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.433+0000 7fda88a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda84074880 con 0x7fda84073600 2024-04-25T10:26:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.433+0000 7fda83e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fda84073600 0x7fda8406ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:52078/0 (socket says 172.21.15.19:52078) 2024-04-25T10:26:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.434+0000 7fda83e00640 1 -- 172.21.15.19:0/2832241015 learned_addr learned my addr 172.21.15.19:0/2832241015 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.434+0000 7fda88a00640 1 -- 172.21.15.19:0/2832241015 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fda840c3da0 con 0x7fda840731f0 2024-04-25T10:26:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.434+0000 7f3a0fc00640 1 Processor -- start 2024-04-25T10:26:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.431+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae840cf420 con 0x7fae84047170 2024-04-25T10:26:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.432+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae84171490 con 0x7fae84047170 2024-04-25T10:26:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.433+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae84005530 con 0x7fae84047170 2024-04-25T10:26:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.435+0000 7f3a0fc00640 1 -- start start 2024-04-25T10:26:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.434+0000 7fda83400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fda840c4260 0x7fda840c8100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39792/0 (socket says 172.21.15.19:39792) 2024-04-25T10:26:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.436+0000 7fda82a00640 1 --2- 172.21.15.19:0/2832241015 >> v2:172.21.15.19:3300/0 conn(0x7fda840731f0 0x7fda8415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.435+0000 7f5da2a00640 1 -- 172.21.15.19:0/3316931332 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5d9c05eda0 con 0x7f5dac0ccd80 2024-04-25T10:26:18.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7f3a0fc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00006a80 0x7f3a00031be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7f3a0fc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a000334d0 0x7f3a001616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7f3a0fc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a000d56e0 0x7f3a000c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7f3a0fc00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a00045340 con 0x7f3a00006a80 2024-04-25T10:26:18.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7f3a0fc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3a00006560 con 0x7f3a000d56e0 2024-04-25T10:26:18.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7f3a0fc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3a000d5af0 con 0x7f3a000334d0 2024-04-25T10:26:18.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996389591 0 0) 0x7fda84074880 con 0x7fda84073600 2024-04-25T10:26:18.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda68003520 con 0x7fda84073600 2024-04-25T10:26:18.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1108230337 0 0) 0x7fda840c34b0 con 0x7fda840c4260 2024-04-25T10:26:18.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda84074880 con 0x7fda840c4260 2024-04-25T10:26:18.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7f3a0d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00006a80 0x7f3a00031be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7f3a0d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00006a80 0x7f3a00031be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41540/0 (socket says 172.21.15.19:41540) 2024-04-25T10:26:18.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7f3a0d200640 1 -- 172.21.15.19:0/3900192124 learned_addr learned my addr 172.21.15.19:0/3900192124 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.437+0000 7f3a07e00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a000334d0 0x7f3a001616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.438+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 <== mon.1 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 893317969 0 0) 0x7fda68003520 con 0x7fda84073600 2024-04-25T10:26:18.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.438+0000 7f3a0dc00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a000d56e0 0x7f3a000c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.438+0000 7f3a07e00640 1 -- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a000d56e0 msgr2=0x7f3a000c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.438+0000 7f3a07e00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a000d56e0 0x7f3a000c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.438+0000 7f3a07e00640 1 -- 172.21.15.19:0/3900192124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00006a80 msgr2=0x7f3a00031be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.438+0000 7f3a07e00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00006a80 0x7f3a00031be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.438+0000 7f3a07e00640 1 -- 172.21.15.19:0/3900192124 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a001795a0 con 0x7f3a000334d0 2024-04-25T10:26:18.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.439+0000 7f3a07e00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a000334d0 0x7f3a001616a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f39f4031000 tx=0x7f39f40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.438+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 >> v2:172.21.15.19:3300/0 conn(0x7fda840731f0 msgr2=0x7fda8415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.441+0000 7fda82000640 1 --2- 172.21.15.19:0/2832241015 >> v2:172.21.15.19:3300/0 conn(0x7fda840731f0 0x7fda8415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.441+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 >> v1:172.21.15.19:6789/0 conn(0x7fda840c4260 legacy=0x7fda840c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.441+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda840c3750 con 0x7fda84073600 2024-04-25T10:26:18.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.441+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 <== mon.1 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2140478945 0 0) 0x7fda74001670 con 0x7fda84073600 2024-04-25T10:26:18.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.441+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 >> v1:172.21.15.112:6789/0 conn(0x7fda84073600 legacy=0x7fda8406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.441+0000 7f3a04c00640 1 -- 172.21.15.19:0/3900192124 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4042020 con 0x7f3a000334d0 2024-04-25T10:26:18.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.441+0000 7f3a04c00640 1 -- 172.21.15.19:0/3900192124 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f4008040 con 0x7f3a000334d0 2024-04-25T10:26:18.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.442+0000 7f3a04c00640 1 -- 172.21.15.19:0/3900192124 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4008430 con 0x7f3a000334d0 2024-04-25T10:26:18.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.441+0000 7fda82000640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda68004ba0 0x7fda68004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.443+0000 7f3a0fc00640 1 -- 172.21.15.19:0/3900192124 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a00179840 con 0x7f3a000334d0 2024-04-25T10:26:18.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.443+0000 7f3a0fc00640 1 -- 172.21.15.19:0/3900192124 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a00175af0 con 0x7f3a000334d0 2024-04-25T10:26:18.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.442+0000 7fda82000640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda680037a0 0x7fda68003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.442+0000 7fda82000640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda680040f0 0x7fda6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.442+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fda840c3da0 con 0x7fda680037a0 2024-04-25T10:26:18.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.442+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fda6800c090 con 0x7fda680040f0 2024-04-25T10:26:18.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.442+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fda6800c290 con 0x7fda68004ba0 2024-04-25T10:26:18.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.442+0000 7fda82a00640 1 --2- 172.21.15.19:0/2832241015 >> v2:172.21.15.19:3300/0 conn(0x7fda840731f0 0x7fda8415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:18.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.443+0000 7fda83400640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda68004ba0 0x7fda68004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.443+0000 7fda82a00640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda680037a0 0x7fda68003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.444+0000 7fda83400640 1 -- 172.21.15.19:0/2832241015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda680040f0 msgr2=0x7fda6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:18.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.444+0000 7fda83e00640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda680040f0 0x7fda6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.444+0000 7fda83400640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda680040f0 0x7fda6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.444+0000 7fda83400640 1 -- 172.21.15.19:0/2832241015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda680037a0 msgr2=0x7fda68003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.444+0000 7fda83400640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda680037a0 0x7fda68003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.444+0000 7fda83400640 1 -- 172.21.15.19:0/2832241015 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda68003520 con 0x7fda68004ba0 2024-04-25T10:26:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.444+0000 7fda82a00640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda680037a0 0x7fda68003bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:26:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.444+0000 7fda83e00640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda680040f0 0x7fda6800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.444+0000 7fda83e00640 1 -- 172.21.15.19:0/2832241015 reap_dead start 2024-04-25T10:26:18.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.445+0000 7f3a0fc00640 1 -- 172.21.15.19:0/3900192124 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a00005560 con 0x7f3a000334d0 2024-04-25T10:26:18.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.447+0000 7f3a04c00640 1 -- 172.21.15.19:0/3900192124 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f39f4045020 con 0x7f3a000334d0 2024-04-25T10:26:18.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.449+0000 7f3a04c00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f39e8074500 0x7f39e8076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.448+0000 7fae82a00640 1 -- 172.21.15.19:0/2036620147 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fae8c0cb020 con 0x7fae84047170 2024-04-25T10:26:18.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.449+0000 7f3a04c00640 1 -- 172.21.15.19:0/3900192124 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f39f407c890 con 0x7f3a000334d0 2024-04-25T10:26:18.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.450+0000 7fae82a00640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae68074580 0x7fae68076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.448+0000 7fda83400640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda68004ba0 0x7fda68004fd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda840c3680 tx=0x7fda68005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca170aa93520efa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.450+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00c0e0 con 0x7fda68004ba0 2024-04-25T10:26:18.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.450+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7c004d60 con 0x7fda68004ba0 2024-04-25T10:26:18.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.450+0000 7fda82000640 1 -- 172.21.15.19:0/2832241015 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c007310 con 0x7fda68004ba0 2024-04-25T10:26:18.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.450+0000 7f3a0d200640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f39e8074500 0x7f39e8076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.450+0000 7fae89e00640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae68074580 0x7fae68076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.451+0000 7fae82a00640 1 -- 172.21.15.19:0/2036620147 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fae8c13bf80 con 0x7fae84047170 2024-04-25T10:26:18.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.451+0000 7fae82a00640 1 -- 172.21.15.19:0/2036620147 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fae8404fec0 con 0x7fae84047170 2024-04-25T10:26:18.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.451+0000 7f3a04c00640 1 -- 172.21.15.19:0/3900192124 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f39f404c070 con 0x7f3a000334d0 2024-04-25T10:26:18.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.455+0000 7fae89e00640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae68074580 0x7fae68076a90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae84033020 tx=0x7fae7c00f040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.455+0000 7fda88a00640 1 -- 172.21.15.19:0/2832241015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda68004ba0 msgr2=0x7fda68004fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.455+0000 7fda88a00640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda68004ba0 0x7fda68004fd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda840c3680 tx=0x7fda68005830 comp rx=0 tx=0).stop 2024-04-25T10:26:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.455+0000 7fda88a00640 1 -- 172.21.15.19:0/2832241015 shutdown_connections 2024-04-25T10:26:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.455+0000 7fda88a00640 1 --2- 172.21.15.19:0/2832241015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda68004ba0 0x7fda68004fd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.455+0000 7fda88a00640 1 -- 172.21.15.19:0/2832241015 >> 172.21.15.19:0/2832241015 conn(0x7fda8406d120 msgr2=0x7fda840cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.457+0000 7f3a0d200640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f39e8074500 0x7f39e8076a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f39fc006fd0 tx=0x7f39fc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.457+0000 7fda88a00640 1 -- 172.21.15.19:0/2832241015 shutdown_connections 2024-04-25T10:26:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.457+0000 7fda88a00640 1 -- 172.21.15.19:0/2832241015 wait complete. 2024-04-25T10:26:18.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.464+0000 7fda88a00640 1 Processor -- start 2024-04-25T10:26:18.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.465+0000 7fda88a00640 1 -- start start 2024-04-25T10:26:18.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.468+0000 7fda88a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda68004ba0 0x7fda841561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.468+0000 7fda88a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda8415fab0 0x7fda841ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.468+0000 7fda83400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda68004ba0 0x7fda841561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.469+0000 7fda83400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda68004ba0 0x7fda841561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37012/0 (socket says 172.21.15.19:37012) 2024-04-25T10:26:18.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.469+0000 7fda83400640 1 -- 172.21.15.19:0/2971743030 learned_addr learned my addr 172.21.15.19:0/2971743030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.469+0000 7fda82a00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda8415fab0 0x7fda841ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.469+0000 7fda88a00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda841ef280 0x7fda84154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.470+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fda84074460 con 0x7fda841ef280 2024-04-25T10:26:18.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.470+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fda84074b40 con 0x7fda68004ba0 2024-04-25T10:26:18.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.470+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fda840745e0 con 0x7fda8415fab0 2024-04-25T10:26:18.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.471+0000 7fda83e00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda841ef280 0x7fda84154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.472+0000 7fda83e00640 1 -- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda8415fab0 msgr2=0x7fda841ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.472+0000 7fda83e00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda8415fab0 0x7fda841ed130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.472+0000 7fda83e00640 1 -- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda68004ba0 msgr2=0x7fda841561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.472+0000 7fda83e00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda68004ba0 0x7fda841561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.472+0000 7fda83e00640 1 -- 172.21.15.19:0/2971743030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda842000d0 con 0x7fda841ef280 2024-04-25T10:26:18.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.473+0000 7fda83e00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda841ef280 0x7fda84154e70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda840ce340 tx=0x7fda7400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.474+0000 7fda7b400640 1 -- 172.21.15.19:0/2971743030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda740049a0 con 0x7fda841ef280 2024-04-25T10:26:18.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.474+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda84156730 con 0x7fda841ef280 2024-04-25T10:26:18.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.474+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda841ffdf0 con 0x7fda841ef280 2024-04-25T10:26:18.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.475+0000 7fda7b400640 1 -- 172.21.15.19:0/2971743030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda74004b40 con 0x7fda841ef280 2024-04-25T10:26:18.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.475+0000 7fda7b400640 1 -- 172.21.15.19:0/2971743030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda740049a0 con 0x7fda841ef280 2024-04-25T10:26:18.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.479+0000 7fda7b400640 1 -- 172.21.15.19:0/2971743030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fda74008070 con 0x7fda841ef280 2024-04-25T10:26:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.481+0000 7fda7b400640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda640748b0 0x7fda64076dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.482+0000 7fda7b400640 1 -- 172.21.15.19:0/2971743030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fda7400edb0 con 0x7fda841ef280 2024-04-25T10:26:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.482+0000 7fda83400640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda640748b0 0x7fda64076dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.483+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda5c005290 con 0x7fda841ef280 2024-04-25T10:26:18.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.483+0000 7fda83400640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda640748b0 0x7fda64076dc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00c5d0 tx=0x7fda7c009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.485+0000 7fa8f2800640 1 Processor -- start 2024-04-25T10:26:18.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.486+0000 7fa8f2800640 1 -- start start 2024-04-25T10:26:18.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.489+0000 7fa8f2800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8ec0cce90 0x7fa8ec15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.489+0000 7fa8f2800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa8ec0d1cf0 0x7fa8ec0d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.489+0000 7fa8f2800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8ec0cd2a0 con 0x7fa8ec156740 2024-04-25T10:26:18.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.490+0000 7fa8f1e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa8ec0d1cf0 0x7fa8ec0d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.490+0000 7fa8f1e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa8ec0d1cf0 0x7fa8ec0d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37020/0 (socket says 172.21.15.19:37020) 2024-04-25T10:26:18.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.490+0000 7fa8f1e00640 1 -- 172.21.15.19:0/484522381 learned_addr learned my addr 172.21.15.19:0/484522381 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.491+0000 7fa8f2800640 1 -- 172.21.15.19:0/484522381 --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ec15d2d0 con 0x7fa8ec0d1cf0 2024-04-25T10:26:18.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.491+0000 7fa8f0a00640 1 --2- 172.21.15.19:0/484522381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8ec0cce90 0x7fa8ec15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.491+0000 7fa8f2800640 1 -- 172.21.15.19:0/484522381 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec0ce610 con 0x7fa8ec0cce90 2024-04-25T10:26:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.492+0000 7f3199c00640 1 Processor -- start 2024-04-25T10:26:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.492+0000 7fa8f1e00640 1 -- 172.21.15.19:0/484522381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8ec0cce90 msgr2=0x7fa8ec15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.492+0000 7fa8f1e00640 1 --2- 172.21.15.19:0/484522381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8ec0cce90 0x7fa8ec15cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.492+0000 7fa8f1e00640 1 -- 172.21.15.19:0/484522381 >> v1:172.21.15.19:6789/0 conn(0x7fa8ec156740 legacy=0x7fa8ec0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.493+0000 7f3199c00640 1 -- start start 2024-04-25T10:26:18.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.496+0000 7fda7b400640 1 -- 172.21.15.19:0/2971743030 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fda7405e6c0 con 0x7fda841ef280 2024-04-25T10:26:18.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.496+0000 7f3199c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f31940c8e00 0x7f3194152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.496+0000 7f3199c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 0x7f319415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.497+0000 7fa8f1e00640 1 -- 172.21.15.19:0/484522381 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec0cd520 con 0x7fa8ec0d1cf0 2024-04-25T10:26:18.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.497+0000 7f3199c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31940c9410 con 0x7f3194073820 2024-04-25T10:26:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.497+0000 7f3192a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f31940c8e00 0x7f3194152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.497+0000 7f3192a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f31940c8e00 0x7f3194152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41546/0 (socket says 172.21.15.19:41546) 2024-04-25T10:26:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.497+0000 7f3192a00640 1 -- 172.21.15.19:0/1103166919 learned_addr learned my addr 172.21.15.19:0/1103166919 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.497+0000 7f3199c00640 1 -- 172.21.15.19:0/1103166919 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f319415bc40 con 0x7f31940c8e00 2024-04-25T10:26:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.498+0000 7f3199c00640 1 -- 172.21.15.19:0/1103166919 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f31940c9680 con 0x7f31940ca9c0 2024-04-25T10:26:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.498+0000 7f3193400640 1 --2- 172.21.15.19:0/1103166919 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 0x7f319415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.498+0000 7f3191600640 1 -- 172.21.15.19:0/1103166919 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722911313 0 0) 0x7f31940c9410 con 0x7f3194073820 2024-04-25T10:26:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.498+0000 7f3191600640 1 -- 172.21.15.19:0/1103166919 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3178003520 con 0x7f3194073820 2024-04-25T10:26:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.499+0000 7f3192a00640 1 -- 172.21.15.19:0/1103166919 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 msgr2=0x7f319415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.499+0000 7f3192a00640 1 --2- 172.21.15.19:0/1103166919 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 0x7f319415c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.499+0000 7f3192a00640 1 -- 172.21.15.19:0/1103166919 >> v1:172.21.15.112:6789/0 conn(0x7f3194073820 legacy=0x7f31940ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.499+0000 7fa8f1e00640 1 --2- 172.21.15.19:0/484522381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8ec0d1cf0 0x7fa8ec0d2100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009870 tx=0x7fa8e002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5820492fff05975 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.499+0000 7f3192a00640 1 -- 172.21.15.19:0/1103166919 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31940c9960 con 0x7f31940c8e00 2024-04-25T10:26:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.500+0000 7f3193400640 1 --2- 172.21.15.19:0/1103166919 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 0x7f319415c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.500+0000 7fa8ebe00640 1 -- 172.21.15.19:0/484522381 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0037070 con 0x7fa8ec0d1cf0 2024-04-25T10:26:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.500+0000 7fa8ebe00640 1 -- 172.21.15.19:0/484522381 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e002ae50 con 0x7fa8ec0d1cf0 2024-04-25T10:26:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.501+0000 7fa8ebe00640 1 -- 172.21.15.19:0/484522381 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0032860 con 0x7fa8ec0d1cf0 2024-04-25T10:26:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.502+0000 7fa8f2800640 1 -- 172.21.15.19:0/484522381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8ec0d1cf0 msgr2=0x7fa8ec0d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.502+0000 7fa8f2800640 1 --2- 172.21.15.19:0/484522381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8ec0d1cf0 0x7fa8ec0d2100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009870 tx=0x7fa8e002a300 comp rx=0 tx=0).stop 2024-04-25T10:26:18.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.504+0000 7fa8f2800640 1 -- 172.21.15.19:0/484522381 shutdown_connections 2024-04-25T10:26:18.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.504+0000 7fa8f2800640 1 --2- 172.21.15.19:0/484522381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8ec0d1cf0 0x7fa8ec0d2100 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.504+0000 7fa8f2800640 1 --2- 172.21.15.19:0/484522381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8ec0cce90 0x7fa8ec15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.504+0000 7fa8f2800640 1 -- 172.21.15.19:0/484522381 >> 172.21.15.19:0/484522381 conn(0x7fa8ec08dad0 msgr2=0x7fa8ec08dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.504+0000 7f3192a00640 1 --2- 172.21.15.19:0/1103166919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31940c8e00 0x7f3194152aa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f318c007eb0 tx=0x7f318c02cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4d341005f6f2ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.504+0000 7fa8f2800640 1 -- 172.21.15.19:0/484522381 shutdown_connections 2024-04-25T10:26:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.504+0000 7f3191600640 1 -- 172.21.15.19:0/1103166919 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c02d9a0 con 0x7f31940c8e00 2024-04-25T10:26:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.505+0000 7fa8f2800640 1 -- 172.21.15.19:0/484522381 wait complete. 2024-04-25T10:26:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.505+0000 7f3191600640 1 -- 172.21.15.19:0/1103166919 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c02db40 con 0x7f31940c8e00 2024-04-25T10:26:18.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.506+0000 7f3199c00640 1 -- 172.21.15.19:0/1103166919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31940c8e00 msgr2=0x7f3194152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.506+0000 7f3199c00640 1 --2- 172.21.15.19:0/1103166919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31940c8e00 0x7f3194152aa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f318c007eb0 tx=0x7f318c02cc50 comp rx=0 tx=0).stop 2024-04-25T10:26:18.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.507+0000 7f3199c00640 1 -- 172.21.15.19:0/1103166919 shutdown_connections 2024-04-25T10:26:18.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.507+0000 7f3199c00640 1 --2- 172.21.15.19:0/1103166919 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 0x7f319415c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.508+0000 7f3199c00640 1 --2- 172.21.15.19:0/1103166919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31940c8e00 0x7f3194152aa0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.508+0000 7f3199c00640 1 -- 172.21.15.19:0/1103166919 >> 172.21.15.19:0/1103166919 conn(0x7f319406f1f0 msgr2=0x7f319406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.508+0000 7f3199c00640 1 -- 172.21.15.19:0/1103166919 shutdown_connections 2024-04-25T10:26:18.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.508+0000 7f3199c00640 1 -- 172.21.15.19:0/1103166919 wait complete. 2024-04-25T10:26:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.513+0000 7f3199c00640 1 Processor -- start 2024-04-25T10:26:18.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.513+0000 7f3199c00640 1 -- start start 2024-04-25T10:26:18.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.516+0000 7f3199c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3194073820 0x7f31940b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.517+0000 7f3199c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31940c8e00 0x7f3194151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.517+0000 7f3199c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 0x7f31940af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.518+0000 7f3199c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f31940c36b0 con 0x7f3194073820 2024-04-25T10:26:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.518+0000 7f3193400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 0x7f31940af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.518+0000 7f3193400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 0x7f31940af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:59970/0 (socket says 172.21.15.19:59970) 2024-04-25T10:26:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.518+0000 7f3193400640 1 -- 172.21.15.19:0/3671861823 learned_addr learned my addr 172.21.15.19:0/3671861823 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.519+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f31940c9f20 con 0x7f31940c8e00 2024-04-25T10:26:18.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.519+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f31940c3830 con 0x7f31940ca9c0 2024-04-25T10:26:18.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.519+0000 7f3192000640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31940c8e00 0x7f3194151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.520+0000 7f3193400640 1 -- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31940c8e00 msgr2=0x7f3194151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.520+0000 7f3193400640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31940c8e00 0x7f3194151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.520+0000 7f3192a00640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3194073820 0x7f31940b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.520+0000 7f3193400640 1 -- 172.21.15.19:0/3671861823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3194073820 msgr2=0x7f31940b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.520+0000 7f3193400640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3194073820 0x7f31940b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.521+0000 7f3193400640 1 -- 172.21.15.19:0/3671861823 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3194151c70 con 0x7f31940ca9c0 2024-04-25T10:26:18.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.521+0000 7f3192000640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31940c8e00 0x7f3194151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:18.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.521+0000 7f3192a00640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3194073820 0x7f31940b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:18.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.522+0000 7fa8f2800640 1 Processor -- start 2024-04-25T10:26:18.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.522+0000 7fa8f2800640 1 -- start start 2024-04-25T10:26:18.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.522+0000 7f3193400640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 0x7f31940af220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f317c00e860 tx=0x7f317c00ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.523+0000 7f318aa00640 1 -- 172.21.15.19:0/3671861823 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c017070 con 0x7f31940ca9c0 2024-04-25T10:26:18.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.525+0000 7fa8f2800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8ec0cce90 0x7fa8ec1e9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.526+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31941f5ce0 con 0x7f31940ca9c0 2024-04-25T10:26:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.526+0000 7fa8f2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8ec0d1cf0 0x7fa8ec0cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.526+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f31941f62a0 con 0x7f31940ca9c0 2024-04-25T10:26:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.526+0000 7f318aa00640 1 -- 172.21.15.19:0/3671861823 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c00c8e0 con 0x7f31940ca9c0 2024-04-25T10:26:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.526+0000 7f318aa00640 1 -- 172.21.15.19:0/3671861823 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c00ccd0 con 0x7f31940ca9c0 2024-04-25T10:26:18.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.527+0000 7fa8f2800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8ec156740 0x7fa8ec152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.527+0000 7fa8f2800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0cdfc0 con 0x7fa8ec0cce90 2024-04-25T10:26:18.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.527+0000 7fa8f2800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0cdce0 con 0x7fa8ec0d1cf0 2024-04-25T10:26:18.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.527+0000 7fa8f2800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec0ce2a0 con 0x7fa8ec156740 2024-04-25T10:26:18.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.528+0000 7fa8f0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8ec0d1cf0 0x7fa8ec0cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.528+0000 7fa8f0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8ec0d1cf0 0x7fa8ec0cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37036/0 (socket says 172.21.15.19:37036) 2024-04-25T10:26:18.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.528+0000 7fa8f0a00640 1 -- 172.21.15.19:0/2111707565 learned_addr learned my addr 172.21.15.19:0/2111707565 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.528+0000 7fa8f1e00640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8ec156740 0x7fa8ec152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.528+0000 7fa8f1400640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8ec0cce90 0x7fa8ec1e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.530+0000 7fa8f1400640 1 -- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8ec156740 msgr2=0x7fa8ec152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.530+0000 7fa8f1400640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8ec156740 0x7fa8ec152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.530+0000 7fa8f1400640 1 -- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8ec0d1cf0 msgr2=0x7fa8ec0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.530+0000 7fa8f1400640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8ec0d1cf0 0x7fa8ec0cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.530+0000 7fa8f1400640 1 -- 172.21.15.19:0/2111707565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec0d1490 con 0x7fa8ec0cce90 2024-04-25T10:26:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.531+0000 7fa8f1e00640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8ec156740 0x7fa8ec152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:26:18.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.531+0000 7fa8f1400640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8ec0cce90 0x7fa8ec1e9660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400c760 tx=0x7fa8e400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.532+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31941f5a40 con 0x7f31940ca9c0 2024-04-25T10:26:18.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.532+0000 7fa8e9600640 1 -- 172.21.15.19:0/2111707565 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4016020 con 0x7fa8ec0cce90 2024-04-25T10:26:18.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.532+0000 7fa8e9600640 1 -- 172.21.15.19:0/2111707565 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e4006d50 con 0x7fa8ec0cce90 2024-04-25T10:26:18.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.532+0000 7fa8e9600640 1 -- 172.21.15.19:0/2111707565 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4003b90 con 0x7fa8ec0cce90 2024-04-25T10:26:18.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.532+0000 7fa8f2800640 1 -- 172.21.15.19:0/2111707565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec15a250 con 0x7fa8ec0cce90 2024-04-25T10:26:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.532+0000 7fa8f2800640 1 -- 172.21.15.19:0/2111707565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec15a530 con 0x7fa8ec0cce90 2024-04-25T10:26:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.537+0000 7fa8e9600640 1 -- 172.21.15.19:0/2111707565 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa8e400a7f0 con 0x7fa8ec0cce90 2024-04-25T10:26:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.540+0000 7fa8e9600640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa8d00745b0 0x7fa8d0076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.540+0000 7fa8e9600640 1 -- 172.21.15.19:0/2111707565 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fa8e40950d0 con 0x7fa8ec0cce90 2024-04-25T10:26:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.541+0000 7f318aa00640 1 -- 172.21.15.19:0/3671861823 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f317c01a070 con 0x7f31940ca9c0 2024-04-25T10:26:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.541+0000 7fa8f0a00640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa8d00745b0 0x7fa8d0076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.542+0000 7fa8f0a00640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa8d00745b0 0x7fa8d0076ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc006fd0 tx=0x7fa8dc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.543+0000 7fa8f2800640 1 -- 172.21.15.19:0/2111707565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ec050740 con 0x7fa8ec0cce90 2024-04-25T10:26:18.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.544+0000 7f318aa00640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f31700744e0 0x7f31700769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.544+0000 7f318aa00640 1 -- 172.21.15.19:0/3671861823 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f317c0956f0 con 0x7f31940ca9c0 2024-04-25T10:26:18.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.545+0000 7f3192a00640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f31700744e0 0x7f31700769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.545+0000 7f318aa00640 1 -- 172.21.15.19:0/3671861823 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31941f5a40 con 0x7f31940ca9c0 2024-04-25T10:26:18.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.547+0000 7f3192a00640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f31700744e0 0x7f31700769f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f318c036000 tx=0x7f318c031000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.561+0000 7fa8e9600640 1 -- 172.21.15.19:0/2111707565 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8e4020020 con 0x7fa8ec0cce90 2024-04-25T10:26:18.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.572+0000 7f4ba5400640 1 Processor -- start 2024-04-25T10:26:18.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.573+0000 7f4ba5400640 1 -- start start 2024-04-25T10:26:18.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.576+0000 7f4ba5400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4ba00c2640 0x7f4ba0158370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.576+0000 7f4ba5400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba0074830 0x7f4ba006f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.577+0000 7f4b9de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba0074830 0x7f4ba006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.577+0000 7f4b9de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba0074830 0x7f4ba006f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:59988/0 (socket says 172.21.15.19:59988) 2024-04-25T10:26:18.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.577+0000 7f4b9de00640 1 -- 172.21.15.19:0/2499644503 learned_addr learned my addr 172.21.15.19:0/2499644503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.577+0000 7f4ba5400640 1 -- 172.21.15.19:0/2499644503 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba00c2af0 con 0x7f4ba00c4320 2024-04-25T10:26:18.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.577+0000 7f4ba5400640 1 -- 172.21.15.19:0/2499644503 --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba0152b50 con 0x7f4ba00c2640 2024-04-25T10:26:18.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.577+0000 7f4ba5400640 1 -- 172.21.15.19:0/2499644503 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba00c8cc0 con 0x7f4ba0074830 2024-04-25T10:26:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.579+0000 7f4b9de00640 1 -- 172.21.15.19:0/2499644503 >> v2:172.21.15.112:3300/0 conn(0x7f4ba00c2640 msgr2=0x7f4ba0158370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T10:26:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.579+0000 7f4b9de00640 1 --2- 172.21.15.19:0/2499644503 >> v2:172.21.15.112:3300/0 conn(0x7f4ba00c2640 0x7f4ba0158370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.579+0000 7f4b9de00640 1 -- 172.21.15.19:0/2499644503 >> v1:172.21.15.19:6789/0 conn(0x7f4ba00c4320 legacy=0x7f4ba0152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.579+0000 7f4b9de00640 1 -- 172.21.15.19:0/2499644503 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba00c8fa0 con 0x7f4ba0074830 2024-04-25T10:26:18.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.578+0000 7f4b9d400640 1 -- 172.21.15.19:0/2499644503 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1202576193 0 0) 0x7f4ba00c2af0 con 0x7f4ba00c4320 2024-04-25T10:26:18.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.582+0000 7f4b9de00640 1 --2- 172.21.15.19:0/2499644503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba0074830 0x7f4ba006f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009870 tx=0x7f4b9002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5991325d30ec273 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.582+0000 7f4b9d400640 1 -- 172.21.15.19:0/2499644503 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90037070 con 0x7f4ba0074830 2024-04-25T10:26:18.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.582+0000 7f4b9d400640 1 -- 172.21.15.19:0/2499644503 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b90032440 con 0x7f4ba0074830 2024-04-25T10:26:18.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.584+0000 7f4b9d400640 1 -- 172.21.15.19:0/2499644503 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90037070 con 0x7f4ba0074830 2024-04-25T10:26:18.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.584+0000 7f4ba5400640 1 -- 172.21.15.19:0/2499644503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba0074830 msgr2=0x7f4ba006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.584+0000 7f4ba5400640 1 --2- 172.21.15.19:0/2499644503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba0074830 0x7f4ba006f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009870 tx=0x7f4b9002a210 comp rx=0 tx=0).stop 2024-04-25T10:26:18.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.584+0000 7f4ba5400640 1 -- 172.21.15.19:0/2499644503 shutdown_connections 2024-04-25T10:26:18.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.585+0000 7f4ba5400640 1 --2- 172.21.15.19:0/2499644503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba0074830 0x7f4ba006f320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.585+0000 7f4ba5400640 1 --2- 172.21.15.19:0/2499644503 >> v2:172.21.15.112:3300/0 conn(0x7f4ba00c2640 0x7f4ba0158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.585+0000 7f4ba5400640 1 -- 172.21.15.19:0/2499644503 >> 172.21.15.19:0/2499644503 conn(0x7f4ba00ca120 msgr2=0x7f4ba00ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.585+0000 7f4ba5400640 1 -- 172.21.15.19:0/2499644503 shutdown_connections 2024-04-25T10:26:18.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.585+0000 7f4ba5400640 1 -- 172.21.15.19:0/2499644503 wait complete. 2024-04-25T10:26:18.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.590+0000 7f4ba5400640 1 Processor -- start 2024-04-25T10:26:18.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.591+0000 7f4ba5400640 1 -- start start 2024-04-25T10:26:18.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.594+0000 7f4ba5400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba0074830 0x7f4ba01e1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.594+0000 7f4ba5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba00c2640 0x7f4ba01e1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.594+0000 7f4ba5400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba00c4320 0x7f4ba0149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.595+0000 7f4b9de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba00c2640 0x7f4ba01e1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.595+0000 7f4b9de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba00c2640 0x7f4ba01e1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37054/0 (socket says 172.21.15.19:37054) 2024-04-25T10:26:18.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.595+0000 7f4b9de00640 1 -- 172.21.15.19:0/825312710 learned_addr learned my addr 172.21.15.19:0/825312710 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.595+0000 7f4b9f200640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba00c4320 0x7f4ba0149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.596+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba00c4730 con 0x7f4ba0074830 2024-04-25T10:26:18.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.596+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba006ee00 con 0x7f4ba00c2640 2024-04-25T10:26:18.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.596+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba00c8020 con 0x7f4ba00c4320 2024-04-25T10:26:18.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.599+0000 7f4b9de00640 1 -- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba00c4320 msgr2=0x7f4ba0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.599+0000 7f4b9de00640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba00c4320 0x7f4ba0149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.599+0000 7f4b9de00640 1 -- 172.21.15.19:0/825312710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba0074830 msgr2=0x7f4ba01e1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.599+0000 7f4b9de00640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba0074830 0x7f4ba01e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.600+0000 7f4b9de00640 1 -- 172.21.15.19:0/825312710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba01e1590 con 0x7f4ba00c2640 2024-04-25T10:26:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.600+0000 7f4b9f200640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba00c4320 0x7f4ba0149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:18.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.602+0000 7f4b9de00640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba00c2640 0x7f4ba01e1f30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4b90000c00 tx=0x7f4b900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.605+0000 7f4b96a00640 1 -- 172.21.15.19:0/825312710 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90041020 con 0x7f4ba00c2640 2024-04-25T10:26:18.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.605+0000 7f4b96a00640 1 -- 172.21.15.19:0/825312710 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b90032810 con 0x7f4ba00c2640 2024-04-25T10:26:18.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.605+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba0157d10 con 0x7f4ba00c2640 2024-04-25T10:26:18.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.605+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba01582d0 con 0x7f4ba00c2640 2024-04-25T10:26:18.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.607+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba0076520 con 0x7f4ba00c2640 2024-04-25T10:26:18.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.609+0000 7f4b96a00640 1 -- 172.21.15.19:0/825312710 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90037040 con 0x7f4ba00c2640 2024-04-25T10:26:18.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.616+0000 7f4b96a00640 1 -- 172.21.15.19:0/825312710 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4b90044020 con 0x7f4ba00c2640 2024-04-25T10:26:18.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.618+0000 7f4b96a00640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4b800744b0 0x7f4b800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.619+0000 7f4b96a00640 1 -- 172.21.15.19:0/825312710 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f4b9007c8b0 con 0x7f4ba00c2640 2024-04-25T10:26:18.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.620+0000 7f4b9e800640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4b800744b0 0x7f4b800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.620+0000 7f4b96a00640 1 -- 172.21.15.19:0/825312710 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4b9004b030 con 0x7f4ba00c2640 2024-04-25T10:26:18.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.621+0000 7f4b9e800640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4b800744b0 0x7f4b800769c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800abb0 tx=0x7f4b98009250 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.716+0000 7faaa8c00640 1 Processor -- start 2024-04-25T10:26:18.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.716+0000 7faaa8c00640 1 -- start start 2024-04-25T10:26:18.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.719+0000 7faaa8c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaa415b2c0 0x7faaa40c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.719+0000 7faaa8c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faaa4073160 0x7faaa415e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.719+0000 7faaa8c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa4158010 con 0x7faaa415e760 2024-04-25T10:26:18.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.719+0000 7faaa8c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7faaa4074970 con 0x7faaa4073160 2024-04-25T10:26:18.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.719+0000 7faaa8c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faaa40c8600 con 0x7faaa415b2c0 2024-04-25T10:26:18.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.719+0000 7faaa1400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faaa4073160 0x7faaa415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.720+0000 7faaa1400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faaa4073160 0x7faaa415e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37060/0 (socket says 172.21.15.19:37060) 2024-04-25T10:26:18.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.720+0000 7faaa1400640 1 -- 172.21.15.19:0/1303407701 learned_addr learned my addr 172.21.15.19:0/1303407701 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.720+0000 7faaa1400640 1 -- 172.21.15.19:0/1303407701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaa415b2c0 msgr2=0x7faaa40c9810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:26:18.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.720+0000 7faaa1400640 1 --2- 172.21.15.19:0/1303407701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaa415b2c0 0x7faaa40c9810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.720+0000 7faaa1400640 1 -- 172.21.15.19:0/1303407701 >> v1:172.21.15.19:6789/0 conn(0x7faaa415e760 legacy=0x7faaa40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:18.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.720+0000 7faaa1400640 1 -- 172.21.15.19:0/1303407701 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa40c88e0 con 0x7faaa4073160 2024-04-25T10:26:18.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.724+0000 7faaa1400640 1 --2- 172.21.15.19:0/1303407701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaa4073160 0x7faaa415e220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faa94009870 tx=0x7faa9402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3056156e85da7252 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.735+0000 7faaa0a00640 1 -- 172.21.15.19:0/1303407701 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94037070 con 0x7faaa4073160 2024-04-25T10:26:18.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.735+0000 7faaa0a00640 1 -- 172.21.15.19:0/1303407701 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa94032440 con 0x7faaa4073160 2024-04-25T10:26:18.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.735+0000 7faaa0a00640 1 -- 172.21.15.19:0/1303407701 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94032810 con 0x7faaa4073160 2024-04-25T10:26:18.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.739+0000 7faaa8c00640 1 -- 172.21.15.19:0/1303407701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaa4073160 msgr2=0x7faaa415e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.739+0000 7faaa8c00640 1 --2- 172.21.15.19:0/1303407701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaa4073160 0x7faaa415e220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faa94009870 tx=0x7faa9402a2c0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.743+0000 7faaa8c00640 1 -- 172.21.15.19:0/1303407701 shutdown_connections 2024-04-25T10:26:18.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.743+0000 7faaa8c00640 1 --2- 172.21.15.19:0/1303407701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaa4073160 0x7faaa415e220 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.743+0000 7faaa8c00640 1 --2- 172.21.15.19:0/1303407701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaa415b2c0 0x7faaa40c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.743+0000 7faaa8c00640 1 -- 172.21.15.19:0/1303407701 >> 172.21.15.19:0/1303407701 conn(0x7faaa406f1f0 msgr2=0x7faaa406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.745+0000 7faaa8c00640 1 -- 172.21.15.19:0/1303407701 shutdown_connections 2024-04-25T10:26:18.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.745+0000 7faaa8c00640 1 -- 172.21.15.19:0/1303407701 wait complete. 2024-04-25T10:26:18.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.760+0000 7faaa8c00640 1 Processor -- start 2024-04-25T10:26:18.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.771+0000 7faaa8c00640 1 -- start start 2024-04-25T10:26:18.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.792+0000 7faaa8c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaa4073160 0x7faaa40afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.792+0000 7faaa8c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaa415e760 0x7faaa414f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.796+0000 7faaa8c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaa41e4560 0x7faaa414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.796+0000 7faaa8c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faaa406d4c0 con 0x7faaa4073160 2024-04-25T10:26:18.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.796+0000 7faaa2800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaa41e4560 0x7faaa414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.796+0000 7faaa2800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaa41e4560 0x7faaa414fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:59998/0 (socket says 172.21.15.19:59998) 2024-04-25T10:26:18.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.796+0000 7faaa2800640 1 -- 172.21.15.19:0/1904631701 learned_addr learned my addr 172.21.15.19:0/1904631701 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:18.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.798+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faaa415a580 con 0x7faaa415e760 2024-04-25T10:26:18.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.798+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faaa40ce4f0 con 0x7faaa41e4560 2024-04-25T10:26:18.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.799+0000 7faaa1400640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaa415e760 0x7faaa414f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.804+0000 7faaa1e00640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaa4073160 0x7faaa40afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.804+0000 7faaa2800640 1 -- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaa415e760 msgr2=0x7faaa414f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.804+0000 7faaa2800640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaa415e760 0x7faaa414f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.804+0000 7faaa2800640 1 -- 172.21.15.19:0/1904631701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaa4073160 msgr2=0x7faaa40afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.805+0000 7faaa2800640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaa4073160 0x7faaa40afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.809+0000 7faaa2800640 1 -- 172.21.15.19:0/1904631701 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa41e5400 con 0x7faaa41e4560 2024-04-25T10:26:18.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.810+0000 7faaa2800640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaa41e4560 0x7faaa414fe90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa9000b440 tx=0x7faa9000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.810+0000 7faa9a000640 1 -- 172.21.15.19:0/1904631701 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90015020 con 0x7faaa41e4560 2024-04-25T10:26:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.812+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa41f5c70 con 0x7faaa41e4560 2024-04-25T10:26:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.812+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa41f6230 con 0x7faaa41e4560 2024-04-25T10:26:18.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.814+0000 7faa9a000640 1 -- 172.21.15.19:0/1904631701 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa90011850 con 0x7faaa41e4560 2024-04-25T10:26:18.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.814+0000 7faa9a000640 1 -- 172.21.15.19:0/1904631701 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90011c40 con 0x7faaa41e4560 2024-04-25T10:26:18.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.815+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa41f5aa0 con 0x7faaa41e4560 2024-04-25T10:26:18.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.818+0000 7faa9a000640 1 -- 172.21.15.19:0/1904631701 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faa90018020 con 0x7faaa41e4560 2024-04-25T10:26:18.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.820+0000 7faa9a000640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7faa840744e0 0x7faa840769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:18.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.821+0000 7faa9a000640 1 -- 172.21.15.19:0/1904631701 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7faa90095090 con 0x7faaa41e4560 2024-04-25T10:26:18.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.843+0000 7faa9a000640 1 -- 172.21.15.19:0/1904631701 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa9001f030 con 0x7faaa41e4560 2024-04-25T10:26:18.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.843+0000 7faaa1e00640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7faa840744e0 0x7faa840769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:18.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.847+0000 7faaa1e00640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7faa840744e0 0x7faa840769f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009f50 tx=0x7faa9c009540 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:18.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.859+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5dac074820 con 0x7f5dac0ccd80 2024-04-25T10:26:18.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.863+0000 7f5da2a00640 1 -- 172.21.15.19:0/3316931332 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d9c0673e0 con 0x7f5dac0ccd80 2024-04-25T10:26:18.865 INFO:teuthology.orchestra.run.smithi019.stdout:55834574863 2024-04-25T10:26:18.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.875+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5d8c0745b0 msgr2=0x7f5d8c076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.875+0000 7f5dabe00640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5d8c0745b0 0x7f5d8c076ac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5d98006a50 tx=0x7f5d98008040 comp rx=0 tx=0).stop 2024-04-25T10:26:18.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.875+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0ccd80 msgr2=0x7f5dac150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.875+0000 7f5dabe00640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0ccd80 0x7f5dac150b00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c007340 tx=0x7f5d9c007800 comp rx=0 tx=0).stop 2024-04-25T10:26:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.877+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 shutdown_connections 2024-04-25T10:26:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.877+0000 7f5dabe00640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dac151040 0x7f5dac202060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.877+0000 7f5dabe00640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5d8c0745b0 0x7f5d8c076ac0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.877+0000 7f5dabe00640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dac0ccd80 0x7f5dac150b00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.877+0000 7f5dabe00640 1 --2- 172.21.15.19:0/3316931332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9000d960 0x7f5dac159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.877+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 >> 172.21.15.19:0/3316931332 conn(0x7f5dac070d10 msgr2=0x7f5dac0b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.878+0000 7f3a0fc00640 1 -- 172.21.15.19:0/3900192124 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3a000d4f90 con 0x7f3a000334d0 2024-04-25T10:26:18.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.878+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 shutdown_connections 2024-04-25T10:26:18.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.878+0000 7f5dabe00640 1 -- 172.21.15.19:0/3316931332 wait complete. 2024-04-25T10:26:18.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.880+0000 7f3a04c00640 1 -- 172.21.15.19:0/3900192124 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3a001795a0 con 0x7f3a000334d0 2024-04-25T10:26:18.885 INFO:teuthology.orchestra.run.smithi019.stdout:55834574863 2024-04-25T10:26:18.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.883+0000 7f3a0fc00640 1 -- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f39e8074500 msgr2=0x7f39e8076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.883+0000 7f3a0fc00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f39e8074500 0x7f39e8076a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f39fc006fd0 tx=0x7f39fc008040 comp rx=0 tx=0).stop 2024-04-25T10:26:18.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.883+0000 7f3a0fc00640 1 -- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a000334d0 msgr2=0x7f3a001616a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.883+0000 7f3a0fc00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a000334d0 0x7f3a001616a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f39f4031000 tx=0x7f39f40046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.884+0000 7f3a0fc00640 1 -- 172.21.15.19:0/3900192124 shutdown_connections 2024-04-25T10:26:18.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.884+0000 7f3a0fc00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a000d56e0 0x7f3a000c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.884+0000 7f3a0fc00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f39e8074500 0x7f39e8076a10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.884+0000 7f3a0fc00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a000334d0 0x7f3a001616a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.884+0000 7f3a0fc00640 1 --2- 172.21.15.19:0/3900192124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00006a80 0x7f3a00031be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.884+0000 7f3a0fc00640 1 -- 172.21.15.19:0/3900192124 >> 172.21.15.19:0/3900192124 conn(0x7f3a000503a0 msgr2=0x7f3a00045f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.886+0000 7f3a0fc00640 1 -- 172.21.15.19:0/3900192124 shutdown_connections 2024-04-25T10:26:18.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.886+0000 7f3a0fc00640 1 -- 172.21.15.19:0/3900192124 wait complete. 2024-04-25T10:26:18.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.894+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fae8404c6e0 con 0x7fae84047170 2024-04-25T10:26:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.901+0000 7fae82a00640 1 -- 172.21.15.19:0/2036620147 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fae8c1064a0 con 0x7fae84047170 2024-04-25T10:26:18.903 INFO:teuthology.orchestra.run.smithi019.stdout:55834574863 2024-04-25T10:26:18.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.906+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae68074580 msgr2=0x7fae68076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.906+0000 7fae91400640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae68074580 0x7fae68076a90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae84033020 tx=0x7fae7c00f040 comp rx=0 tx=0).stop 2024-04-25T10:26:18.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.906+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae84047170 msgr2=0x7fae840cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.906+0000 7fae91400640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae84047170 0x7fae840cf6e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae8c077a40 tx=0x7fae8c06a980 comp rx=0 tx=0).stop 2024-04-25T10:26:18.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.907+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 shutdown_connections 2024-04-25T10:26:18.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.907+0000 7fae91400640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae840de8d0 0x7fae840cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.907+0000 7fae91400640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae8404c900 0x7fae84166f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.907+0000 7fae91400640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fae68074580 0x7fae68076a90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.907+0000 7fae91400640 1 --2- 172.21.15.19:0/2036620147 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae84047170 0x7fae840cf6e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.907+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 >> 172.21.15.19:0/2036620147 conn(0x7fae84050370 msgr2=0x7fae84005dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.907+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 shutdown_connections 2024-04-25T10:26:18.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.907+0000 7fae91400640 1 -- 172.21.15.19:0/2036620147 wait complete. 2024-04-25T10:26:18.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.2 2024-04-25T10:26:18.921 DEBUG:teuthology.parallel:result is None 2024-04-25T10:26:18.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.0 2024-04-25T10:26:18.940 DEBUG:teuthology.parallel:result is None 2024-04-25T10:26:18.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.4 2024-04-25T10:26:18.957 DEBUG:teuthology.parallel:result is None 2024-04-25T10:26:18.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.974+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fda5c005850 con 0x7fda841ef280 2024-04-25T10:26:18.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.975+0000 7fda7b400640 1 -- 172.21.15.19:0/2971743030 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda740629c0 con 0x7fda841ef280 2024-04-25T10:26:18.978 INFO:teuthology.orchestra.run.smithi019.stdout:55834574863 2024-04-25T10:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.978+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda640748b0 msgr2=0x7fda64076dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.978+0000 7fda88a00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda640748b0 0x7fda64076dc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00c5d0 tx=0x7fda7c009000 comp rx=0 tx=0).stop 2024-04-25T10:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.978+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda841ef280 msgr2=0x7fda84154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.978+0000 7fda88a00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda841ef280 0x7fda84154e70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda840ce340 tx=0x7fda7400ebc0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.979+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 shutdown_connections 2024-04-25T10:26:18.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.979+0000 7fda88a00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda841ef280 0x7fda84154e70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.979+0000 7fda88a00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda640748b0 0x7fda64076dc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.979+0000 7fda88a00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda8415fab0 0x7fda841ed130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.979+0000 7fda88a00640 1 --2- 172.21.15.19:0/2971743030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda68004ba0 0x7fda841561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:18.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.979+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 >> 172.21.15.19:0/2971743030 conn(0x7fda8406d120 msgr2=0x7fda841572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:18.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.979+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 shutdown_connections 2024-04-25T10:26:18.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:18.979+0000 7fda88a00640 1 -- 172.21.15.19:0/2971743030 wait complete. 2024-04-25T10:26:19.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.7 2024-04-25T10:26:19.019 DEBUG:teuthology.parallel:result is None 2024-04-25T10:26:19.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.020+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3194076520 con 0x7f31940ca9c0 2024-04-25T10:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.021+0000 7f318aa00640 1 -- 172.21.15.19:0/3671861823 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f317c05fb90 con 0x7f31940ca9c0 2024-04-25T10:26:19.024 INFO:teuthology.orchestra.run.smithi019.stdout:55834574863 2024-04-25T10:26:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f31700744e0 msgr2=0x7f31700769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f31700744e0 0x7f31700769f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f318c036000 tx=0x7f318c031000 comp rx=0 tx=0).stop 2024-04-25T10:26:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 msgr2=0x7f31940af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 0x7f31940af220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f317c00e860 tx=0x7f317c00ed20 comp rx=0 tx=0).stop 2024-04-25T10:26:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 shutdown_connections 2024-04-25T10:26:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f31700744e0 0x7f31700769f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31940ca9c0 0x7f31940af220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31940c8e00 0x7f3194151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 --2- 172.21.15.19:0/3671861823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3194073820 0x7f31940b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 >> 172.21.15.19:0/3671861823 conn(0x7f319406f1f0 msgr2=0x7f3194075af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 shutdown_connections 2024-04-25T10:26:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.024+0000 7f3199c00640 1 -- 172.21.15.19:0/3671861823 wait complete. 2024-04-25T10:26:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.035+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4ba0074610 con 0x7f4ba00c2640 2024-04-25T10:26:19.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.035+0000 7f4b96a00640 1 -- 172.21.15.19:0/825312710 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b900809c0 con 0x7f4ba00c2640 2024-04-25T10:26:19.038 INFO:teuthology.orchestra.run.smithi019.stdout:55834574861 2024-04-25T10:26:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4b800744b0 msgr2=0x7f4b800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4b800744b0 0x7f4b800769c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800abb0 tx=0x7f4b98009250 comp rx=0 tx=0).stop 2024-04-25T10:26:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba00c2640 msgr2=0x7f4ba01e1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba00c2640 0x7f4ba01e1f30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4b90000c00 tx=0x7f4b900046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 shutdown_connections 2024-04-25T10:26:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4b800744b0 0x7f4b800769c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4ba00c4320 0x7f4ba0149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba00c2640 0x7f4ba01e1f30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 --2- 172.21.15.19:0/825312710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba0074830 0x7f4ba01e1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 >> 172.21.15.19:0/825312710 conn(0x7f4ba00ca120 msgr2=0x7f4ba01510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 shutdown_connections 2024-04-25T10:26:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.038+0000 7f4ba5400640 1 -- 172.21.15.19:0/825312710 wait complete. 2024-04-25T10:26:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.042+0000 7fa8f2800640 1 -- 172.21.15.19:0/2111707565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa8ec0c7570 con 0x7fa8ec0cce90 2024-04-25T10:26:19.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.042+0000 7fa8e9600640 1 -- 172.21.15.19:0/2111707565 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa8ec0cd2a0 con 0x7fa8ec0cce90 2024-04-25T10:26:19.045 INFO:teuthology.orchestra.run.smithi019.stdout:55834574862 2024-04-25T10:26:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.045+0000 7fa8f2800640 1 -- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa8d00745b0 msgr2=0x7fa8d0076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.045+0000 7fa8f2800640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa8d00745b0 0x7fa8d0076ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc006fd0 tx=0x7fa8dc008040 comp rx=0 tx=0).stop 2024-04-25T10:26:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.045+0000 7fa8f2800640 1 -- 172.21.15.19:0/2111707565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8ec0cce90 msgr2=0x7fa8ec1e9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.045+0000 7fa8f2800640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8ec0cce90 0x7fa8ec1e9660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400c760 tx=0x7fa8e400cc20 comp rx=0 tx=0).stop 2024-04-25T10:26:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.045+0000 7fa8f2800640 1 -- 172.21.15.19:0/2111707565 shutdown_connections 2024-04-25T10:26:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.045+0000 7fa8f2800640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa8d00745b0 0x7fa8d0076ac0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.045+0000 7fa8f2800640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8ec156740 0x7fa8ec152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.045+0000 7fa8f2800640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8ec0d1cf0 0x7fa8ec0cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.045+0000 7fa8f2800640 1 --2- 172.21.15.19:0/2111707565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8ec0cce90 0x7fa8ec1e9660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.045+0000 7fa8f2800640 1 -- 172.21.15.19:0/2111707565 >> 172.21.15.19:0/2111707565 conn(0x7fa8ec08dad0 msgr2=0x7fa8ec0c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:19.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.046+0000 7fa8f2800640 1 -- 172.21.15.19:0/2111707565 shutdown_connections 2024-04-25T10:26:19.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.046+0000 7fa8f2800640 1 -- 172.21.15.19:0/2111707565 wait complete. 2024-04-25T10:26:19.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574863 got 55834574863 for osd.3 2024-04-25T10:26:19.061 DEBUG:teuthology.parallel:result is None 2024-04-25T10:26:19.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.1 2024-04-25T10:26:19.071 DEBUG:teuthology.parallel:result is None 2024-04-25T10:26:19.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.5 2024-04-25T10:26:19.084 DEBUG:teuthology.parallel:result is None 2024-04-25T10:26:19.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.174+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7faaa4076520 con 0x7faaa41e4560 2024-04-25T10:26:19.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.175+0000 7faa9a000640 1 -- 172.21.15.19:0/1904631701 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa9005f410 con 0x7faaa41e4560 2024-04-25T10:26:19.178 INFO:teuthology.orchestra.run.smithi019.stdout:55834574862 2024-04-25T10:26:19.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7faa840744e0 msgr2=0x7faa840769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7faa840744e0 0x7faa840769f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009f50 tx=0x7faa9c009540 comp rx=0 tx=0).stop 2024-04-25T10:26:19.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaa41e4560 msgr2=0x7faaa414fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaa41e4560 0x7faaa414fe90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa9000b440 tx=0x7faa9000b900 comp rx=0 tx=0).stop 2024-04-25T10:26:19.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 shutdown_connections 2024-04-25T10:26:19.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7faa840744e0 0x7faa840769f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaa41e4560 0x7faaa414fe90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaa415e760 0x7faaa414f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 --2- 172.21.15.19:0/1904631701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaa4073160 0x7faaa40afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 >> 172.21.15.19:0/1904631701 conn(0x7faaa406f1f0 msgr2=0x7faaa4158940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:19.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 shutdown_connections 2024-04-25T10:26:19.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.178+0000 7faaa8c00640 1 -- 172.21.15.19:0/1904631701 wait complete. 2024-04-25T10:26:19.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.6 2024-04-25T10:26:19.204 DEBUG:teuthology.parallel:result is None 2024-04-25T10:26:19.204 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T10:26:19.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:26:19.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.463+0000 7f2656200640 1 Processor -- start 2024-04-25T10:26:19.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.463+0000 7f2656200640 1 -- start start 2024-04-25T10:26:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.465+0000 7f2656200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26500c7f90 0x7f2650073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.465+0000 7f2656200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500cac80 0x7f2650073b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.465+0000 7f2656200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f265015a8b0 con 0x7f265015a370 2024-04-25T10:26:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.465+0000 7f2656200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2650070f70 con 0x7f26500c7f90 2024-04-25T10:26:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.465+0000 7f2656200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2650072ea0 con 0x7f26500cac80 2024-04-25T10:26:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.465+0000 7f2654e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f265015a370 0x7f2650070860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:52088/0 (socket says 172.21.15.19:52088) 2024-04-25T10:26:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.465+0000 7f2655800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500cac80 0x7f2650073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.465+0000 7f2654e00640 1 -- 172.21.15.19:0/1283252606 learned_addr learned my addr 172.21.15.19:0/1283252606 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:19.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.465+0000 7f2647e00640 1 --2- 172.21.15.19:0/1283252606 >> v2:172.21.15.19:3300/0 conn(0x7f26500c7f90 0x7f2650073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:19.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.466+0000 7f264fe00640 1 -- 172.21.15.19:0/1283252606 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158533095 0 0) 0x7f265015a8b0 con 0x7f265015a370 2024-04-25T10:26:19.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.466+0000 7f264fe00640 1 -- 172.21.15.19:0/1283252606 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f262c003520 con 0x7f265015a370 2024-04-25T10:26:19.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.466+0000 7f2655800640 1 -- 172.21.15.19:0/1283252606 >> v2:172.21.15.19:3300/0 conn(0x7f26500c7f90 msgr2=0x7f2650073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:19.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.466+0000 7f2655800640 1 --2- 172.21.15.19:0/1283252606 >> v2:172.21.15.19:3300/0 conn(0x7f26500c7f90 0x7f2650073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.466+0000 7f2655800640 1 -- 172.21.15.19:0/1283252606 >> v1:172.21.15.112:6789/0 conn(0x7f265015a370 legacy=0x7f2650070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.466+0000 7f2655800640 1 -- 172.21.15.19:0/1283252606 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265015ab70 con 0x7f26500cac80 2024-04-25T10:26:19.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.466+0000 7f2647e00640 1 --2- 172.21.15.19:0/1283252606 >> v2:172.21.15.19:3300/0 conn(0x7f26500c7f90 0x7f2650073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:26:19.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.467+0000 7f2655800640 1 --2- 172.21.15.19:0/1283252606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500cac80 0x7f2650073b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2648009d90 tx=0x7f264802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d07ff5a63fb49bfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:19.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.467+0000 7f264fe00640 1 -- 172.21.15.19:0/1283252606 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648031600 con 0x7f26500cac80 2024-04-25T10:26:19.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.467+0000 7f264fe00640 1 -- 172.21.15.19:0/1283252606 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26480317a0 con 0x7f26500cac80 2024-04-25T10:26:19.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.467+0000 7f264fe00640 1 -- 172.21.15.19:0/1283252606 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648031b70 con 0x7f26500cac80 2024-04-25T10:26:19.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.468+0000 7f2656200640 1 -- 172.21.15.19:0/1283252606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500cac80 msgr2=0x7f2650073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.468+0000 7f2656200640 1 --2- 172.21.15.19:0/1283252606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500cac80 0x7f2650073b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2648009d90 tx=0x7f264802a5d0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.468+0000 7f2656200640 1 -- 172.21.15.19:0/1283252606 shutdown_connections 2024-04-25T10:26:19.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.468+0000 7f2656200640 1 --2- 172.21.15.19:0/1283252606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500cac80 0x7f2650073b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.468+0000 7f2656200640 1 --2- 172.21.15.19:0/1283252606 >> v2:172.21.15.19:3300/0 conn(0x7f26500c7f90 0x7f2650073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.468+0000 7f2656200640 1 -- 172.21.15.19:0/1283252606 >> 172.21.15.19:0/1283252606 conn(0x7f26500cdbc0 msgr2=0x7f26500ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:19.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.468+0000 7f2656200640 1 -- 172.21.15.19:0/1283252606 shutdown_connections 2024-04-25T10:26:19.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.468+0000 7f2656200640 1 -- 172.21.15.19:0/1283252606 wait complete. 2024-04-25T10:26:19.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.470+0000 7f2656200640 1 Processor -- start 2024-04-25T10:26:19.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.471+0000 7f2656200640 1 -- start start 2024-04-25T10:26:19.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.472+0000 7f2656200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500c7f90 0x7f26501e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:19.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.472+0000 7f2656200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26500cac80 0x7f2650154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:19.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.472+0000 7f2656200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f265015a370 0x7f265014d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:19.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.472+0000 7f2656200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f265015b130 con 0x7f265015a370 2024-04-25T10:26:19.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.472+0000 7f2656200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2650073180 con 0x7f26500cac80 2024-04-25T10:26:19.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.472+0000 7f2656200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f26500c4b20 con 0x7f26500c7f90 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.472+0000 7f2654e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500c7f90 0x7f26501e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.472+0000 7f2647e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26500cac80 0x7f2650154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.472+0000 7f2654e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500c7f90 0x7f26501e50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60014/0 (socket says 172.21.15.19:60014) 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.472+0000 7f2655800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f265015a370 0x7f265014d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.472+0000 7f2654e00640 1 -- 172.21.15.19:0/2798247187 learned_addr learned my addr 172.21.15.19:0/2798247187 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.473+0000 7f2654e00640 1 -- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26500cac80 msgr2=0x7f2650154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.473+0000 7f2654e00640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26500cac80 0x7f2650154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.473+0000 7f2654e00640 1 -- 172.21.15.19:0/2798247187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f265015a370 msgr2=0x7f265014d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.473+0000 7f2654e00640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f265015a370 0x7f265014d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.473+0000 7f2654e00640 1 -- 172.21.15.19:0/2798247187 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26501e55e0 con 0x7f26500c7f90 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.473+0000 7f2654e00640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500c7f90 0x7f26501e50a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f263400c390 tx=0x7f263400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.473+0000 7f264d600640 1 -- 172.21.15.19:0/2798247187 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634017070 con 0x7f26500c7f90 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.473+0000 7f264d600640 1 -- 172.21.15.19:0/2798247187 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2634005ce0 con 0x7f26500c7f90 2024-04-25T10:26:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.473+0000 7f264d600640 1 -- 172.21.15.19:0/2798247187 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26340072f0 con 0x7f26500c7f90 2024-04-25T10:26:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.473+0000 7f2656200640 1 -- 172.21.15.19:0/2798247187 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265014e2c0 con 0x7f26500c7f90 2024-04-25T10:26:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.474+0000 7f2656200640 1 -- 172.21.15.19:0/2798247187 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26501f28e0 con 0x7f26500c7f90 2024-04-25T10:26:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.475+0000 7f2656200640 1 -- 172.21.15.19:0/2798247187 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2650069c90 con 0x7f26500c7f90 2024-04-25T10:26:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.476+0000 7f264d600640 1 -- 172.21.15.19:0/2798247187 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f263401a070 con 0x7f26500c7f90 2024-04-25T10:26:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.477+0000 7f264d600640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f26240744b0 0x7f26240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.477+0000 7f264d600640 1 -- 172.21.15.19:0/2798247187 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f2634094840 con 0x7f26500c7f90 2024-04-25T10:26:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.477+0000 7f2647e00640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f26240744b0 0x7f26240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.478+0000 7f2647e00640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f26240744b0 0x7f26240769c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f265015a340 tx=0x7f263c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.481+0000 7f264d600640 1 -- 172.21.15.19:0/2798247187 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2650069c90 con 0x7f26500c7f90 2024-04-25T10:26:19.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.673+0000 7f2656200640 1 -- 172.21.15.19:0/2798247187 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2650050740 con 0x7f26240744b0 2024-04-25T10:26:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.683+0000 7f264d600640 1 -- 172.21.15.19:0/2798247187 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332562 (secure 0 0 0) 0x7f2650050740 con 0x7f26240744b0 2024-04-25T10:26:19.688 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:19.693 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:26:19.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.691+0000 7f2656200640 1 -- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f26240744b0 msgr2=0x7f26240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.691+0000 7f2656200640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f26240744b0 0x7f26240769c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f265015a340 tx=0x7f263c008040 comp rx=0 tx=0).stop 2024-04-25T10:26:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.691+0000 7f2656200640 1 -- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500c7f90 msgr2=0x7f26501e50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.691+0000 7f2656200640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500c7f90 0x7f26501e50a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f263400c390 tx=0x7f263400c850 comp rx=0 tx=0).stop 2024-04-25T10:26:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.691+0000 7f2656200640 1 -- 172.21.15.19:0/2798247187 shutdown_connections 2024-04-25T10:26:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.691+0000 7f2656200640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f265015a370 0x7f265014d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.691+0000 7f2656200640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26500cac80 0x7f2650154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.691+0000 7f2656200640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f26240744b0 0x7f26240769c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.691+0000 7f2656200640 1 --2- 172.21.15.19:0/2798247187 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26500c7f90 0x7f26501e50a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.691+0000 7f2656200640 1 -- 172.21.15.19:0/2798247187 >> 172.21.15.19:0/2798247187 conn(0x7f26500cdbc0 msgr2=0x7f265006c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.692+0000 7f2656200640 1 -- 172.21.15.19:0/2798247187 shutdown_connections 2024-04-25T10:26:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:19.692+0000 7f2656200640 1 -- 172.21.15.19:0/2798247187 wait complete. 2024-04-25T10:26:19.719 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-04-25T10:26:18.588488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":189,"num_write_kb":1659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3256,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3334144,"data_stored":1994940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002046"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694853+0000","last_change":"2024-04-25T10:25:36.182605+0000","last_active":"2024-04-25T10:25:42.694853+0000","last_peered":"2024-04-25T10:25:42.694853+0000","last_clean":"2024-04-25T10:25:42.694853+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:25:42.694853+0000","last_undegraded":"2024-04-25T10:25:42.694853+0000","last_fullsized":"2024-04-25T10:25:42.694853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907219+0000","last_change":"2024-04-25T10:25:37.199467+0000","last_active":"2024-04-25T10:25:42.907219+0000","last_peered":"2024-04-25T10:25:42.907219+0000","last_clean":"2024-04-25T10:25:42.907219+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:25:42.907219+0000","last_undegraded":"2024-04-25T10:25:42.907219+0000","last_fullsized":"2024-04-25T10:25:42.907219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739046+0000","last_change":"2024-04-25T10:25:41.234657+0000","last_active":"2024-04-25T10:25:42.739046+0000","last_peered":"2024-04-25T10:25:42.739046+0000","last_clean":"2024-04-25T10:25:42.739046+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:25:42.739046+0000","last_undegraded":"2024-04-25T10:25:42.739046+0000","last_fullsized":"2024-04-25T10:25:42.739046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:56.869031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907367+0000","last_change":"2024-04-25T10:25:36.166548+0000","last_active":"2024-04-25T10:25:42.907367+0000","last_peered":"2024-04-25T10:25:42.907367+0000","last_clean":"2024-04-25T10:25:42.907367+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:25:42.907367+0000","last_undegraded":"2024-04-25T10:25:42.907367+0000","last_fullsized":"2024-04-25T10:25:42.907367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907166+0000","last_change":"2024-04-25T10:25:37.179746+0000","last_active":"2024-04-25T10:25:42.907166+0000","last_peered":"2024-04-25T10:25:42.907166+0000","last_clean":"2024-04-25T10:25:42.907166+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:25:42.907166+0000","last_undegraded":"2024-04-25T10:25:42.907166+0000","last_fullsized":"2024-04-25T10:25:42.907166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213170+0000","last_change":"2024-04-25T10:25:41.232828+0000","last_active":"2024-04-25T10:25:42.213170+0000","last_peered":"2024-04-25T10:25:42.213170+0000","last_clean":"2024-04-25T10:25:42.213170+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:25:42.213170+0000","last_undegraded":"2024-04-25T10:25:42.213170+0000","last_fullsized":"2024-04-25T10:25:42.213170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:01.782881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557901+0000","last_change":"2024-04-25T10:25:36.190035+0000","last_active":"2024-04-25T10:25:42.557901+0000","last_peered":"2024-04-25T10:25:42.557901+0000","last_clean":"2024-04-25T10:25:42.557901+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:25:42.557901+0000","last_undegraded":"2024-04-25T10:25:42.557901+0000","last_fullsized":"2024-04-25T10:25:42.557901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060790+0000","last_change":"2024-04-25T10:25:37.191742+0000","last_active":"2024-04-25T10:25:43.060790+0000","last_peered":"2024-04-25T10:25:43.060790+0000","last_clean":"2024-04-25T10:25:43.060790+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:25:43.060790+0000","last_undegraded":"2024-04-25T10:25:43.060790+0000","last_fullsized":"2024-04-25T10:25:43.060790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214077+0000","last_change":"2024-04-25T10:25:41.242444+0000","last_active":"2024-04-25T10:25:42.214077+0000","last_peered":"2024-04-25T10:25:42.214077+0000","last_clean":"2024-04-25T10:25:42.214077+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:25:42.214077+0000","last_undegraded":"2024-04-25T10:25:42.214077+0000","last_fullsized":"2024-04-25T10:25:42.214077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558215+0000","last_change":"2024-04-25T10:25:36.190527+0000","last_active":"2024-04-25T10:25:42.558215+0000","last_peered":"2024-04-25T10:25:42.558215+0000","last_clean":"2024-04-25T10:25:42.558215+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:25:42.558215+0000","last_undegraded":"2024-04-25T10:25:42.558215+0000","last_fullsized":"2024-04-25T10:25:42.558215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939821+0000","last_change":"2024-04-25T10:25:37.204468+0000","last_active":"2024-04-25T10:25:42.939821+0000","last_peered":"2024-04-25T10:25:42.939821+0000","last_clean":"2024-04-25T10:25:42.939821+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:25:42.939821+0000","last_undegraded":"2024-04-25T10:25:42.939821+0000","last_fullsized":"2024-04-25T10:25:42.939821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213229+0000","last_change":"2024-04-25T10:25:41.236518+0000","last_active":"2024-04-25T10:25:42.213229+0000","last_peered":"2024-04-25T10:25:42.213229+0000","last_clean":"2024-04-25T10:25:42.213229+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:25:42.213229+0000","last_undegraded":"2024-04-25T10:25:42.213229+0000","last_fullsized":"2024-04-25T10:25:42.213229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938344+0000","last_change":"2024-04-25T10:25:37.194114+0000","last_active":"2024-04-25T10:25:42.938344+0000","last_peered":"2024-04-25T10:25:42.938344+0000","last_clean":"2024-04-25T10:25:42.938344+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:25:42.938344+0000","last_undegraded":"2024-04-25T10:25:42.938344+0000","last_fullsized":"2024-04-25T10:25:42.938344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:40.192156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.349266+0000","last_change":"2024-04-25T10:25:36.188266+0000","last_active":"2024-04-25T10:26:14.349266+0000","last_peered":"2024-04-25T10:26:14.349266+0000","last_clean":"2024-04-25T10:26:14.349266+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:26:14.349266+0000","last_undegraded":"2024-04-25T10:26:14.349266+0000","last_fullsized":"2024-04-25T10:26:14.349266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.845953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939631+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:25:42.939631+0000","last_peered":"2024-04-25T10:25:42.939631+0000","last_clean":"2024-04-25T10:25:42.939631+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:25:42.939631+0000","last_undegraded":"2024-04-25T10:25:42.939631+0000","last_fullsized":"2024-04-25T10:25:42.939631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:13.684019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739296+0000","last_change":"2024-04-25T10:25:37.166002+0000","last_active":"2024-04-25T10:25:42.739296+0000","last_peered":"2024-04-25T10:25:42.739296+0000","last_clean":"2024-04-25T10:25:42.739296+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:25:42.739296+0000","last_undegraded":"2024-04-25T10:25:42.739296+0000","last_fullsized":"2024-04-25T10:25:42.739296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210956+0000","last_change":"2024-04-25T10:25:36.168204+0000","last_active":"2024-04-25T10:25:42.210956+0000","last_peered":"2024-04-25T10:25:42.210956+0000","last_clean":"2024-04-25T10:25:42.210956+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:25:42.210956+0000","last_undegraded":"2024-04-25T10:25:42.210956+0000","last_fullsized":"2024-04-25T10:25:42.210956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.907635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557959+0000","last_change":"2024-04-25T10:25:41.257264+0000","last_active":"2024-04-25T10:25:42.557959+0000","last_peered":"2024-04-25T10:25:42.557959+0000","last_clean":"2024-04-25T10:25:42.557959+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:25:42.557959+0000","last_undegraded":"2024-04-25T10:25:42.557959+0000","last_fullsized":"2024-04-25T10:25:42.557959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694025+0000","last_change":"2024-04-25T10:25:37.158884+0000","last_active":"2024-04-25T10:25:42.694025+0000","last_peered":"2024-04-25T10:25:42.694025+0000","last_clean":"2024-04-25T10:25:42.694025+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:25:42.694025+0000","last_undegraded":"2024-04-25T10:25:42.694025+0000","last_fullsized":"2024-04-25T10:25:42.694025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.342072+0000","last_change":"2024-04-25T10:25:36.173499+0000","last_active":"2024-04-25T10:26:14.342072+0000","last_peered":"2024-04-25T10:26:14.342072+0000","last_clean":"2024-04-25T10:26:14.342072+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:26:14.342072+0000","last_undegraded":"2024-04-25T10:26:14.342072+0000","last_fullsized":"2024-04-25T10:26:14.342072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739678+0000","last_change":"2024-04-25T10:25:41.239990+0000","last_active":"2024-04-25T10:25:42.739678+0000","last_peered":"2024-04-25T10:25:42.739678+0000","last_clean":"2024-04-25T10:25:42.739678+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:25:42.739678+0000","last_undegraded":"2024-04-25T10:25:42.739678+0000","last_fullsized":"2024-04-25T10:25:42.739678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:15.055786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938134+0000","last_change":"2024-04-25T10:25:37.193560+0000","last_active":"2024-04-25T10:25:42.938134+0000","last_peered":"2024-04-25T10:25:42.938134+0000","last_clean":"2024-04-25T10:25:42.938134+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:25:42.938134+0000","last_undegraded":"2024-04-25T10:25:42.938134+0000","last_fullsized":"2024-04-25T10:25:42.938134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.349153+0000","last_change":"2024-04-25T10:25:36.174077+0000","last_active":"2024-04-25T10:26:14.349153+0000","last_peered":"2024-04-25T10:26:14.349153+0000","last_clean":"2024-04-25T10:26:14.349153+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:26:14.349153+0000","last_undegraded":"2024-04-25T10:26:14.349153+0000","last_fullsized":"2024-04-25T10:26:14.349153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215236+0000","last_change":"2024-04-25T10:25:41.262158+0000","last_active":"2024-04-25T10:25:42.215236+0000","last_peered":"2024-04-25T10:25:42.215236+0000","last_clean":"2024-04-25T10:25:42.215236+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:25:42.215236+0000","last_undegraded":"2024-04-25T10:25:42.215236+0000","last_fullsized":"2024-04-25T10:25:42.215236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694651+0000","last_change":"2024-04-25T10:25:37.159876+0000","last_active":"2024-04-25T10:25:42.694651+0000","last_peered":"2024-04-25T10:25:42.694651+0000","last_clean":"2024-04-25T10:25:42.694651+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:25:42.694651+0000","last_undegraded":"2024-04-25T10:25:42.694651+0000","last_fullsized":"2024-04-25T10:25:42.694651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.344683+0000","last_change":"2024-04-25T10:25:36.194275+0000","last_active":"2024-04-25T10:26:14.344683+0000","last_peered":"2024-04-25T10:26:14.344683+0000","last_clean":"2024-04-25T10:26:14.344683+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:26:14.344683+0000","last_undegraded":"2024-04-25T10:26:14.344683+0000","last_fullsized":"2024-04-25T10:26:14.344683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213280+0000","last_change":"2024-04-25T10:25:41.261185+0000","last_active":"2024-04-25T10:25:42.213280+0000","last_peered":"2024-04-25T10:25:42.213280+0000","last_clean":"2024-04-25T10:25:42.213280+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:25:42.213280+0000","last_undegraded":"2024-04-25T10:25:42.213280+0000","last_fullsized":"2024-04-25T10:25:42.213280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694769+0000","last_change":"2024-04-25T10:25:37.165436+0000","last_active":"2024-04-25T10:25:42.694769+0000","last_peered":"2024-04-25T10:25:42.694769+0000","last_clean":"2024-04-25T10:25:42.694769+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:25:42.694769+0000","last_undegraded":"2024-04-25T10:25:42.694769+0000","last_fullsized":"2024-04-25T10:25:42.694769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694831+0000","last_change":"2024-04-25T10:25:36.181966+0000","last_active":"2024-04-25T10:25:42.694831+0000","last_peered":"2024-04-25T10:25:42.694831+0000","last_clean":"2024-04-25T10:25:42.694831+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:25:42.694831+0000","last_undegraded":"2024-04-25T10:25:42.694831+0000","last_fullsized":"2024-04-25T10:25:42.694831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694190+0000","last_change":"2024-04-25T10:25:41.246715+0000","last_active":"2024-04-25T10:25:42.694190+0000","last_peered":"2024-04-25T10:25:42.694190+0000","last_clean":"2024-04-25T10:25:42.694190+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:25:42.694190+0000","last_undegraded":"2024-04-25T10:25:42.694190+0000","last_fullsized":"2024-04-25T10:25:42.694190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:03.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211189+0000","last_change":"2024-04-25T10:25:37.170738+0000","last_active":"2024-04-25T10:25:42.211189+0000","last_peered":"2024-04-25T10:25:42.211189+0000","last_clean":"2024-04-25T10:25:42.211189+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:25:42.211189+0000","last_undegraded":"2024-04-25T10:25:42.211189+0000","last_fullsized":"2024-04-25T10:25:42.211189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:43.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940562+0000","last_change":"2024-04-25T10:25:36.186052+0000","last_active":"2024-04-25T10:25:42.940562+0000","last_peered":"2024-04-25T10:25:42.940562+0000","last_clean":"2024-04-25T10:25:42.940562+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:25:42.940562+0000","last_undegraded":"2024-04-25T10:25:42.940562+0000","last_fullsized":"2024-04-25T10:25:42.940562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:42.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210861+0000","last_change":"2024-04-25T10:25:41.244909+0000","last_active":"2024-04-25T10:25:42.210861+0000","last_peered":"2024-04-25T10:25:42.210861+0000","last_clean":"2024-04-25T10:25:42.210861+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:25:42.210861+0000","last_undegraded":"2024-04-25T10:25:42.210861+0000","last_fullsized":"2024-04-25T10:25:42.210861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214362+0000","last_change":"2024-04-25T10:25:37.181614+0000","last_active":"2024-04-25T10:25:42.214362+0000","last_peered":"2024-04-25T10:25:42.214362+0000","last_clean":"2024-04-25T10:25:42.214362+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:25:42.214362+0000","last_undegraded":"2024-04-25T10:25:42.214362+0000","last_fullsized":"2024-04-25T10:25:42.214362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906827+0000","last_change":"2024-04-25T10:25:36.166395+0000","last_active":"2024-04-25T10:25:42.906827+0000","last_peered":"2024-04-25T10:25:42.906827+0000","last_clean":"2024-04-25T10:25:42.906827+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:25:42.906827+0000","last_undegraded":"2024-04-25T10:25:42.906827+0000","last_fullsized":"2024-04-25T10:25:42.906827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210725+0000","last_change":"2024-04-25T10:25:41.237175+0000","last_active":"2024-04-25T10:25:42.210725+0000","last_peered":"2024-04-25T10:25:42.210725+0000","last_clean":"2024-04-25T10:25:42.210725+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:25:42.210725+0000","last_undegraded":"2024-04-25T10:25:42.210725+0000","last_fullsized":"2024-04-25T10:25:42.210725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557408+0000","last_change":"2024-04-25T10:25:37.192638+0000","last_active":"2024-04-25T10:25:42.557408+0000","last_peered":"2024-04-25T10:25:42.557408+0000","last_clean":"2024-04-25T10:25:42.557408+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:25:42.557408+0000","last_undegraded":"2024-04-25T10:25:42.557408+0000","last_fullsized":"2024-04-25T10:25:42.557408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938986+0000","last_change":"2024-04-25T10:25:36.182126+0000","last_active":"2024-04-25T10:25:42.938986+0000","last_peered":"2024-04-25T10:25:42.938986+0000","last_clean":"2024-04-25T10:25:42.938986+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:25:42.938986+0000","last_undegraded":"2024-04-25T10:25:42.938986+0000","last_fullsized":"2024-04-25T10:25:42.938986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:50.385012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211123+0000","last_change":"2024-04-25T10:25:41.247504+0000","last_active":"2024-04-25T10:25:42.211123+0000","last_peered":"2024-04-25T10:25:42.211123+0000","last_clean":"2024-04-25T10:25:42.211123+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:25:42.211123+0000","last_undegraded":"2024-04-25T10:25:42.211123+0000","last_fullsized":"2024-04-25T10:25:42.211123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906483+0000","last_change":"2024-04-25T10:25:37.171962+0000","last_active":"2024-04-25T10:25:42.906483+0000","last_peered":"2024-04-25T10:25:42.906483+0000","last_clean":"2024-04-25T10:25:42.906483+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:25:42.906483+0000","last_undegraded":"2024-04-25T10:25:42.906483+0000","last_fullsized":"2024-04-25T10:25:42.906483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739203+0000","last_change":"2024-04-25T10:25:36.167914+0000","last_active":"2024-04-25T10:25:42.739203+0000","last_peered":"2024-04-25T10:25:42.739203+0000","last_clean":"2024-04-25T10:25:42.739203+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:25:42.739203+0000","last_undegraded":"2024-04-25T10:25:42.739203+0000","last_fullsized":"2024-04-25T10:25:42.739203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211236+0000","last_change":"2024-04-25T10:25:41.250414+0000","last_active":"2024-04-25T10:25:42.211236+0000","last_peered":"2024-04-25T10:25:42.211236+0000","last_clean":"2024-04-25T10:25:42.211236+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:25:42.211236+0000","last_undegraded":"2024-04-25T10:25:42.211236+0000","last_fullsized":"2024-04-25T10:25:42.211236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210559+0000","last_change":"2024-04-25T10:25:37.179610+0000","last_active":"2024-04-25T10:25:42.210559+0000","last_peered":"2024-04-25T10:25:42.210559+0000","last_clean":"2024-04-25T10:25:42.210559+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:25:42.210559+0000","last_undegraded":"2024-04-25T10:25:42.210559+0000","last_fullsized":"2024-04-25T10:25:42.210559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:22.862181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938893+0000","last_change":"2024-04-25T10:25:36.187683+0000","last_active":"2024-04-25T10:25:42.938893+0000","last_peered":"2024-04-25T10:25:42.938893+0000","last_clean":"2024-04-25T10:25:42.938893+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:25:42.938893+0000","last_undegraded":"2024-04-25T10:25:42.938893+0000","last_fullsized":"2024-04-25T10:25:42.938893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907107+0000","last_change":"2024-04-25T10:25:41.239687+0000","last_active":"2024-04-25T10:25:42.907107+0000","last_peered":"2024-04-25T10:25:42.907107+0000","last_clean":"2024-04-25T10:25:42.907107+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:25:42.907107+0000","last_undegraded":"2024-04-25T10:25:42.907107+0000","last_fullsized":"2024-04-25T10:25:42.907107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.061875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694268+0000","last_change":"2024-04-25T10:25:37.172981+0000","last_active":"2024-04-25T10:25:42.694268+0000","last_peered":"2024-04-25T10:25:42.694268+0000","last_clean":"2024-04-25T10:25:42.694268+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:25:42.694268+0000","last_undegraded":"2024-04-25T10:25:42.694268+0000","last_fullsized":"2024-04-25T10:25:42.694268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"24'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.349377+0000","last_change":"2024-04-25T10:25:36.186586+0000","last_active":"2024-04-25T10:26:14.349377+0000","last_peered":"2024-04-25T10:26:14.349377+0000","last_clean":"2024-04-25T10:26:14.349377+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:26:14.349377+0000","last_undegraded":"2024-04-25T10:26:14.349377+0000","last_fullsized":"2024-04-25T10:26:14.349377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:00.696356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060315+0000","last_change":"2024-04-25T10:25:25.811918+0000","last_active":"2024-04-25T10:25:43.060315+0000","last_peered":"2024-04-25T10:25:43.060315+0000","last_clean":"2024-04-25T10:25:43.060315+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:25:43.060315+0000","last_undegraded":"2024-04-25T10:25:43.060315+0000","last_fullsized":"2024-04-25T10:25:43.060315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_clean_scrub_stamp":"2024-04-25T10:25:24.774439+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:46.603072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940494+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:25:42.940494+0000","last_peered":"2024-04-25T10:25:42.940494+0000","last_clean":"2024-04-25T10:25:42.940494+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:25:42.940494+0000","last_undegraded":"2024-04-25T10:25:42.940494+0000","last_fullsized":"2024-04-25T10:25:42.940494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:56.121358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940058+0000","last_change":"2024-04-25T10:25:37.187670+0000","last_active":"2024-04-25T10:25:42.940058+0000","last_peered":"2024-04-25T10:25:42.940058+0000","last_clean":"2024-04-25T10:25:42.940058+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:25:42.940058+0000","last_undegraded":"2024-04-25T10:25:42.940058+0000","last_fullsized":"2024-04-25T10:25:42.940058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:09.567527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211314+0000","last_change":"2024-04-25T10:25:36.190434+0000","last_active":"2024-04-25T10:25:42.211314+0000","last_peered":"2024-04-25T10:25:42.211314+0000","last_clean":"2024-04-25T10:25:42.211314+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:25:42.211314+0000","last_undegraded":"2024-04-25T10:25:42.211314+0000","last_fullsized":"2024-04-25T10:25:42.211314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213349+0000","last_change":"2024-04-25T10:25:41.249210+0000","last_active":"2024-04-25T10:25:42.213349+0000","last_peered":"2024-04-25T10:25:42.213349+0000","last_clean":"2024-04-25T10:25:42.213349+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:25:42.213349+0000","last_undegraded":"2024-04-25T10:25:42.213349+0000","last_fullsized":"2024-04-25T10:25:42.213349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558163+0000","last_change":"2024-04-25T10:25:37.176608+0000","last_active":"2024-04-25T10:25:42.558163+0000","last_peered":"2024-04-25T10:25:42.558163+0000","last_clean":"2024-04-25T10:25:42.558163+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:25:42.558163+0000","last_undegraded":"2024-04-25T10:25:42.558163+0000","last_fullsized":"2024-04-25T10:25:42.558163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907148+0000","last_change":"2024-04-25T10:25:36.175833+0000","last_active":"2024-04-25T10:25:42.907148+0000","last_peered":"2024-04-25T10:25:42.907148+0000","last_clean":"2024-04-25T10:25:42.907148+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:25:42.907148+0000","last_undegraded":"2024-04-25T10:25:42.907148+0000","last_fullsized":"2024-04-25T10:25:42.907148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906867+0000","last_change":"2024-04-25T10:25:41.256600+0000","last_active":"2024-04-25T10:25:42.906867+0000","last_peered":"2024-04-25T10:25:42.906867+0000","last_clean":"2024-04-25T10:25:42.906867+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:25:42.906867+0000","last_undegraded":"2024-04-25T10:25:42.906867+0000","last_fullsized":"2024-04-25T10:25:42.906867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557874+0000","last_change":"2024-04-25T10:25:37.185203+0000","last_active":"2024-04-25T10:25:42.557874+0000","last_peered":"2024-04-25T10:25:42.557874+0000","last_clean":"2024-04-25T10:25:42.557874+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:25:42.557874+0000","last_undegraded":"2024-04-25T10:25:42.557874+0000","last_fullsized":"2024-04-25T10:25:42.557874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694752+0000","last_change":"2024-04-25T10:25:36.168542+0000","last_active":"2024-04-25T10:25:42.694752+0000","last_peered":"2024-04-25T10:25:42.694752+0000","last_clean":"2024-04-25T10:25:42.694752+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:25:42.694752+0000","last_undegraded":"2024-04-25T10:25:42.694752+0000","last_fullsized":"2024-04-25T10:25:42.694752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938149+0000","last_change":"2024-04-25T10:25:41.242053+0000","last_active":"2024-04-25T10:25:42.938149+0000","last_peered":"2024-04-25T10:25:42.938149+0000","last_clean":"2024-04-25T10:25:42.938149+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:25:42.938149+0000","last_undegraded":"2024-04-25T10:25:42.938149+0000","last_fullsized":"2024-04-25T10:25:42.938149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:05.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215366+0000","last_change":"2024-04-25T10:25:37.198952+0000","last_active":"2024-04-25T10:25:42.215366+0000","last_peered":"2024-04-25T10:25:42.215366+0000","last_clean":"2024-04-25T10:25:42.215366+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:25:42.215366+0000","last_undegraded":"2024-04-25T10:25:42.215366+0000","last_fullsized":"2024-04-25T10:25:42.215366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557962+0000","last_change":"2024-04-25T10:25:36.179694+0000","last_active":"2024-04-25T10:25:42.557962+0000","last_peered":"2024-04-25T10:25:42.557962+0000","last_clean":"2024-04-25T10:25:42.557962+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:25:42.557962+0000","last_undegraded":"2024-04-25T10:25:42.557962+0000","last_fullsized":"2024-04-25T10:25:42.557962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.059908+0000","last_change":"2024-04-25T10:25:41.251379+0000","last_active":"2024-04-25T10:25:43.059908+0000","last_peered":"2024-04-25T10:25:43.059908+0000","last_clean":"2024-04-25T10:25:43.059908+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:25:43.059908+0000","last_undegraded":"2024-04-25T10:25:43.059908+0000","last_fullsized":"2024-04-25T10:25:43.059908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:47.690188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.937946+0000","last_change":"2024-04-25T10:25:37.202390+0000","last_active":"2024-04-25T10:25:42.937946+0000","last_peered":"2024-04-25T10:25:42.937946+0000","last_clean":"2024-04-25T10:25:42.937946+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:25:42.937946+0000","last_undegraded":"2024-04-25T10:25:42.937946+0000","last_fullsized":"2024-04-25T10:25:42.937946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'10","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.339154+0000","last_change":"2024-04-25T10:25:36.154879+0000","last_active":"2024-04-25T10:26:14.339154+0000","last_peered":"2024-04-25T10:26:14.339154+0000","last_clean":"2024-04-25T10:26:14.339154+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:26:14.339154+0000","last_undegraded":"2024-04-25T10:26:14.339154+0000","last_fullsized":"2024-04-25T10:26:14.339154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907317+0000","last_change":"2024-04-25T10:25:41.239631+0000","last_active":"2024-04-25T10:25:42.907317+0000","last_peered":"2024-04-25T10:25:42.907317+0000","last_clean":"2024-04-25T10:25:42.907317+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:25:42.907317+0000","last_undegraded":"2024-04-25T10:25:42.907317+0000","last_fullsized":"2024-04-25T10:25:42.907317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.684623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060223+0000","last_change":"2024-04-25T10:25:37.181525+0000","last_active":"2024-04-25T10:25:43.060223+0000","last_peered":"2024-04-25T10:25:43.060223+0000","last_clean":"2024-04-25T10:25:43.060223+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:25:43.060223+0000","last_undegraded":"2024-04-25T10:25:43.060223+0000","last_fullsized":"2024-04-25T10:25:43.060223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557280+0000","last_change":"2024-04-25T10:25:36.192797+0000","last_active":"2024-04-25T10:25:42.557280+0000","last_peered":"2024-04-25T10:25:42.557280+0000","last_clean":"2024-04-25T10:25:42.557280+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:25:42.557280+0000","last_undegraded":"2024-04-25T10:25:42.557280+0000","last_fullsized":"2024-04-25T10:25:42.557280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907235+0000","last_change":"2024-04-25T10:25:41.244618+0000","last_active":"2024-04-25T10:25:42.907235+0000","last_peered":"2024-04-25T10:25:42.907235+0000","last_clean":"2024-04-25T10:25:42.907235+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:25:42.907235+0000","last_undegraded":"2024-04-25T10:25:42.907235+0000","last_fullsized":"2024-04-25T10:25:42.907235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:13.625947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938496+0000","last_change":"2024-04-25T10:25:37.208984+0000","last_active":"2024-04-25T10:25:42.938496+0000","last_peered":"2024-04-25T10:25:42.938496+0000","last_clean":"2024-04-25T10:25:42.938496+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:25:42.938496+0000","last_undegraded":"2024-04-25T10:25:42.938496+0000","last_fullsized":"2024-04-25T10:25:42.938496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.346185+0000","last_change":"2024-04-25T10:25:36.185689+0000","last_active":"2024-04-25T10:26:14.346185+0000","last_peered":"2024-04-25T10:26:14.346185+0000","last_clean":"2024-04-25T10:26:14.346185+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:26:14.346185+0000","last_undegraded":"2024-04-25T10:26:14.346185+0000","last_fullsized":"2024-04-25T10:26:14.346185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:35.671970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211007+0000","last_change":"2024-04-25T10:25:41.247314+0000","last_active":"2024-04-25T10:25:42.211007+0000","last_peered":"2024-04-25T10:25:42.211007+0000","last_clean":"2024-04-25T10:25:42.211007+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:25:42.211007+0000","last_undegraded":"2024-04-25T10:25:42.211007+0000","last_fullsized":"2024-04-25T10:25:42.211007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210831+0000","last_change":"2024-04-25T10:25:37.193696+0000","last_active":"2024-04-25T10:25:42.210831+0000","last_peered":"2024-04-25T10:25:42.210831+0000","last_clean":"2024-04-25T10:25:42.210831+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:25:42.210831+0000","last_undegraded":"2024-04-25T10:25:42.210831+0000","last_fullsized":"2024-04-25T10:25:42.210831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.341455+0000","last_change":"2024-04-25T10:25:36.181843+0000","last_active":"2024-04-25T10:26:14.341455+0000","last_peered":"2024-04-25T10:26:14.341455+0000","last_clean":"2024-04-25T10:26:14.341455+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:26:14.341455+0000","last_undegraded":"2024-04-25T10:26:14.341455+0000","last_fullsized":"2024-04-25T10:26:14.341455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939937+0000","last_change":"2024-04-25T10:25:41.247061+0000","last_active":"2024-04-25T10:25:42.939937+0000","last_peered":"2024-04-25T10:25:42.939937+0000","last_clean":"2024-04-25T10:25:42.939937+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:25:42.939937+0000","last_undegraded":"2024-04-25T10:25:42.939937+0000","last_fullsized":"2024-04-25T10:25:42.939937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.491573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557676+0000","last_change":"2024-04-25T10:25:37.185402+0000","last_active":"2024-04-25T10:25:42.557676+0000","last_peered":"2024-04-25T10:25:42.557676+0000","last_clean":"2024-04-25T10:25:42.557676+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:25:42.557676+0000","last_undegraded":"2024-04-25T10:25:42.557676+0000","last_fullsized":"2024-04-25T10:25:42.557676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"24'12","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.345642+0000","last_change":"2024-04-25T10:25:36.166998+0000","last_active":"2024-04-25T10:26:14.345642+0000","last_peered":"2024-04-25T10:26:14.345642+0000","last_clean":"2024-04-25T10:26:14.345642+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:26:14.345642+0000","last_undegraded":"2024-04-25T10:26:14.345642+0000","last_fullsized":"2024-04-25T10:26:14.345642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:25.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694238+0000","last_change":"2024-04-25T10:25:41.248522+0000","last_active":"2024-04-25T10:25:42.694238+0000","last_peered":"2024-04-25T10:25:42.694238+0000","last_clean":"2024-04-25T10:25:42.694238+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:25:42.694238+0000","last_undegraded":"2024-04-25T10:25:42.694238+0000","last_fullsized":"2024-04-25T10:25:42.694238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:51.139406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938911+0000","last_change":"2024-04-25T10:25:37.196588+0000","last_active":"2024-04-25T10:25:42.938911+0000","last_peered":"2024-04-25T10:25:42.938911+0000","last_clean":"2024-04-25T10:25:42.938911+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:25:42.938911+0000","last_undegraded":"2024-04-25T10:25:42.938911+0000","last_fullsized":"2024-04-25T10:25:42.938911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:00.003456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739704+0000","last_change":"2024-04-25T10:25:36.156630+0000","last_active":"2024-04-25T10:25:42.739704+0000","last_peered":"2024-04-25T10:25:42.739704+0000","last_clean":"2024-04-25T10:25:42.739704+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:25:42.739704+0000","last_undegraded":"2024-04-25T10:25:42.739704+0000","last_fullsized":"2024-04-25T10:25:42.739704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214326+0000","last_change":"2024-04-25T10:25:41.261315+0000","last_active":"2024-04-25T10:25:42.214326+0000","last_peered":"2024-04-25T10:25:42.214326+0000","last_clean":"2024-04-25T10:25:42.214326+0000","last_became_active":"2024-04-25T10:25:41.260933+0000","last_became_peered":"2024-04-25T10:25:41.260933+0000","last_unstale":"2024-04-25T10:25:42.214326+0000","last_undegraded":"2024-04-25T10:25:42.214326+0000","last_fullsized":"2024-04-25T10:25:42.214326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907317+0000","last_change":"2024-04-25T10:25:37.187575+0000","last_active":"2024-04-25T10:25:42.907317+0000","last_peered":"2024-04-25T10:25:42.907317+0000","last_clean":"2024-04-25T10:25:42.907317+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:25:42.907317+0000","last_undegraded":"2024-04-25T10:25:42.907317+0000","last_fullsized":"2024-04-25T10:25:42.907317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.344373+0000","last_change":"2024-04-25T10:25:36.183582+0000","last_active":"2024-04-25T10:26:14.344373+0000","last_peered":"2024-04-25T10:26:14.344373+0000","last_clean":"2024-04-25T10:26:14.344373+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:26:14.344373+0000","last_undegraded":"2024-04-25T10:26:14.344373+0000","last_fullsized":"2024-04-25T10:26:14.344373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.738922+0000","last_change":"2024-04-25T10:25:41.238488+0000","last_active":"2024-04-25T10:25:42.738922+0000","last_peered":"2024-04-25T10:25:42.738922+0000","last_clean":"2024-04-25T10:25:42.738922+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:25:42.738922+0000","last_undegraded":"2024-04-25T10:25:42.738922+0000","last_fullsized":"2024-04-25T10:25:42.738922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:05.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215257+0000","last_change":"2024-04-25T10:25:37.192707+0000","last_active":"2024-04-25T10:25:42.215257+0000","last_peered":"2024-04-25T10:25:42.215257+0000","last_clean":"2024-04-25T10:25:42.215257+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:25:42.215257+0000","last_undegraded":"2024-04-25T10:25:42.215257+0000","last_fullsized":"2024-04-25T10:25:42.215257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.344284+0000","last_change":"2024-04-25T10:25:36.173755+0000","last_active":"2024-04-25T10:26:14.344284+0000","last_peered":"2024-04-25T10:26:14.344284+0000","last_clean":"2024-04-25T10:26:14.344284+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:26:14.344284+0000","last_undegraded":"2024-04-25T10:26:14.344284+0000","last_fullsized":"2024-04-25T10:26:14.344284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694479+0000","last_change":"2024-04-25T10:25:41.248983+0000","last_active":"2024-04-25T10:25:42.694479+0000","last_peered":"2024-04-25T10:25:42.694479+0000","last_clean":"2024-04-25T10:25:42.694479+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:25:42.694479+0000","last_undegraded":"2024-04-25T10:25:42.694479+0000","last_fullsized":"2024-04-25T10:25:42.694479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.880608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694655+0000","last_change":"2024-04-25T10:25:41.246692+0000","last_active":"2024-04-25T10:25:42.694655+0000","last_peered":"2024-04-25T10:25:42.694655+0000","last_clean":"2024-04-25T10:25:42.694655+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:25:42.694655+0000","last_undegraded":"2024-04-25T10:25:42.694655+0000","last_fullsized":"2024-04-25T10:25:42.694655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:44.250576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694263+0000","last_change":"2024-04-25T10:25:37.178691+0000","last_active":"2024-04-25T10:25:42.694263+0000","last_peered":"2024-04-25T10:25:42.694263+0000","last_clean":"2024-04-25T10:25:42.694263+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:25:42.694263+0000","last_undegraded":"2024-04-25T10:25:42.694263+0000","last_fullsized":"2024-04-25T10:25:42.694263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938531+0000","last_change":"2024-04-25T10:25:36.191338+0000","last_active":"2024-04-25T10:25:42.938531+0000","last_peered":"2024-04-25T10:25:42.938531+0000","last_clean":"2024-04-25T10:25:42.938531+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:25:42.938531+0000","last_undegraded":"2024-04-25T10:25:42.938531+0000","last_fullsized":"2024-04-25T10:25:42.938531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939550+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:25:42.939550+0000","last_peered":"2024-04-25T10:25:42.939550+0000","last_clean":"2024-04-25T10:25:42.939550+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:25:42.939550+0000","last_undegraded":"2024-04-25T10:25:42.939550+0000","last_fullsized":"2024-04-25T10:25:42.939550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:21.254459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906524+0000","last_change":"2024-04-25T10:25:37.170931+0000","last_active":"2024-04-25T10:25:42.906524+0000","last_peered":"2024-04-25T10:25:42.906524+0000","last_clean":"2024-04-25T10:25:42.906524+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:25:42.906524+0000","last_undegraded":"2024-04-25T10:25:42.906524+0000","last_fullsized":"2024-04-25T10:25:42.906524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210600+0000","last_change":"2024-04-25T10:25:36.173721+0000","last_active":"2024-04-25T10:25:42.210600+0000","last_peered":"2024-04-25T10:25:42.210600+0000","last_clean":"2024-04-25T10:25:42.210600+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:25:42.210600+0000","last_undegraded":"2024-04-25T10:25:42.210600+0000","last_fullsized":"2024-04-25T10:25:42.210600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:42.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938659+0000","last_change":"2024-04-25T10:25:36.195499+0000","last_active":"2024-04-25T10:25:42.938659+0000","last_peered":"2024-04-25T10:25:42.938659+0000","last_clean":"2024-04-25T10:25:42.938659+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:25:42.938659+0000","last_undegraded":"2024-04-25T10:25:42.938659+0000","last_fullsized":"2024-04-25T10:25:42.938659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:05.600702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694264+0000","last_change":"2024-04-25T10:25:37.180896+0000","last_active":"2024-04-25T10:25:42.694264+0000","last_peered":"2024-04-25T10:25:42.694264+0000","last_clean":"2024-04-25T10:25:42.694264+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:25:42.694264+0000","last_undegraded":"2024-04-25T10:25:42.694264+0000","last_fullsized":"2024-04-25T10:25:42.694264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694682+0000","last_change":"2024-04-25T10:25:41.231793+0000","last_active":"2024-04-25T10:25:42.694682+0000","last_peered":"2024-04-25T10:25:42.694682+0000","last_clean":"2024-04-25T10:25:42.694682+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:25:42.694682+0000","last_undegraded":"2024-04-25T10:25:42.694682+0000","last_fullsized":"2024-04-25T10:25:42.694682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:33.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.341748+0000","last_change":"2024-04-25T10:25:36.166742+0000","last_active":"2024-04-25T10:26:14.341748+0000","last_peered":"2024-04-25T10:26:14.341748+0000","last_clean":"2024-04-25T10:26:14.341748+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:26:14.341748+0000","last_undegraded":"2024-04-25T10:26:14.341748+0000","last_fullsized":"2024-04-25T10:26:14.341748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060207+0000","last_change":"2024-04-25T10:25:37.185699+0000","last_active":"2024-04-25T10:25:43.060207+0000","last_peered":"2024-04-25T10:25:43.060207+0000","last_clean":"2024-04-25T10:25:43.060207+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:25:43.060207+0000","last_undegraded":"2024-04-25T10:25:43.060207+0000","last_fullsized":"2024-04-25T10:25:43.060207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739632+0000","last_change":"2024-04-25T10:25:41.258191+0000","last_active":"2024-04-25T10:25:42.739632+0000","last_peered":"2024-04-25T10:25:42.739632+0000","last_clean":"2024-04-25T10:25:42.739632+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:25:42.739632+0000","last_undegraded":"2024-04-25T10:25:42.739632+0000","last_fullsized":"2024-04-25T10:25:42.739632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.479785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213165+0000","last_change":"2024-04-25T10:25:37.183192+0000","last_active":"2024-04-25T10:25:42.213165+0000","last_peered":"2024-04-25T10:25:42.213165+0000","last_clean":"2024-04-25T10:25:42.213165+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:25:42.213165+0000","last_undegraded":"2024-04-25T10:25:42.213165+0000","last_fullsized":"2024-04-25T10:25:42.213165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739050+0000","last_change":"2024-04-25T10:25:37.180242+0000","last_active":"2024-04-25T10:25:42.739050+0000","last_peered":"2024-04-25T10:25:42.739050+0000","last_clean":"2024-04-25T10:25:42.739050+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:25:42.739050+0000","last_undegraded":"2024-04-25T10:25:42.739050+0000","last_fullsized":"2024-04-25T10:25:42.739050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939126+0000","last_change":"2024-04-25T10:25:37.187312+0000","last_active":"2024-04-25T10:25:42.939126+0000","last_peered":"2024-04-25T10:25:42.939126+0000","last_clean":"2024-04-25T10:25:42.939126+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:25:42.939126+0000","last_undegraded":"2024-04-25T10:25:42.939126+0000","last_fullsized":"2024-04-25T10:25:42.939126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:22.595222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906846+0000","last_change":"2024-04-25T10:25:37.166351+0000","last_active":"2024-04-25T10:25:42.906846+0000","last_peered":"2024-04-25T10:25:42.906846+0000","last_clean":"2024-04-25T10:25:42.906846+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:25:42.906846+0000","last_undegraded":"2024-04-25T10:25:42.906846+0000","last_fullsized":"2024-04-25T10:25:42.906846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211208+0000","last_change":"2024-04-25T10:25:37.181021+0000","last_active":"2024-04-25T10:25:42.211208+0000","last_peered":"2024-04-25T10:25:42.211208+0000","last_clean":"2024-04-25T10:25:42.211208+0000","last_became_active":"2024-04-25T10:25:37.180457+0000","last_became_peered":"2024-04-25T10:25:37.180457+0000","last_unstale":"2024-04-25T10:25:42.211208+0000","last_undegraded":"2024-04-25T10:25:42.211208+0000","last_fullsized":"2024-04-25T10:25:42.211208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211379+0000","last_change":"2024-04-25T10:25:37.170647+0000","last_active":"2024-04-25T10:25:42.211379+0000","last_peered":"2024-04-25T10:25:42.211379+0000","last_clean":"2024-04-25T10:25:42.211379+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:25:42.211379+0000","last_undegraded":"2024-04-25T10:25:42.211379+0000","last_fullsized":"2024-04-25T10:25:42.211379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214987+0000","last_change":"2024-04-25T10:25:37.196676+0000","last_active":"2024-04-25T10:25:42.214987+0000","last_peered":"2024-04-25T10:25:42.214987+0000","last_clean":"2024-04-25T10:25:42.214987+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:25:42.214987+0000","last_undegraded":"2024-04-25T10:25:42.214987+0000","last_fullsized":"2024-04-25T10:25:42.214987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906997+0000","last_change":"2024-04-25T10:25:37.186567+0000","last_active":"2024-04-25T10:25:42.906997+0000","last_peered":"2024-04-25T10:25:42.906997+0000","last_clean":"2024-04-25T10:25:42.906997+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:25:42.906997+0000","last_undegraded":"2024-04-25T10:25:42.906997+0000","last_fullsized":"2024-04-25T10:25:42.906997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938137+0000","last_change":"2024-04-25T10:25:37.184887+0000","last_active":"2024-04-25T10:25:42.938137+0000","last_peered":"2024-04-25T10:25:42.938137+0000","last_clean":"2024-04-25T10:25:42.938137+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:25:42.938137+0000","last_undegraded":"2024-04-25T10:25:42.938137+0000","last_fullsized":"2024-04-25T10:25:42.938137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906496+0000","last_change":"2024-04-25T10:25:37.196649+0000","last_active":"2024-04-25T10:25:42.906496+0000","last_peered":"2024-04-25T10:25:42.906496+0000","last_clean":"2024-04-25T10:25:42.906496+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:25:42.906496+0000","last_undegraded":"2024-04-25T10:25:42.906496+0000","last_fullsized":"2024-04-25T10:25:42.906496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.059874+0000","last_change":"2024-04-25T10:25:37.192093+0000","last_active":"2024-04-25T10:25:43.059874+0000","last_peered":"2024-04-25T10:25:43.059874+0000","last_clean":"2024-04-25T10:25:43.059874+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:25:43.059874+0000","last_undegraded":"2024-04-25T10:25:43.059874+0000","last_fullsized":"2024-04-25T10:25:43.059874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694151+0000","last_change":"2024-04-25T10:25:37.184014+0000","last_active":"2024-04-25T10:25:42.694151+0000","last_peered":"2024-04-25T10:25:42.694151+0000","last_clean":"2024-04-25T10:25:42.694151+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:25:42.694151+0000","last_undegraded":"2024-04-25T10:25:42.694151+0000","last_fullsized":"2024-04-25T10:25:42.694151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:52.810612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558111+0000","last_change":"2024-04-25T10:25:37.187384+0000","last_active":"2024-04-25T10:25:42.558111+0000","last_peered":"2024-04-25T10:25:42.558111+0000","last_clean":"2024-04-25T10:25:42.558111+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:25:42.558111+0000","last_undegraded":"2024-04-25T10:25:42.558111+0000","last_fullsized":"2024-04-25T10:25:42.558111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940269+0000","last_change":"2024-04-25T10:25:37.195712+0000","last_active":"2024-04-25T10:25:42.940269+0000","last_peered":"2024-04-25T10:25:42.940269+0000","last_clean":"2024-04-25T10:25:42.940269+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:25:42.940269+0000","last_undegraded":"2024-04-25T10:25:42.940269+0000","last_fullsized":"2024-04-25T10:25:42.940269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:13.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739591+0000","last_change":"2024-04-25T10:25:37.198664+0000","last_active":"2024-04-25T10:25:42.739591+0000","last_peered":"2024-04-25T10:25:42.739591+0000","last_clean":"2024-04-25T10:25:42.739591+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:25:42.739591+0000","last_undegraded":"2024-04-25T10:25:42.739591+0000","last_fullsized":"2024-04-25T10:25:42.739591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939668+0000","last_change":"2024-04-25T10:25:37.203174+0000","last_active":"2024-04-25T10:25:42.939668+0000","last_peered":"2024-04-25T10:25:42.939668+0000","last_clean":"2024-04-25T10:25:42.939668+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:25:42.939668+0000","last_undegraded":"2024-04-25T10:25:42.939668+0000","last_fullsized":"2024-04-25T10:25:42.939668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:05.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.937977+0000","last_change":"2024-04-25T10:25:37.199911+0000","last_active":"2024-04-25T10:25:42.937977+0000","last_peered":"2024-04-25T10:25:42.937977+0000","last_clean":"2024-04-25T10:25:42.937977+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:25:42.937977+0000","last_undegraded":"2024-04-25T10:25:42.937977+0000","last_fullsized":"2024-04-25T10:25:42.937977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:29.272654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906404+0000","last_change":"2024-04-25T10:25:37.177405+0000","last_active":"2024-04-25T10:25:42.906404+0000","last_peered":"2024-04-25T10:25:42.906404+0000","last_clean":"2024-04-25T10:25:42.906404+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:25:42.906404+0000","last_undegraded":"2024-04-25T10:25:42.906404+0000","last_fullsized":"2024-04-25T10:25:42.906404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210795+0000","last_change":"2024-04-25T10:25:37.167752+0000","last_active":"2024-04-25T10:25:42.210795+0000","last_peered":"2024-04-25T10:25:42.210795+0000","last_clean":"2024-04-25T10:25:42.210795+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:25:42.210795+0000","last_undegraded":"2024-04-25T10:25:42.210795+0000","last_fullsized":"2024-04-25T10:25:42.210795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211127+0000","last_change":"2024-04-25T10:25:37.180781+0000","last_active":"2024-04-25T10:25:42.211127+0000","last_peered":"2024-04-25T10:25:42.211127+0000","last_clean":"2024-04-25T10:25:42.211127+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:25:42.211127+0000","last_undegraded":"2024-04-25T10:25:42.211127+0000","last_fullsized":"2024-04-25T10:25:42.211127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558079+0000","last_change":"2024-04-25T10:25:37.192759+0000","last_active":"2024-04-25T10:25:42.558079+0000","last_peered":"2024-04-25T10:25:42.558079+0000","last_clean":"2024-04-25T10:25:42.558079+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:25:42.558079+0000","last_undegraded":"2024-04-25T10:25:42.558079+0000","last_fullsized":"2024-04-25T10:25:42.558079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557604+0000","last_change":"2024-04-25T10:25:37.195532+0000","last_active":"2024-04-25T10:25:42.557604+0000","last_peered":"2024-04-25T10:25:42.557604+0000","last_clean":"2024-04-25T10:25:42.557604+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:25:42.557604+0000","last_undegraded":"2024-04-25T10:25:42.557604+0000","last_fullsized":"2024-04-25T10:25:42.557604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557494+0000","last_change":"2024-04-25T10:25:37.200331+0000","last_active":"2024-04-25T10:25:42.557494+0000","last_peered":"2024-04-25T10:25:42.557494+0000","last_clean":"2024-04-25T10:25:42.557494+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:25:42.557494+0000","last_undegraded":"2024-04-25T10:25:42.557494+0000","last_fullsized":"2024-04-25T10:25:42.557494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.062123+0000","last_change":"2024-04-25T10:25:37.194514+0000","last_active":"2024-04-25T10:25:43.062123+0000","last_peered":"2024-04-25T10:25:43.062123+0000","last_clean":"2024-04-25T10:25:43.062123+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:25:43.062123+0000","last_undegraded":"2024-04-25T10:25:43.062123+0000","last_fullsized":"2024-04-25T10:25:43.062123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906388+0000","last_change":"2024-04-25T10:25:37.177730+0000","last_active":"2024-04-25T10:25:42.906388+0000","last_peered":"2024-04-25T10:25:42.906388+0000","last_clean":"2024-04-25T10:25:42.906388+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:25:42.906388+0000","last_undegraded":"2024-04-25T10:25:42.906388+0000","last_fullsized":"2024-04-25T10:25:42.906388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557231+0000","last_change":"2024-04-25T10:25:37.173419+0000","last_active":"2024-04-25T10:25:42.557231+0000","last_peered":"2024-04-25T10:25:42.557231+0000","last_clean":"2024-04-25T10:25:42.557231+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:25:42.557231+0000","last_undegraded":"2024-04-25T10:25:42.557231+0000","last_fullsized":"2024-04-25T10:25:42.557231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213625+0000","last_change":"2024-04-25T10:25:37.182871+0000","last_active":"2024-04-25T10:25:42.213625+0000","last_peered":"2024-04-25T10:25:42.213625+0000","last_clean":"2024-04-25T10:25:42.213625+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:25:42.213625+0000","last_undegraded":"2024-04-25T10:25:42.213625+0000","last_fullsized":"2024-04-25T10:25:42.213625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557442+0000","last_change":"2024-04-25T10:25:37.173983+0000","last_active":"2024-04-25T10:25:42.557442+0000","last_peered":"2024-04-25T10:25:42.557442+0000","last_clean":"2024-04-25T10:25:42.557442+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:25:42.557442+0000","last_undegraded":"2024-04-25T10:25:42.557442+0000","last_fullsized":"2024-04-25T10:25:42.557442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213953+0000","last_change":"2024-04-25T10:25:37.182178+0000","last_active":"2024-04-25T10:25:42.213953+0000","last_peered":"2024-04-25T10:25:42.213953+0000","last_clean":"2024-04-25T10:25:42.213953+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:25:42.213953+0000","last_undegraded":"2024-04-25T10:25:42.213953+0000","last_fullsized":"2024-04-25T10:25:42.213953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907005+0000","last_change":"2024-04-25T10:25:37.170383+0000","last_active":"2024-04-25T10:25:42.907005+0000","last_peered":"2024-04-25T10:25:42.907005+0000","last_clean":"2024-04-25T10:25:42.907005+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:25:42.907005+0000","last_undegraded":"2024-04-25T10:25:42.907005+0000","last_fullsized":"2024-04-25T10:25:42.907005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907087+0000","last_change":"2024-04-25T10:25:37.167687+0000","last_active":"2024-04-25T10:25:42.907087+0000","last_peered":"2024-04-25T10:25:42.907087+0000","last_clean":"2024-04-25T10:25:42.907087+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:25:42.907087+0000","last_undegraded":"2024-04-25T10:25:42.907087+0000","last_fullsized":"2024-04-25T10:25:42.907087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557840+0000","last_change":"2024-04-25T10:25:37.196591+0000","last_active":"2024-04-25T10:25:42.557840+0000","last_peered":"2024-04-25T10:25:42.557840+0000","last_clean":"2024-04-25T10:25:42.557840+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:25:42.557840+0000","last_undegraded":"2024-04-25T10:25:42.557840+0000","last_fullsized":"2024-04-25T10:25:42.557840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":100970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":100886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":864256,"data_stored":691346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":105562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":100868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":856064,"data_stored":690792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":100410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:26:19.724 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:26:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.021+0000 7f7a1be00640 1 Processor -- start 2024-04-25T10:26:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.021+0000 7f7a1be00640 1 -- start start 2024-04-25T10:26:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.024+0000 7f7a1be00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a1c0c2640 0x7f7a1c0c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.024+0000 7f7a1be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a1c0c2a50 0x7f7a1c0c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.024+0000 7f7a1be00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a1c0c8340 con 0x7f7a1c1532c0 2024-04-25T10:26:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.024+0000 7f7a1be00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f7a1c0c9dc0 con 0x7f7a1c0c2640 2024-04-25T10:26:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.024+0000 7f7a1be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1c15c680 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.024+0000 7f7a1aa00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7a1c1532c0 0x7f7a1c072ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39824/0 (socket says 172.21.15.19:39824) 2024-04-25T10:26:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.024+0000 7f7a1aa00640 1 -- 172.21.15.19:0/109892026 learned_addr learned my addr 172.21.15.19:0/109892026 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.024+0000 7f7a13e00640 1 --2- 172.21.15.19:0/109892026 >> v2:172.21.15.19:3300/0 conn(0x7f7a1c0c2640 0x7f7a1c0c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.024+0000 7f7a1b400640 1 --2- 172.21.15.19:0/109892026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a1c0c2a50 0x7f7a1c0c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.025+0000 7f7a1a000640 1 -- 172.21.15.19:0/109892026 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044856853 0 0) 0x7f7a1c0c8340 con 0x7f7a1c1532c0 2024-04-25T10:26:20.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.025+0000 7f7a1a000640 1 -- 172.21.15.19:0/109892026 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a00003520 con 0x7f7a1c1532c0 2024-04-25T10:26:20.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.025+0000 7f7a13e00640 1 -- 172.21.15.19:0/109892026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a1c0c2a50 msgr2=0x7f7a1c0c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:20.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.025+0000 7f7a13e00640 1 --2- 172.21.15.19:0/109892026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a1c0c2a50 0x7f7a1c0c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.025+0000 7f7a13e00640 1 -- 172.21.15.19:0/109892026 >> v1:172.21.15.19:6789/0 conn(0x7f7a1c1532c0 legacy=0x7f7a1c072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.025+0000 7f7a13e00640 1 -- 172.21.15.19:0/109892026 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c15c960 con 0x7f7a1c0c2640 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.026+0000 7f7a13e00640 1 --2- 172.21.15.19:0/109892026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a1c0c2640 0x7f7a1c0c2fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7a040097a0 tx=0x7f7a0402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea8d278e0827bbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.026+0000 7f7a1a000640 1 -- 172.21.15.19:0/109892026 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a04037070 con 0x7f7a1c0c2640 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.026+0000 7f7a1a000640 1 -- 172.21.15.19:0/109892026 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a04032440 con 0x7f7a1c0c2640 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.026+0000 7f7a1a000640 1 -- 172.21.15.19:0/109892026 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a040327f0 con 0x7f7a1c0c2640 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.027+0000 7f7a1be00640 1 -- 172.21.15.19:0/109892026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a1c0c2640 msgr2=0x7f7a1c0c2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.027+0000 7f7a1be00640 1 --2- 172.21.15.19:0/109892026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a1c0c2640 0x7f7a1c0c2fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7a040097a0 tx=0x7f7a0402a180 comp rx=0 tx=0).stop 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.027+0000 7f7a1be00640 1 -- 172.21.15.19:0/109892026 shutdown_connections 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.027+0000 7f7a1be00640 1 --2- 172.21.15.19:0/109892026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a1c0c2a50 0x7f7a1c0c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.027+0000 7f7a1be00640 1 --2- 172.21.15.19:0/109892026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a1c0c2640 0x7f7a1c0c2fe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.027+0000 7f7a1be00640 1 -- 172.21.15.19:0/109892026 >> 172.21.15.19:0/109892026 conn(0x7f7a1c0cdbc0 msgr2=0x7f7a1c0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.027+0000 7f7a1be00640 1 -- 172.21.15.19:0/109892026 shutdown_connections 2024-04-25T10:26:20.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.027+0000 7f7a1be00640 1 -- 172.21.15.19:0/109892026 wait complete. 2024-04-25T10:26:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.029+0000 7f7a1be00640 1 Processor -- start 2024-04-25T10:26:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.029+0000 7f7a1be00640 1 -- start start 2024-04-25T10:26:20.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a1be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a1c0c2640 0x7f7a1c159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a1be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a1c0c2a50 0x7f7a1c1f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a1be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a1c1532c0 0x7f7a1c1e5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a1be00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c15d440 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a1be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c15cf20 con 0x7f7a1c0c2640 2024-04-25T10:26:20.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a1be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1c0c8620 con 0x7f7a1c1532c0 2024-04-25T10:26:20.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a13e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a1c0c2a50 0x7f7a1c1f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a13e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a1c0c2a50 0x7f7a1c1f0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41610/0 (socket says 172.21.15.19:41610) 2024-04-25T10:26:20.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a13e00640 1 -- 172.21.15.19:0/4057725719 learned_addr learned my addr 172.21.15.19:0/4057725719 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:20.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a1b400640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a1c1532c0 0x7f7a1c1e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a1aa00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a1c0c2640 0x7f7a1c159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a13e00640 1 -- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a1c1532c0 msgr2=0x7f7a1c1e5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.031+0000 7f7a13e00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a1c1532c0 0x7f7a1c1e5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.032+0000 7f7a13e00640 1 -- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a1c0c2640 msgr2=0x7f7a1c159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.032+0000 7f7a13e00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a1c0c2640 0x7f7a1c159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.032+0000 7f7a13e00640 1 -- 172.21.15.19:0/4057725719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c0c7290 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.032+0000 7f7a13e00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a1c0c2a50 0x7f7a1c1f0d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a040098c0 tx=0x7f7a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:20.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.032+0000 7f7a12a00640 1 -- 172.21.15.19:0/4057725719 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a04037040 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.032+0000 7f7a12a00640 1 -- 172.21.15.19:0/4057725719 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a040044c0 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.032+0000 7f7a12a00640 1 -- 172.21.15.19:0/4057725719 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a040325f0 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.032+0000 7f7a1be00640 1 -- 172.21.15.19:0/4057725719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1c1e4630 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.032+0000 7f7a1be00640 1 -- 172.21.15.19:0/4057725719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1c0cc190 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.033+0000 7f7a1be00640 1 -- 172.21.15.19:0/4057725719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a1c0c6fe0 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.035+0000 7f7a12a00640 1 -- 172.21.15.19:0/4057725719 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7a04044020 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.036+0000 7f7a12a00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f79f80744e0 0x7f79f80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.036+0000 7f7a12a00640 1 -- 172.21.15.19:0/4057725719 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f7a040b56a0 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.037+0000 7f7a1aa00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f79f80744e0 0x7f79f80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.037+0000 7f7a1aa00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f79f80744e0 0x7f79f80769f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c005880 tx=0x7f7a0c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:20.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.041+0000 7f7a12a00640 1 -- 172.21.15.19:0/4057725719 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7a0407f460 con 0x7f7a1c0c2a50 2024-04-25T10:26:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.235+0000 7f7a1be00640 1 -- 172.21.15.19:0/4057725719 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a1c0c7570 con 0x7f79f80744e0 2024-04-25T10:26:20.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.245+0000 7f7a12a00640 1 -- 172.21.15.19:0/4057725719 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332562 (secure 0 0 0) 0x7f7a1c0c7570 con 0x7f79f80744e0 2024-04-25T10:26:20.250 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:20.255 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.252+0000 7f7a1be00640 1 -- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f79f80744e0 msgr2=0x7f79f80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.252+0000 7f7a1be00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f79f80744e0 0x7f79f80769f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c005880 tx=0x7f7a0c009040 comp rx=0 tx=0).stop 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.252+0000 7f7a1be00640 1 -- 172.21.15.19:0/4057725719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a1c0c2a50 msgr2=0x7f7a1c1f0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.252+0000 7f7a1be00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a1c0c2a50 0x7f7a1c1f0d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a040098c0 tx=0x7f7a040046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.252+0000 7f7a1be00640 1 -- 172.21.15.19:0/4057725719 shutdown_connections 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.252+0000 7f7a1be00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f79f80744e0 0x7f79f80769f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.252+0000 7f7a1be00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7a1c1532c0 0x7f7a1c1e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.252+0000 7f7a1be00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a1c0c2a50 0x7f7a1c1f0d50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.252+0000 7f7a1be00640 1 --2- 172.21.15.19:0/4057725719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a1c0c2640 0x7f7a1c159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.252+0000 7f7a1be00640 1 -- 172.21.15.19:0/4057725719 >> 172.21.15.19:0/4057725719 conn(0x7f7a1c0cdbc0 msgr2=0x7f7a1c073710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.252+0000 7f7a1be00640 1 -- 172.21.15.19:0/4057725719 shutdown_connections 2024-04-25T10:26:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.253+0000 7f7a1be00640 1 -- 172.21.15.19:0/4057725719 wait complete. 2024-04-25T10:26:20.280 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-04-25T10:26:18.588488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":189,"num_write_kb":1659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3256,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3334144,"data_stored":1994940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002046"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694853+0000","last_change":"2024-04-25T10:25:36.182605+0000","last_active":"2024-04-25T10:25:42.694853+0000","last_peered":"2024-04-25T10:25:42.694853+0000","last_clean":"2024-04-25T10:25:42.694853+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:25:42.694853+0000","last_undegraded":"2024-04-25T10:25:42.694853+0000","last_fullsized":"2024-04-25T10:25:42.694853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907219+0000","last_change":"2024-04-25T10:25:37.199467+0000","last_active":"2024-04-25T10:25:42.907219+0000","last_peered":"2024-04-25T10:25:42.907219+0000","last_clean":"2024-04-25T10:25:42.907219+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:25:42.907219+0000","last_undegraded":"2024-04-25T10:25:42.907219+0000","last_fullsized":"2024-04-25T10:25:42.907219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739046+0000","last_change":"2024-04-25T10:25:41.234657+0000","last_active":"2024-04-25T10:25:42.739046+0000","last_peered":"2024-04-25T10:25:42.739046+0000","last_clean":"2024-04-25T10:25:42.739046+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:25:42.739046+0000","last_undegraded":"2024-04-25T10:25:42.739046+0000","last_fullsized":"2024-04-25T10:25:42.739046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:56.869031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907367+0000","last_change":"2024-04-25T10:25:36.166548+0000","last_active":"2024-04-25T10:25:42.907367+0000","last_peered":"2024-04-25T10:25:42.907367+0000","last_clean":"2024-04-25T10:25:42.907367+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:25:42.907367+0000","last_undegraded":"2024-04-25T10:25:42.907367+0000","last_fullsized":"2024-04-25T10:25:42.907367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907166+0000","last_change":"2024-04-25T10:25:37.179746+0000","last_active":"2024-04-25T10:25:42.907166+0000","last_peered":"2024-04-25T10:25:42.907166+0000","last_clean":"2024-04-25T10:25:42.907166+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:25:42.907166+0000","last_undegraded":"2024-04-25T10:25:42.907166+0000","last_fullsized":"2024-04-25T10:25:42.907166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213170+0000","last_change":"2024-04-25T10:25:41.232828+0000","last_active":"2024-04-25T10:25:42.213170+0000","last_peered":"2024-04-25T10:25:42.213170+0000","last_clean":"2024-04-25T10:25:42.213170+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:25:42.213170+0000","last_undegraded":"2024-04-25T10:25:42.213170+0000","last_fullsized":"2024-04-25T10:25:42.213170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:01.782881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557901+0000","last_change":"2024-04-25T10:25:36.190035+0000","last_active":"2024-04-25T10:25:42.557901+0000","last_peered":"2024-04-25T10:25:42.557901+0000","last_clean":"2024-04-25T10:25:42.557901+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:25:42.557901+0000","last_undegraded":"2024-04-25T10:25:42.557901+0000","last_fullsized":"2024-04-25T10:25:42.557901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060790+0000","last_change":"2024-04-25T10:25:37.191742+0000","last_active":"2024-04-25T10:25:43.060790+0000","last_peered":"2024-04-25T10:25:43.060790+0000","last_clean":"2024-04-25T10:25:43.060790+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:25:43.060790+0000","last_undegraded":"2024-04-25T10:25:43.060790+0000","last_fullsized":"2024-04-25T10:25:43.060790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214077+0000","last_change":"2024-04-25T10:25:41.242444+0000","last_active":"2024-04-25T10:25:42.214077+0000","last_peered":"2024-04-25T10:25:42.214077+0000","last_clean":"2024-04-25T10:25:42.214077+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:25:42.214077+0000","last_undegraded":"2024-04-25T10:25:42.214077+0000","last_fullsized":"2024-04-25T10:25:42.214077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558215+0000","last_change":"2024-04-25T10:25:36.190527+0000","last_active":"2024-04-25T10:25:42.558215+0000","last_peered":"2024-04-25T10:25:42.558215+0000","last_clean":"2024-04-25T10:25:42.558215+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:25:42.558215+0000","last_undegraded":"2024-04-25T10:25:42.558215+0000","last_fullsized":"2024-04-25T10:25:42.558215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939821+0000","last_change":"2024-04-25T10:25:37.204468+0000","last_active":"2024-04-25T10:25:42.939821+0000","last_peered":"2024-04-25T10:25:42.939821+0000","last_clean":"2024-04-25T10:25:42.939821+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:25:42.939821+0000","last_undegraded":"2024-04-25T10:25:42.939821+0000","last_fullsized":"2024-04-25T10:25:42.939821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213229+0000","last_change":"2024-04-25T10:25:41.236518+0000","last_active":"2024-04-25T10:25:42.213229+0000","last_peered":"2024-04-25T10:25:42.213229+0000","last_clean":"2024-04-25T10:25:42.213229+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:25:42.213229+0000","last_undegraded":"2024-04-25T10:25:42.213229+0000","last_fullsized":"2024-04-25T10:25:42.213229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938344+0000","last_change":"2024-04-25T10:25:37.194114+0000","last_active":"2024-04-25T10:25:42.938344+0000","last_peered":"2024-04-25T10:25:42.938344+0000","last_clean":"2024-04-25T10:25:42.938344+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:25:42.938344+0000","last_undegraded":"2024-04-25T10:25:42.938344+0000","last_fullsized":"2024-04-25T10:25:42.938344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:40.192156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.349266+0000","last_change":"2024-04-25T10:25:36.188266+0000","last_active":"2024-04-25T10:26:14.349266+0000","last_peered":"2024-04-25T10:26:14.349266+0000","last_clean":"2024-04-25T10:26:14.349266+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:26:14.349266+0000","last_undegraded":"2024-04-25T10:26:14.349266+0000","last_fullsized":"2024-04-25T10:26:14.349266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.845953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939631+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:25:42.939631+0000","last_peered":"2024-04-25T10:25:42.939631+0000","last_clean":"2024-04-25T10:25:42.939631+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:25:42.939631+0000","last_undegraded":"2024-04-25T10:25:42.939631+0000","last_fullsized":"2024-04-25T10:25:42.939631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:13.684019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739296+0000","last_change":"2024-04-25T10:25:37.166002+0000","last_active":"2024-04-25T10:25:42.739296+0000","last_peered":"2024-04-25T10:25:42.739296+0000","last_clean":"2024-04-25T10:25:42.739296+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:25:42.739296+0000","last_undegraded":"2024-04-25T10:25:42.739296+0000","last_fullsized":"2024-04-25T10:25:42.739296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210956+0000","last_change":"2024-04-25T10:25:36.168204+0000","last_active":"2024-04-25T10:25:42.210956+0000","last_peered":"2024-04-25T10:25:42.210956+0000","last_clean":"2024-04-25T10:25:42.210956+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:25:42.210956+0000","last_undegraded":"2024-04-25T10:25:42.210956+0000","last_fullsized":"2024-04-25T10:25:42.210956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.907635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557959+0000","last_change":"2024-04-25T10:25:41.257264+0000","last_active":"2024-04-25T10:25:42.557959+0000","last_peered":"2024-04-25T10:25:42.557959+0000","last_clean":"2024-04-25T10:25:42.557959+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:25:42.557959+0000","last_undegraded":"2024-04-25T10:25:42.557959+0000","last_fullsized":"2024-04-25T10:25:42.557959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694025+0000","last_change":"2024-04-25T10:25:37.158884+0000","last_active":"2024-04-25T10:25:42.694025+0000","last_peered":"2024-04-25T10:25:42.694025+0000","last_clean":"2024-04-25T10:25:42.694025+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:25:42.694025+0000","last_undegraded":"2024-04-25T10:25:42.694025+0000","last_fullsized":"2024-04-25T10:25:42.694025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.342072+0000","last_change":"2024-04-25T10:25:36.173499+0000","last_active":"2024-04-25T10:26:14.342072+0000","last_peered":"2024-04-25T10:26:14.342072+0000","last_clean":"2024-04-25T10:26:14.342072+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:26:14.342072+0000","last_undegraded":"2024-04-25T10:26:14.342072+0000","last_fullsized":"2024-04-25T10:26:14.342072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739678+0000","last_change":"2024-04-25T10:25:41.239990+0000","last_active":"2024-04-25T10:25:42.739678+0000","last_peered":"2024-04-25T10:25:42.739678+0000","last_clean":"2024-04-25T10:25:42.739678+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:25:42.739678+0000","last_undegraded":"2024-04-25T10:25:42.739678+0000","last_fullsized":"2024-04-25T10:25:42.739678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:15.055786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938134+0000","last_change":"2024-04-25T10:25:37.193560+0000","last_active":"2024-04-25T10:25:42.938134+0000","last_peered":"2024-04-25T10:25:42.938134+0000","last_clean":"2024-04-25T10:25:42.938134+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:25:42.938134+0000","last_undegraded":"2024-04-25T10:25:42.938134+0000","last_fullsized":"2024-04-25T10:25:42.938134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.349153+0000","last_change":"2024-04-25T10:25:36.174077+0000","last_active":"2024-04-25T10:26:14.349153+0000","last_peered":"2024-04-25T10:26:14.349153+0000","last_clean":"2024-04-25T10:26:14.349153+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:26:14.349153+0000","last_undegraded":"2024-04-25T10:26:14.349153+0000","last_fullsized":"2024-04-25T10:26:14.349153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215236+0000","last_change":"2024-04-25T10:25:41.262158+0000","last_active":"2024-04-25T10:25:42.215236+0000","last_peered":"2024-04-25T10:25:42.215236+0000","last_clean":"2024-04-25T10:25:42.215236+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:25:42.215236+0000","last_undegraded":"2024-04-25T10:25:42.215236+0000","last_fullsized":"2024-04-25T10:25:42.215236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694651+0000","last_change":"2024-04-25T10:25:37.159876+0000","last_active":"2024-04-25T10:25:42.694651+0000","last_peered":"2024-04-25T10:25:42.694651+0000","last_clean":"2024-04-25T10:25:42.694651+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:25:42.694651+0000","last_undegraded":"2024-04-25T10:25:42.694651+0000","last_fullsized":"2024-04-25T10:25:42.694651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.344683+0000","last_change":"2024-04-25T10:25:36.194275+0000","last_active":"2024-04-25T10:26:14.344683+0000","last_peered":"2024-04-25T10:26:14.344683+0000","last_clean":"2024-04-25T10:26:14.344683+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:26:14.344683+0000","last_undegraded":"2024-04-25T10:26:14.344683+0000","last_fullsized":"2024-04-25T10:26:14.344683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213280+0000","last_change":"2024-04-25T10:25:41.261185+0000","last_active":"2024-04-25T10:25:42.213280+0000","last_peered":"2024-04-25T10:25:42.213280+0000","last_clean":"2024-04-25T10:25:42.213280+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:25:42.213280+0000","last_undegraded":"2024-04-25T10:25:42.213280+0000","last_fullsized":"2024-04-25T10:25:42.213280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694769+0000","last_change":"2024-04-25T10:25:37.165436+0000","last_active":"2024-04-25T10:25:42.694769+0000","last_peered":"2024-04-25T10:25:42.694769+0000","last_clean":"2024-04-25T10:25:42.694769+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:25:42.694769+0000","last_undegraded":"2024-04-25T10:25:42.694769+0000","last_fullsized":"2024-04-25T10:25:42.694769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694831+0000","last_change":"2024-04-25T10:25:36.181966+0000","last_active":"2024-04-25T10:25:42.694831+0000","last_peered":"2024-04-25T10:25:42.694831+0000","last_clean":"2024-04-25T10:25:42.694831+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:25:42.694831+0000","last_undegraded":"2024-04-25T10:25:42.694831+0000","last_fullsized":"2024-04-25T10:25:42.694831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694190+0000","last_change":"2024-04-25T10:25:41.246715+0000","last_active":"2024-04-25T10:25:42.694190+0000","last_peered":"2024-04-25T10:25:42.694190+0000","last_clean":"2024-04-25T10:25:42.694190+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:25:42.694190+0000","last_undegraded":"2024-04-25T10:25:42.694190+0000","last_fullsized":"2024-04-25T10:25:42.694190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:03.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211189+0000","last_change":"2024-04-25T10:25:37.170738+0000","last_active":"2024-04-25T10:25:42.211189+0000","last_peered":"2024-04-25T10:25:42.211189+0000","last_clean":"2024-04-25T10:25:42.211189+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:25:42.211189+0000","last_undegraded":"2024-04-25T10:25:42.211189+0000","last_fullsized":"2024-04-25T10:25:42.211189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:43.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940562+0000","last_change":"2024-04-25T10:25:36.186052+0000","last_active":"2024-04-25T10:25:42.940562+0000","last_peered":"2024-04-25T10:25:42.940562+0000","last_clean":"2024-04-25T10:25:42.940562+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:25:42.940562+0000","last_undegraded":"2024-04-25T10:25:42.940562+0000","last_fullsized":"2024-04-25T10:25:42.940562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:42.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210861+0000","last_change":"2024-04-25T10:25:41.244909+0000","last_active":"2024-04-25T10:25:42.210861+0000","last_peered":"2024-04-25T10:25:42.210861+0000","last_clean":"2024-04-25T10:25:42.210861+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:25:42.210861+0000","last_undegraded":"2024-04-25T10:25:42.210861+0000","last_fullsized":"2024-04-25T10:25:42.210861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214362+0000","last_change":"2024-04-25T10:25:37.181614+0000","last_active":"2024-04-25T10:25:42.214362+0000","last_peered":"2024-04-25T10:25:42.214362+0000","last_clean":"2024-04-25T10:25:42.214362+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:25:42.214362+0000","last_undegraded":"2024-04-25T10:25:42.214362+0000","last_fullsized":"2024-04-25T10:25:42.214362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906827+0000","last_change":"2024-04-25T10:25:36.166395+0000","last_active":"2024-04-25T10:25:42.906827+0000","last_peered":"2024-04-25T10:25:42.906827+0000","last_clean":"2024-04-25T10:25:42.906827+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:25:42.906827+0000","last_undegraded":"2024-04-25T10:25:42.906827+0000","last_fullsized":"2024-04-25T10:25:42.906827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210725+0000","last_change":"2024-04-25T10:25:41.237175+0000","last_active":"2024-04-25T10:25:42.210725+0000","last_peered":"2024-04-25T10:25:42.210725+0000","last_clean":"2024-04-25T10:25:42.210725+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:25:42.210725+0000","last_undegraded":"2024-04-25T10:25:42.210725+0000","last_fullsized":"2024-04-25T10:25:42.210725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557408+0000","last_change":"2024-04-25T10:25:37.192638+0000","last_active":"2024-04-25T10:25:42.557408+0000","last_peered":"2024-04-25T10:25:42.557408+0000","last_clean":"2024-04-25T10:25:42.557408+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:25:42.557408+0000","last_undegraded":"2024-04-25T10:25:42.557408+0000","last_fullsized":"2024-04-25T10:25:42.557408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938986+0000","last_change":"2024-04-25T10:25:36.182126+0000","last_active":"2024-04-25T10:25:42.938986+0000","last_peered":"2024-04-25T10:25:42.938986+0000","last_clean":"2024-04-25T10:25:42.938986+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:25:42.938986+0000","last_undegraded":"2024-04-25T10:25:42.938986+0000","last_fullsized":"2024-04-25T10:25:42.938986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:50.385012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211123+0000","last_change":"2024-04-25T10:25:41.247504+0000","last_active":"2024-04-25T10:25:42.211123+0000","last_peered":"2024-04-25T10:25:42.211123+0000","last_clean":"2024-04-25T10:25:42.211123+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:25:42.211123+0000","last_undegraded":"2024-04-25T10:25:42.211123+0000","last_fullsized":"2024-04-25T10:25:42.211123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906483+0000","last_change":"2024-04-25T10:25:37.171962+0000","last_active":"2024-04-25T10:25:42.906483+0000","last_peered":"2024-04-25T10:25:42.906483+0000","last_clean":"2024-04-25T10:25:42.906483+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:25:42.906483+0000","last_undegraded":"2024-04-25T10:25:42.906483+0000","last_fullsized":"2024-04-25T10:25:42.906483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739203+0000","last_change":"2024-04-25T10:25:36.167914+0000","last_active":"2024-04-25T10:25:42.739203+0000","last_peered":"2024-04-25T10:25:42.739203+0000","last_clean":"2024-04-25T10:25:42.739203+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:25:42.739203+0000","last_undegraded":"2024-04-25T10:25:42.739203+0000","last_fullsized":"2024-04-25T10:25:42.739203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211236+0000","last_change":"2024-04-25T10:25:41.250414+0000","last_active":"2024-04-25T10:25:42.211236+0000","last_peered":"2024-04-25T10:25:42.211236+0000","last_clean":"2024-04-25T10:25:42.211236+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:25:42.211236+0000","last_undegraded":"2024-04-25T10:25:42.211236+0000","last_fullsized":"2024-04-25T10:25:42.211236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210559+0000","last_change":"2024-04-25T10:25:37.179610+0000","last_active":"2024-04-25T10:25:42.210559+0000","last_peered":"2024-04-25T10:25:42.210559+0000","last_clean":"2024-04-25T10:25:42.210559+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:25:42.210559+0000","last_undegraded":"2024-04-25T10:25:42.210559+0000","last_fullsized":"2024-04-25T10:25:42.210559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:22.862181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938893+0000","last_change":"2024-04-25T10:25:36.187683+0000","last_active":"2024-04-25T10:25:42.938893+0000","last_peered":"2024-04-25T10:25:42.938893+0000","last_clean":"2024-04-25T10:25:42.938893+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:25:42.938893+0000","last_undegraded":"2024-04-25T10:25:42.938893+0000","last_fullsized":"2024-04-25T10:25:42.938893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907107+0000","last_change":"2024-04-25T10:25:41.239687+0000","last_active":"2024-04-25T10:25:42.907107+0000","last_peered":"2024-04-25T10:25:42.907107+0000","last_clean":"2024-04-25T10:25:42.907107+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:25:42.907107+0000","last_undegraded":"2024-04-25T10:25:42.907107+0000","last_fullsized":"2024-04-25T10:25:42.907107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.061875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694268+0000","last_change":"2024-04-25T10:25:37.172981+0000","last_active":"2024-04-25T10:25:42.694268+0000","last_peered":"2024-04-25T10:25:42.694268+0000","last_clean":"2024-04-25T10:25:42.694268+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:25:42.694268+0000","last_undegraded":"2024-04-25T10:25:42.694268+0000","last_fullsized":"2024-04-25T10:25:42.694268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"24'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.349377+0000","last_change":"2024-04-25T10:25:36.186586+0000","last_active":"2024-04-25T10:26:14.349377+0000","last_peered":"2024-04-25T10:26:14.349377+0000","last_clean":"2024-04-25T10:26:14.349377+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:26:14.349377+0000","last_undegraded":"2024-04-25T10:26:14.349377+0000","last_fullsized":"2024-04-25T10:26:14.349377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:00.696356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060315+0000","last_change":"2024-04-25T10:25:25.811918+0000","last_active":"2024-04-25T10:25:43.060315+0000","last_peered":"2024-04-25T10:25:43.060315+0000","last_clean":"2024-04-25T10:25:43.060315+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:25:43.060315+0000","last_undegraded":"2024-04-25T10:25:43.060315+0000","last_fullsized":"2024-04-25T10:25:43.060315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_clean_scrub_stamp":"2024-04-25T10:25:24.774439+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:46.603072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940494+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:25:42.940494+0000","last_peered":"2024-04-25T10:25:42.940494+0000","last_clean":"2024-04-25T10:25:42.940494+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:25:42.940494+0000","last_undegraded":"2024-04-25T10:25:42.940494+0000","last_fullsized":"2024-04-25T10:25:42.940494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:56.121358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940058+0000","last_change":"2024-04-25T10:25:37.187670+0000","last_active":"2024-04-25T10:25:42.940058+0000","last_peered":"2024-04-25T10:25:42.940058+0000","last_clean":"2024-04-25T10:25:42.940058+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:25:42.940058+0000","last_undegraded":"2024-04-25T10:25:42.940058+0000","last_fullsized":"2024-04-25T10:25:42.940058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:09.567527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211314+0000","last_change":"2024-04-25T10:25:36.190434+0000","last_active":"2024-04-25T10:25:42.211314+0000","last_peered":"2024-04-25T10:25:42.211314+0000","last_clean":"2024-04-25T10:25:42.211314+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:25:42.211314+0000","last_undegraded":"2024-04-25T10:25:42.211314+0000","last_fullsized":"2024-04-25T10:25:42.211314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213349+0000","last_change":"2024-04-25T10:25:41.249210+0000","last_active":"2024-04-25T10:25:42.213349+0000","last_peered":"2024-04-25T10:25:42.213349+0000","last_clean":"2024-04-25T10:25:42.213349+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:25:42.213349+0000","last_undegraded":"2024-04-25T10:25:42.213349+0000","last_fullsized":"2024-04-25T10:25:42.213349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558163+0000","last_change":"2024-04-25T10:25:37.176608+0000","last_active":"2024-04-25T10:25:42.558163+0000","last_peered":"2024-04-25T10:25:42.558163+0000","last_clean":"2024-04-25T10:25:42.558163+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:25:42.558163+0000","last_undegraded":"2024-04-25T10:25:42.558163+0000","last_fullsized":"2024-04-25T10:25:42.558163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907148+0000","last_change":"2024-04-25T10:25:36.175833+0000","last_active":"2024-04-25T10:25:42.907148+0000","last_peered":"2024-04-25T10:25:42.907148+0000","last_clean":"2024-04-25T10:25:42.907148+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:25:42.907148+0000","last_undegraded":"2024-04-25T10:25:42.907148+0000","last_fullsized":"2024-04-25T10:25:42.907148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906867+0000","last_change":"2024-04-25T10:25:41.256600+0000","last_active":"2024-04-25T10:25:42.906867+0000","last_peered":"2024-04-25T10:25:42.906867+0000","last_clean":"2024-04-25T10:25:42.906867+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:25:42.906867+0000","last_undegraded":"2024-04-25T10:25:42.906867+0000","last_fullsized":"2024-04-25T10:25:42.906867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557874+0000","last_change":"2024-04-25T10:25:37.185203+0000","last_active":"2024-04-25T10:25:42.557874+0000","last_peered":"2024-04-25T10:25:42.557874+0000","last_clean":"2024-04-25T10:25:42.557874+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:25:42.557874+0000","last_undegraded":"2024-04-25T10:25:42.557874+0000","last_fullsized":"2024-04-25T10:25:42.557874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694752+0000","last_change":"2024-04-25T10:25:36.168542+0000","last_active":"2024-04-25T10:25:42.694752+0000","last_peered":"2024-04-25T10:25:42.694752+0000","last_clean":"2024-04-25T10:25:42.694752+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:25:42.694752+0000","last_undegraded":"2024-04-25T10:25:42.694752+0000","last_fullsized":"2024-04-25T10:25:42.694752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938149+0000","last_change":"2024-04-25T10:25:41.242053+0000","last_active":"2024-04-25T10:25:42.938149+0000","last_peered":"2024-04-25T10:25:42.938149+0000","last_clean":"2024-04-25T10:25:42.938149+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:25:42.938149+0000","last_undegraded":"2024-04-25T10:25:42.938149+0000","last_fullsized":"2024-04-25T10:25:42.938149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:05.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215366+0000","last_change":"2024-04-25T10:25:37.198952+0000","last_active":"2024-04-25T10:25:42.215366+0000","last_peered":"2024-04-25T10:25:42.215366+0000","last_clean":"2024-04-25T10:25:42.215366+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:25:42.215366+0000","last_undegraded":"2024-04-25T10:25:42.215366+0000","last_fullsized":"2024-04-25T10:25:42.215366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557962+0000","last_change":"2024-04-25T10:25:36.179694+0000","last_active":"2024-04-25T10:25:42.557962+0000","last_peered":"2024-04-25T10:25:42.557962+0000","last_clean":"2024-04-25T10:25:42.557962+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:25:42.557962+0000","last_undegraded":"2024-04-25T10:25:42.557962+0000","last_fullsized":"2024-04-25T10:25:42.557962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.059908+0000","last_change":"2024-04-25T10:25:41.251379+0000","last_active":"2024-04-25T10:25:43.059908+0000","last_peered":"2024-04-25T10:25:43.059908+0000","last_clean":"2024-04-25T10:25:43.059908+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:25:43.059908+0000","last_undegraded":"2024-04-25T10:25:43.059908+0000","last_fullsized":"2024-04-25T10:25:43.059908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:47.690188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.937946+0000","last_change":"2024-04-25T10:25:37.202390+0000","last_active":"2024-04-25T10:25:42.937946+0000","last_peered":"2024-04-25T10:25:42.937946+0000","last_clean":"2024-04-25T10:25:42.937946+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:25:42.937946+0000","last_undegraded":"2024-04-25T10:25:42.937946+0000","last_fullsized":"2024-04-25T10:25:42.937946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'10","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.339154+0000","last_change":"2024-04-25T10:25:36.154879+0000","last_active":"2024-04-25T10:26:14.339154+0000","last_peered":"2024-04-25T10:26:14.339154+0000","last_clean":"2024-04-25T10:26:14.339154+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:26:14.339154+0000","last_undegraded":"2024-04-25T10:26:14.339154+0000","last_fullsized":"2024-04-25T10:26:14.339154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907317+0000","last_change":"2024-04-25T10:25:41.239631+0000","last_active":"2024-04-25T10:25:42.907317+0000","last_peered":"2024-04-25T10:25:42.907317+0000","last_clean":"2024-04-25T10:25:42.907317+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:25:42.907317+0000","last_undegraded":"2024-04-25T10:25:42.907317+0000","last_fullsized":"2024-04-25T10:25:42.907317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.684623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060223+0000","last_change":"2024-04-25T10:25:37.181525+0000","last_active":"2024-04-25T10:25:43.060223+0000","last_peered":"2024-04-25T10:25:43.060223+0000","last_clean":"2024-04-25T10:25:43.060223+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:25:43.060223+0000","last_undegraded":"2024-04-25T10:25:43.060223+0000","last_fullsized":"2024-04-25T10:25:43.060223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557280+0000","last_change":"2024-04-25T10:25:36.192797+0000","last_active":"2024-04-25T10:25:42.557280+0000","last_peered":"2024-04-25T10:25:42.557280+0000","last_clean":"2024-04-25T10:25:42.557280+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:25:42.557280+0000","last_undegraded":"2024-04-25T10:25:42.557280+0000","last_fullsized":"2024-04-25T10:25:42.557280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907235+0000","last_change":"2024-04-25T10:25:41.244618+0000","last_active":"2024-04-25T10:25:42.907235+0000","last_peered":"2024-04-25T10:25:42.907235+0000","last_clean":"2024-04-25T10:25:42.907235+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:25:42.907235+0000","last_undegraded":"2024-04-25T10:25:42.907235+0000","last_fullsized":"2024-04-25T10:25:42.907235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:13.625947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938496+0000","last_change":"2024-04-25T10:25:37.208984+0000","last_active":"2024-04-25T10:25:42.938496+0000","last_peered":"2024-04-25T10:25:42.938496+0000","last_clean":"2024-04-25T10:25:42.938496+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:25:42.938496+0000","last_undegraded":"2024-04-25T10:25:42.938496+0000","last_fullsized":"2024-04-25T10:25:42.938496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.346185+0000","last_change":"2024-04-25T10:25:36.185689+0000","last_active":"2024-04-25T10:26:14.346185+0000","last_peered":"2024-04-25T10:26:14.346185+0000","last_clean":"2024-04-25T10:26:14.346185+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:26:14.346185+0000","last_undegraded":"2024-04-25T10:26:14.346185+0000","last_fullsized":"2024-04-25T10:26:14.346185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:35.671970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211007+0000","last_change":"2024-04-25T10:25:41.247314+0000","last_active":"2024-04-25T10:25:42.211007+0000","last_peered":"2024-04-25T10:25:42.211007+0000","last_clean":"2024-04-25T10:25:42.211007+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:25:42.211007+0000","last_undegraded":"2024-04-25T10:25:42.211007+0000","last_fullsized":"2024-04-25T10:25:42.211007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210831+0000","last_change":"2024-04-25T10:25:37.193696+0000","last_active":"2024-04-25T10:25:42.210831+0000","last_peered":"2024-04-25T10:25:42.210831+0000","last_clean":"2024-04-25T10:25:42.210831+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:25:42.210831+0000","last_undegraded":"2024-04-25T10:25:42.210831+0000","last_fullsized":"2024-04-25T10:25:42.210831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.341455+0000","last_change":"2024-04-25T10:25:36.181843+0000","last_active":"2024-04-25T10:26:14.341455+0000","last_peered":"2024-04-25T10:26:14.341455+0000","last_clean":"2024-04-25T10:26:14.341455+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:26:14.341455+0000","last_undegraded":"2024-04-25T10:26:14.341455+0000","last_fullsized":"2024-04-25T10:26:14.341455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939937+0000","last_change":"2024-04-25T10:25:41.247061+0000","last_active":"2024-04-25T10:25:42.939937+0000","last_peered":"2024-04-25T10:25:42.939937+0000","last_clean":"2024-04-25T10:25:42.939937+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:25:42.939937+0000","last_undegraded":"2024-04-25T10:25:42.939937+0000","last_fullsized":"2024-04-25T10:25:42.939937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.491573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557676+0000","last_change":"2024-04-25T10:25:37.185402+0000","last_active":"2024-04-25T10:25:42.557676+0000","last_peered":"2024-04-25T10:25:42.557676+0000","last_clean":"2024-04-25T10:25:42.557676+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:25:42.557676+0000","last_undegraded":"2024-04-25T10:25:42.557676+0000","last_fullsized":"2024-04-25T10:25:42.557676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"24'12","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.345642+0000","last_change":"2024-04-25T10:25:36.166998+0000","last_active":"2024-04-25T10:26:14.345642+0000","last_peered":"2024-04-25T10:26:14.345642+0000","last_clean":"2024-04-25T10:26:14.345642+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:26:14.345642+0000","last_undegraded":"2024-04-25T10:26:14.345642+0000","last_fullsized":"2024-04-25T10:26:14.345642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:25.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694238+0000","last_change":"2024-04-25T10:25:41.248522+0000","last_active":"2024-04-25T10:25:42.694238+0000","last_peered":"2024-04-25T10:25:42.694238+0000","last_clean":"2024-04-25T10:25:42.694238+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:25:42.694238+0000","last_undegraded":"2024-04-25T10:25:42.694238+0000","last_fullsized":"2024-04-25T10:25:42.694238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:51.139406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938911+0000","last_change":"2024-04-25T10:25:37.196588+0000","last_active":"2024-04-25T10:25:42.938911+0000","last_peered":"2024-04-25T10:25:42.938911+0000","last_clean":"2024-04-25T10:25:42.938911+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:25:42.938911+0000","last_undegraded":"2024-04-25T10:25:42.938911+0000","last_fullsized":"2024-04-25T10:25:42.938911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:00.003456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739704+0000","last_change":"2024-04-25T10:25:36.156630+0000","last_active":"2024-04-25T10:25:42.739704+0000","last_peered":"2024-04-25T10:25:42.739704+0000","last_clean":"2024-04-25T10:25:42.739704+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:25:42.739704+0000","last_undegraded":"2024-04-25T10:25:42.739704+0000","last_fullsized":"2024-04-25T10:25:42.739704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214326+0000","last_change":"2024-04-25T10:25:41.261315+0000","last_active":"2024-04-25T10:25:42.214326+0000","last_peered":"2024-04-25T10:25:42.214326+0000","last_clean":"2024-04-25T10:25:42.214326+0000","last_became_active":"2024-04-25T10:25:41.260933+0000","last_became_peered":"2024-04-25T10:25:41.260933+0000","last_unstale":"2024-04-25T10:25:42.214326+0000","last_undegraded":"2024-04-25T10:25:42.214326+0000","last_fullsized":"2024-04-25T10:25:42.214326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907317+0000","last_change":"2024-04-25T10:25:37.187575+0000","last_active":"2024-04-25T10:25:42.907317+0000","last_peered":"2024-04-25T10:25:42.907317+0000","last_clean":"2024-04-25T10:25:42.907317+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:25:42.907317+0000","last_undegraded":"2024-04-25T10:25:42.907317+0000","last_fullsized":"2024-04-25T10:25:42.907317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.344373+0000","last_change":"2024-04-25T10:25:36.183582+0000","last_active":"2024-04-25T10:26:14.344373+0000","last_peered":"2024-04-25T10:26:14.344373+0000","last_clean":"2024-04-25T10:26:14.344373+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:26:14.344373+0000","last_undegraded":"2024-04-25T10:26:14.344373+0000","last_fullsized":"2024-04-25T10:26:14.344373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.738922+0000","last_change":"2024-04-25T10:25:41.238488+0000","last_active":"2024-04-25T10:25:42.738922+0000","last_peered":"2024-04-25T10:25:42.738922+0000","last_clean":"2024-04-25T10:25:42.738922+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:25:42.738922+0000","last_undegraded":"2024-04-25T10:25:42.738922+0000","last_fullsized":"2024-04-25T10:25:42.738922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:05.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.215257+0000","last_change":"2024-04-25T10:25:37.192707+0000","last_active":"2024-04-25T10:25:42.215257+0000","last_peered":"2024-04-25T10:25:42.215257+0000","last_clean":"2024-04-25T10:25:42.215257+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:25:42.215257+0000","last_undegraded":"2024-04-25T10:25:42.215257+0000","last_fullsized":"2024-04-25T10:25:42.215257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.344284+0000","last_change":"2024-04-25T10:25:36.173755+0000","last_active":"2024-04-25T10:26:14.344284+0000","last_peered":"2024-04-25T10:26:14.344284+0000","last_clean":"2024-04-25T10:26:14.344284+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:26:14.344284+0000","last_undegraded":"2024-04-25T10:26:14.344284+0000","last_fullsized":"2024-04-25T10:26:14.344284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694479+0000","last_change":"2024-04-25T10:25:41.248983+0000","last_active":"2024-04-25T10:25:42.694479+0000","last_peered":"2024-04-25T10:25:42.694479+0000","last_clean":"2024-04-25T10:25:42.694479+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:25:42.694479+0000","last_undegraded":"2024-04-25T10:25:42.694479+0000","last_fullsized":"2024-04-25T10:25:42.694479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.880608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694655+0000","last_change":"2024-04-25T10:25:41.246692+0000","last_active":"2024-04-25T10:25:42.694655+0000","last_peered":"2024-04-25T10:25:42.694655+0000","last_clean":"2024-04-25T10:25:42.694655+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:25:42.694655+0000","last_undegraded":"2024-04-25T10:25:42.694655+0000","last_fullsized":"2024-04-25T10:25:42.694655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:44.250576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694263+0000","last_change":"2024-04-25T10:25:37.178691+0000","last_active":"2024-04-25T10:25:42.694263+0000","last_peered":"2024-04-25T10:25:42.694263+0000","last_clean":"2024-04-25T10:25:42.694263+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:25:42.694263+0000","last_undegraded":"2024-04-25T10:25:42.694263+0000","last_fullsized":"2024-04-25T10:25:42.694263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938531+0000","last_change":"2024-04-25T10:25:36.191338+0000","last_active":"2024-04-25T10:25:42.938531+0000","last_peered":"2024-04-25T10:25:42.938531+0000","last_clean":"2024-04-25T10:25:42.938531+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:25:42.938531+0000","last_undegraded":"2024-04-25T10:25:42.938531+0000","last_fullsized":"2024-04-25T10:25:42.938531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939550+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:25:42.939550+0000","last_peered":"2024-04-25T10:25:42.939550+0000","last_clean":"2024-04-25T10:25:42.939550+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:25:42.939550+0000","last_undegraded":"2024-04-25T10:25:42.939550+0000","last_fullsized":"2024-04-25T10:25:42.939550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:21.254459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906524+0000","last_change":"2024-04-25T10:25:37.170931+0000","last_active":"2024-04-25T10:25:42.906524+0000","last_peered":"2024-04-25T10:25:42.906524+0000","last_clean":"2024-04-25T10:25:42.906524+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:25:42.906524+0000","last_undegraded":"2024-04-25T10:25:42.906524+0000","last_fullsized":"2024-04-25T10:25:42.906524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210600+0000","last_change":"2024-04-25T10:25:36.173721+0000","last_active":"2024-04-25T10:25:42.210600+0000","last_peered":"2024-04-25T10:25:42.210600+0000","last_clean":"2024-04-25T10:25:42.210600+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:25:42.210600+0000","last_undegraded":"2024-04-25T10:25:42.210600+0000","last_fullsized":"2024-04-25T10:25:42.210600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:42.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938659+0000","last_change":"2024-04-25T10:25:36.195499+0000","last_active":"2024-04-25T10:25:42.938659+0000","last_peered":"2024-04-25T10:25:42.938659+0000","last_clean":"2024-04-25T10:25:42.938659+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:25:42.938659+0000","last_undegraded":"2024-04-25T10:25:42.938659+0000","last_fullsized":"2024-04-25T10:25:42.938659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:05.600702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694264+0000","last_change":"2024-04-25T10:25:37.180896+0000","last_active":"2024-04-25T10:25:42.694264+0000","last_peered":"2024-04-25T10:25:42.694264+0000","last_clean":"2024-04-25T10:25:42.694264+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:25:42.694264+0000","last_undegraded":"2024-04-25T10:25:42.694264+0000","last_fullsized":"2024-04-25T10:25:42.694264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694682+0000","last_change":"2024-04-25T10:25:41.231793+0000","last_active":"2024-04-25T10:25:42.694682+0000","last_peered":"2024-04-25T10:25:42.694682+0000","last_clean":"2024-04-25T10:25:42.694682+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:25:42.694682+0000","last_undegraded":"2024-04-25T10:25:42.694682+0000","last_fullsized":"2024-04-25T10:25:42.694682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:33.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:26:14.341748+0000","last_change":"2024-04-25T10:25:36.166742+0000","last_active":"2024-04-25T10:26:14.341748+0000","last_peered":"2024-04-25T10:26:14.341748+0000","last_clean":"2024-04-25T10:26:14.341748+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:26:14.341748+0000","last_undegraded":"2024-04-25T10:26:14.341748+0000","last_fullsized":"2024-04-25T10:26:14.341748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.060207+0000","last_change":"2024-04-25T10:25:37.185699+0000","last_active":"2024-04-25T10:25:43.060207+0000","last_peered":"2024-04-25T10:25:43.060207+0000","last_clean":"2024-04-25T10:25:43.060207+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:25:43.060207+0000","last_undegraded":"2024-04-25T10:25:43.060207+0000","last_fullsized":"2024-04-25T10:25:43.060207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739632+0000","last_change":"2024-04-25T10:25:41.258191+0000","last_active":"2024-04-25T10:25:42.739632+0000","last_peered":"2024-04-25T10:25:42.739632+0000","last_clean":"2024-04-25T10:25:42.739632+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:25:42.739632+0000","last_undegraded":"2024-04-25T10:25:42.739632+0000","last_fullsized":"2024-04-25T10:25:42.739632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.479785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213165+0000","last_change":"2024-04-25T10:25:37.183192+0000","last_active":"2024-04-25T10:25:42.213165+0000","last_peered":"2024-04-25T10:25:42.213165+0000","last_clean":"2024-04-25T10:25:42.213165+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:25:42.213165+0000","last_undegraded":"2024-04-25T10:25:42.213165+0000","last_fullsized":"2024-04-25T10:25:42.213165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739050+0000","last_change":"2024-04-25T10:25:37.180242+0000","last_active":"2024-04-25T10:25:42.739050+0000","last_peered":"2024-04-25T10:25:42.739050+0000","last_clean":"2024-04-25T10:25:42.739050+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:25:42.739050+0000","last_undegraded":"2024-04-25T10:25:42.739050+0000","last_fullsized":"2024-04-25T10:25:42.739050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939126+0000","last_change":"2024-04-25T10:25:37.187312+0000","last_active":"2024-04-25T10:25:42.939126+0000","last_peered":"2024-04-25T10:25:42.939126+0000","last_clean":"2024-04-25T10:25:42.939126+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:25:42.939126+0000","last_undegraded":"2024-04-25T10:25:42.939126+0000","last_fullsized":"2024-04-25T10:25:42.939126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:22.595222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906846+0000","last_change":"2024-04-25T10:25:37.166351+0000","last_active":"2024-04-25T10:25:42.906846+0000","last_peered":"2024-04-25T10:25:42.906846+0000","last_clean":"2024-04-25T10:25:42.906846+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:25:42.906846+0000","last_undegraded":"2024-04-25T10:25:42.906846+0000","last_fullsized":"2024-04-25T10:25:42.906846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211208+0000","last_change":"2024-04-25T10:25:37.181021+0000","last_active":"2024-04-25T10:25:42.211208+0000","last_peered":"2024-04-25T10:25:42.211208+0000","last_clean":"2024-04-25T10:25:42.211208+0000","last_became_active":"2024-04-25T10:25:37.180457+0000","last_became_peered":"2024-04-25T10:25:37.180457+0000","last_unstale":"2024-04-25T10:25:42.211208+0000","last_undegraded":"2024-04-25T10:25:42.211208+0000","last_fullsized":"2024-04-25T10:25:42.211208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211379+0000","last_change":"2024-04-25T10:25:37.170647+0000","last_active":"2024-04-25T10:25:42.211379+0000","last_peered":"2024-04-25T10:25:42.211379+0000","last_clean":"2024-04-25T10:25:42.211379+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:25:42.211379+0000","last_undegraded":"2024-04-25T10:25:42.211379+0000","last_fullsized":"2024-04-25T10:25:42.211379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.214987+0000","last_change":"2024-04-25T10:25:37.196676+0000","last_active":"2024-04-25T10:25:42.214987+0000","last_peered":"2024-04-25T10:25:42.214987+0000","last_clean":"2024-04-25T10:25:42.214987+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:25:42.214987+0000","last_undegraded":"2024-04-25T10:25:42.214987+0000","last_fullsized":"2024-04-25T10:25:42.214987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906997+0000","last_change":"2024-04-25T10:25:37.186567+0000","last_active":"2024-04-25T10:25:42.906997+0000","last_peered":"2024-04-25T10:25:42.906997+0000","last_clean":"2024-04-25T10:25:42.906997+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:25:42.906997+0000","last_undegraded":"2024-04-25T10:25:42.906997+0000","last_fullsized":"2024-04-25T10:25:42.906997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.938137+0000","last_change":"2024-04-25T10:25:37.184887+0000","last_active":"2024-04-25T10:25:42.938137+0000","last_peered":"2024-04-25T10:25:42.938137+0000","last_clean":"2024-04-25T10:25:42.938137+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:25:42.938137+0000","last_undegraded":"2024-04-25T10:25:42.938137+0000","last_fullsized":"2024-04-25T10:25:42.938137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906496+0000","last_change":"2024-04-25T10:25:37.196649+0000","last_active":"2024-04-25T10:25:42.906496+0000","last_peered":"2024-04-25T10:25:42.906496+0000","last_clean":"2024-04-25T10:25:42.906496+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:25:42.906496+0000","last_undegraded":"2024-04-25T10:25:42.906496+0000","last_fullsized":"2024-04-25T10:25:42.906496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.059874+0000","last_change":"2024-04-25T10:25:37.192093+0000","last_active":"2024-04-25T10:25:43.059874+0000","last_peered":"2024-04-25T10:25:43.059874+0000","last_clean":"2024-04-25T10:25:43.059874+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:25:43.059874+0000","last_undegraded":"2024-04-25T10:25:43.059874+0000","last_fullsized":"2024-04-25T10:25:43.059874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.694151+0000","last_change":"2024-04-25T10:25:37.184014+0000","last_active":"2024-04-25T10:25:42.694151+0000","last_peered":"2024-04-25T10:25:42.694151+0000","last_clean":"2024-04-25T10:25:42.694151+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:25:42.694151+0000","last_undegraded":"2024-04-25T10:25:42.694151+0000","last_fullsized":"2024-04-25T10:25:42.694151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:52.810612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558111+0000","last_change":"2024-04-25T10:25:37.187384+0000","last_active":"2024-04-25T10:25:42.558111+0000","last_peered":"2024-04-25T10:25:42.558111+0000","last_clean":"2024-04-25T10:25:42.558111+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:25:42.558111+0000","last_undegraded":"2024-04-25T10:25:42.558111+0000","last_fullsized":"2024-04-25T10:25:42.558111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.940269+0000","last_change":"2024-04-25T10:25:37.195712+0000","last_active":"2024-04-25T10:25:42.940269+0000","last_peered":"2024-04-25T10:25:42.940269+0000","last_clean":"2024-04-25T10:25:42.940269+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:25:42.940269+0000","last_undegraded":"2024-04-25T10:25:42.940269+0000","last_fullsized":"2024-04-25T10:25:42.940269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:13.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.739591+0000","last_change":"2024-04-25T10:25:37.198664+0000","last_active":"2024-04-25T10:25:42.739591+0000","last_peered":"2024-04-25T10:25:42.739591+0000","last_clean":"2024-04-25T10:25:42.739591+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:25:42.739591+0000","last_undegraded":"2024-04-25T10:25:42.739591+0000","last_fullsized":"2024-04-25T10:25:42.739591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.939668+0000","last_change":"2024-04-25T10:25:37.203174+0000","last_active":"2024-04-25T10:25:42.939668+0000","last_peered":"2024-04-25T10:25:42.939668+0000","last_clean":"2024-04-25T10:25:42.939668+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:25:42.939668+0000","last_undegraded":"2024-04-25T10:25:42.939668+0000","last_fullsized":"2024-04-25T10:25:42.939668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:05.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.937977+0000","last_change":"2024-04-25T10:25:37.199911+0000","last_active":"2024-04-25T10:25:42.937977+0000","last_peered":"2024-04-25T10:25:42.937977+0000","last_clean":"2024-04-25T10:25:42.937977+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:25:42.937977+0000","last_undegraded":"2024-04-25T10:25:42.937977+0000","last_fullsized":"2024-04-25T10:25:42.937977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:29.272654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906404+0000","last_change":"2024-04-25T10:25:37.177405+0000","last_active":"2024-04-25T10:25:42.906404+0000","last_peered":"2024-04-25T10:25:42.906404+0000","last_clean":"2024-04-25T10:25:42.906404+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:25:42.906404+0000","last_undegraded":"2024-04-25T10:25:42.906404+0000","last_fullsized":"2024-04-25T10:25:42.906404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.210795+0000","last_change":"2024-04-25T10:25:37.167752+0000","last_active":"2024-04-25T10:25:42.210795+0000","last_peered":"2024-04-25T10:25:42.210795+0000","last_clean":"2024-04-25T10:25:42.210795+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:25:42.210795+0000","last_undegraded":"2024-04-25T10:25:42.210795+0000","last_fullsized":"2024-04-25T10:25:42.210795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.211127+0000","last_change":"2024-04-25T10:25:37.180781+0000","last_active":"2024-04-25T10:25:42.211127+0000","last_peered":"2024-04-25T10:25:42.211127+0000","last_clean":"2024-04-25T10:25:42.211127+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:25:42.211127+0000","last_undegraded":"2024-04-25T10:25:42.211127+0000","last_fullsized":"2024-04-25T10:25:42.211127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.558079+0000","last_change":"2024-04-25T10:25:37.192759+0000","last_active":"2024-04-25T10:25:42.558079+0000","last_peered":"2024-04-25T10:25:42.558079+0000","last_clean":"2024-04-25T10:25:42.558079+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:25:42.558079+0000","last_undegraded":"2024-04-25T10:25:42.558079+0000","last_fullsized":"2024-04-25T10:25:42.558079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557604+0000","last_change":"2024-04-25T10:25:37.195532+0000","last_active":"2024-04-25T10:25:42.557604+0000","last_peered":"2024-04-25T10:25:42.557604+0000","last_clean":"2024-04-25T10:25:42.557604+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:25:42.557604+0000","last_undegraded":"2024-04-25T10:25:42.557604+0000","last_fullsized":"2024-04-25T10:25:42.557604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557494+0000","last_change":"2024-04-25T10:25:37.200331+0000","last_active":"2024-04-25T10:25:42.557494+0000","last_peered":"2024-04-25T10:25:42.557494+0000","last_clean":"2024-04-25T10:25:42.557494+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:25:42.557494+0000","last_undegraded":"2024-04-25T10:25:42.557494+0000","last_fullsized":"2024-04-25T10:25:42.557494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:43.062123+0000","last_change":"2024-04-25T10:25:37.194514+0000","last_active":"2024-04-25T10:25:43.062123+0000","last_peered":"2024-04-25T10:25:43.062123+0000","last_clean":"2024-04-25T10:25:43.062123+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:25:43.062123+0000","last_undegraded":"2024-04-25T10:25:43.062123+0000","last_fullsized":"2024-04-25T10:25:43.062123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.906388+0000","last_change":"2024-04-25T10:25:37.177730+0000","last_active":"2024-04-25T10:25:42.906388+0000","last_peered":"2024-04-25T10:25:42.906388+0000","last_clean":"2024-04-25T10:25:42.906388+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:25:42.906388+0000","last_undegraded":"2024-04-25T10:25:42.906388+0000","last_fullsized":"2024-04-25T10:25:42.906388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557231+0000","last_change":"2024-04-25T10:25:37.173419+0000","last_active":"2024-04-25T10:25:42.557231+0000","last_peered":"2024-04-25T10:25:42.557231+0000","last_clean":"2024-04-25T10:25:42.557231+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:25:42.557231+0000","last_undegraded":"2024-04-25T10:25:42.557231+0000","last_fullsized":"2024-04-25T10:25:42.557231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213625+0000","last_change":"2024-04-25T10:25:37.182871+0000","last_active":"2024-04-25T10:25:42.213625+0000","last_peered":"2024-04-25T10:25:42.213625+0000","last_clean":"2024-04-25T10:25:42.213625+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:25:42.213625+0000","last_undegraded":"2024-04-25T10:25:42.213625+0000","last_fullsized":"2024-04-25T10:25:42.213625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557442+0000","last_change":"2024-04-25T10:25:37.173983+0000","last_active":"2024-04-25T10:25:42.557442+0000","last_peered":"2024-04-25T10:25:42.557442+0000","last_clean":"2024-04-25T10:25:42.557442+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:25:42.557442+0000","last_undegraded":"2024-04-25T10:25:42.557442+0000","last_fullsized":"2024-04-25T10:25:42.557442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.213953+0000","last_change":"2024-04-25T10:25:37.182178+0000","last_active":"2024-04-25T10:25:42.213953+0000","last_peered":"2024-04-25T10:25:42.213953+0000","last_clean":"2024-04-25T10:25:42.213953+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:25:42.213953+0000","last_undegraded":"2024-04-25T10:25:42.213953+0000","last_fullsized":"2024-04-25T10:25:42.213953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907005+0000","last_change":"2024-04-25T10:25:37.170383+0000","last_active":"2024-04-25T10:25:42.907005+0000","last_peered":"2024-04-25T10:25:42.907005+0000","last_clean":"2024-04-25T10:25:42.907005+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:25:42.907005+0000","last_undegraded":"2024-04-25T10:25:42.907005+0000","last_fullsized":"2024-04-25T10:25:42.907005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.907087+0000","last_change":"2024-04-25T10:25:37.167687+0000","last_active":"2024-04-25T10:25:42.907087+0000","last_peered":"2024-04-25T10:25:42.907087+0000","last_clean":"2024-04-25T10:25:42.907087+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:25:42.907087+0000","last_undegraded":"2024-04-25T10:25:42.907087+0000","last_fullsized":"2024-04-25T10:25:42.907087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T10:25:42.557840+0000","last_change":"2024-04-25T10:25:37.196591+0000","last_active":"2024-04-25T10:25:42.557840+0000","last_peered":"2024-04-25T10:25:42.557840+0000","last_clean":"2024-04-25T10:25:42.557840+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:25:42.557840+0000","last_undegraded":"2024-04-25T10:25:42.557840+0000","last_fullsized":"2024-04-25T10:25:42.557840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":100970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":100886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":864256,"data_stored":691346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":105562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":100868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":856064,"data_stored":690792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":100410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:26:20.285 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T10:26:20.285 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T10:26:20.285 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T10:26:20.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:26:20.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.585+0000 7fd0a3e00640 1 Processor -- start 2024-04-25T10:26:20.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.586+0000 7fd0a3e00640 1 -- start start 2024-04-25T10:26:20.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.588+0000 7fd0a3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0a40c7d50 0x7fd0a415a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.588+0000 7fd0a3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd0a40c8160 0x7fd0a415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.588+0000 7fd0a3e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a40c8680 con 0x7fd0a4154500 2024-04-25T10:26:20.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.588+0000 7fd0a3e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd0a40c8940 con 0x7fd0a40c7d50 2024-04-25T10:26:20.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.588+0000 7fd0a3e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd0a40c8c20 con 0x7fd0a40c8160 2024-04-25T10:26:20.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.588+0000 7fd09be00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0a40c7d50 0x7fd0a415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.588+0000 7fd0a3400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd0a40c8160 0x7fd0a415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.588+0000 7fd0a3400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd0a40c8160 0x7fd0a415ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37094/0 (socket says 172.21.15.19:37094) 2024-04-25T10:26:20.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.588+0000 7fd0a3400640 1 -- 172.21.15.19:0/4022499714 learned_addr learned my addr 172.21.15.19:0/4022499714 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:20.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.589+0000 7fd0a3400640 1 -- 172.21.15.19:0/4022499714 >> v2:172.21.15.19:3300/0 conn(0x7fd0a40c7d50 msgr2=0x7fd0a415a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:20.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.589+0000 7fd0a3400640 1 --2- 172.21.15.19:0/4022499714 >> v2:172.21.15.19:3300/0 conn(0x7fd0a40c7d50 0x7fd0a415a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.589+0000 7fd0a3400640 1 -- 172.21.15.19:0/4022499714 >> v1:172.21.15.19:6789/0 conn(0x7fd0a4154500 legacy=0x7fd0a4072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.589+0000 7fd0a3400640 1 -- 172.21.15.19:0/4022499714 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a40c8f00 con 0x7fd0a40c8160 2024-04-25T10:26:20.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.590+0000 7fd0a3400640 1 --2- 172.21.15.19:0/4022499714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0a40c8160 0x7fd0a415ad40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40b3970 tx=0x7fd09c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2e391db496e92b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:20.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.590+0000 7fd0a2000640 1 -- 172.21.15.19:0/4022499714 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c036070 con 0x7fd0a40c8160 2024-04-25T10:26:20.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.590+0000 7fd0a2000640 1 -- 172.21.15.19:0/4022499714 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd09c031600 con 0x7fd0a40c8160 2024-04-25T10:26:20.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.590+0000 7fd0a2000640 1 -- 172.21.15.19:0/4022499714 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c0319d0 con 0x7fd0a40c8160 2024-04-25T10:26:20.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.591+0000 7fd0a3e00640 1 -- 172.21.15.19:0/4022499714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0a40c8160 msgr2=0x7fd0a415ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.591+0000 7fd0a3e00640 1 --2- 172.21.15.19:0/4022499714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0a40c8160 0x7fd0a415ad40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40b3970 tx=0x7fd09c02a730 comp rx=0 tx=0).stop 2024-04-25T10:26:20.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.591+0000 7fd0a3e00640 1 -- 172.21.15.19:0/4022499714 shutdown_connections 2024-04-25T10:26:20.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.591+0000 7fd0a3e00640 1 --2- 172.21.15.19:0/4022499714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0a40c8160 0x7fd0a415ad40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.591+0000 7fd0a3e00640 1 --2- 172.21.15.19:0/4022499714 >> v2:172.21.15.19:3300/0 conn(0x7fd0a40c7d50 0x7fd0a415a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.591+0000 7fd0a3e00640 1 -- 172.21.15.19:0/4022499714 >> 172.21.15.19:0/4022499714 conn(0x7fd0a4070d10 msgr2=0x7fd0a4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:20.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.591+0000 7fd0a3e00640 1 -- 172.21.15.19:0/4022499714 shutdown_connections 2024-04-25T10:26:20.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.591+0000 7fd0a3e00640 1 -- 172.21.15.19:0/4022499714 wait complete. 2024-04-25T10:26:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.593+0000 7fd0a3e00640 1 Processor -- start 2024-04-25T10:26:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.594+0000 7fd0a3e00640 1 -- start start 2024-04-25T10:26:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.595+0000 7fd0a3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a40c7d50 0x7fd0a40af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.595+0000 7fd0a3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd0a4154500 0x7fd0a40cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.595+0000 7fd0a3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0a41586a0 0x7fd0a41596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.595+0000 7fd0a3e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a40ca210 con 0x7fd0a40c7d50 2024-04-25T10:26:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.595+0000 7fd0a3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a40ca090 con 0x7fd0a41586a0 2024-04-25T10:26:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.595+0000 7fd0a3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a40ca390 con 0x7fd0a4154500 2024-04-25T10:26:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.595+0000 7fd0a2a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a40c7d50 0x7fd0a40af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.595+0000 7fd0a2a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a40c7d50 0x7fd0a40af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41634/0 (socket says 172.21.15.19:41634) 2024-04-25T10:26:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.595+0000 7fd0a2a00640 1 -- 172.21.15.19:0/342701986 learned_addr learned my addr 172.21.15.19:0/342701986 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.596+0000 7fd0a3400640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0a41586a0 0x7fd0a41596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.596+0000 7fd09be00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd0a4154500 0x7fd0a40cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.596+0000 7fd0a2a00640 1 -- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd0a4154500 msgr2=0x7fd0a40cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.596+0000 7fd0a2a00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd0a4154500 0x7fd0a40cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.596+0000 7fd0a2a00640 1 -- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0a41586a0 msgr2=0x7fd0a41596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.596+0000 7fd0a2a00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0a41586a0 0x7fd0a41596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.596+0000 7fd0a2a00640 1 -- 172.21.15.19:0/342701986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a40afb40 con 0x7fd0a40c7d50 2024-04-25T10:26:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.596+0000 7fd0a2a00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a40c7d50 0x7fd0a40af600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd09400c3c0 tx=0x7fd09400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.596+0000 7fd09b400640 1 -- 172.21.15.19:0/342701986 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0940052d0 con 0x7fd0a40c7d50 2024-04-25T10:26:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.596+0000 7fd09b400640 1 -- 172.21.15.19:0/342701986 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd094005490 con 0x7fd0a40c7d50 2024-04-25T10:26:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.597+0000 7fd09b400640 1 -- 172.21.15.19:0/342701986 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd094007260 con 0x7fd0a40c7d50 2024-04-25T10:26:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.597+0000 7fd0a3e00640 1 -- 172.21.15.19:0/342701986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a414e480 con 0x7fd0a40c7d50 2024-04-25T10:26:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.597+0000 7fd0a3e00640 1 -- 172.21.15.19:0/342701986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a414d710 con 0x7fd0a40c7d50 2024-04-25T10:26:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.598+0000 7fd0a3e00640 1 -- 172.21.15.19:0/342701986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a41534c0 con 0x7fd0a40c7d50 2024-04-25T10:26:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.599+0000 7fd09b400640 1 -- 172.21.15.19:0/342701986 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd094007400 con 0x7fd0a40c7d50 2024-04-25T10:26:20.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.600+0000 7fd09b400640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0800744b0 0x7fd0800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:20.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.600+0000 7fd09b400640 1 -- 172.21.15.19:0/342701986 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fd094094a50 con 0x7fd0a40c7d50 2024-04-25T10:26:20.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.600+0000 7fd09be00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0800744b0 0x7fd0800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:20.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.601+0000 7fd09be00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0800744b0 0x7fd0800769c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40c4090 tx=0x7fd08c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:20.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.609+0000 7fd09b400640 1 -- 172.21.15.19:0/342701986 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd0a41534c0 con 0x7fd0a40c7d50 2024-04-25T10:26:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.853+0000 7fd0a3e00640 1 -- 172.21.15.19:0/342701986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd0a4050740 con 0x7fd0a40c7d50 2024-04-25T10:26:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.854+0000 7fd09b400640 1 -- 172.21.15.19:0/342701986 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd09405e810 con 0x7fd0a40c7d50 2024-04-25T10:26:20.856 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:20.857 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T10:26:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.857+0000 7fd0a3e00640 1 -- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0800744b0 msgr2=0x7fd0800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.857+0000 7fd0a3e00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0800744b0 0x7fd0800769c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40c4090 tx=0x7fd08c009190 comp rx=0 tx=0).stop 2024-04-25T10:26:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.857+0000 7fd0a3e00640 1 -- 172.21.15.19:0/342701986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a40c7d50 msgr2=0x7fd0a40af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.857+0000 7fd0a3e00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a40c7d50 0x7fd0a40af600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd09400c3c0 tx=0x7fd09400c880 comp rx=0 tx=0).stop 2024-04-25T10:26:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.857+0000 7fd0a3e00640 1 -- 172.21.15.19:0/342701986 shutdown_connections 2024-04-25T10:26:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.857+0000 7fd0a3e00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0a41586a0 0x7fd0a41596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.857+0000 7fd0a3e00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd0800744b0 0x7fd0800769c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.857+0000 7fd0a3e00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd0a4154500 0x7fd0a40cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.857+0000 7fd0a3e00640 1 --2- 172.21.15.19:0/342701986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a40c7d50 0x7fd0a40af600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.857+0000 7fd0a3e00640 1 -- 172.21.15.19:0/342701986 >> 172.21.15.19:0/342701986 conn(0x7fd0a4070d10 msgr2=0x7fd0a40b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.857+0000 7fd0a3e00640 1 -- 172.21.15.19:0/342701986 shutdown_connections 2024-04-25T10:26:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:20.858+0000 7fd0a3e00640 1 -- 172.21.15.19:0/342701986 wait complete. 2024-04-25T10:26:20.902 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T10:26:20.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:21.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.162+0000 7f2e3e000640 1 Processor -- start 2024-04-25T10:26:21.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.162+0000 7f2e3e000640 1 -- start start 2024-04-25T10:26:21.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.164+0000 7f2e3e000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e380b4090 0x7f2e380b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:21.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.164+0000 7f2e3e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e380ccdc0 0x7f2e380cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:21.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.164+0000 7f2e3e000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e3815c5f0 con 0x7f2e381567a0 2024-04-25T10:26:21.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.164+0000 7f2e3e000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2e380cd1d0 con 0x7f2e380b4090 2024-04-25T10:26:21.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.164+0000 7f2e3e000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3815c8d0 con 0x7f2e380ccdc0 2024-04-25T10:26:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.164+0000 7f2e3cc00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e380b4090 0x7f2e380b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.164+0000 7f2e37e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2e381567a0 0x7f2e380b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:52100/0 (socket says 172.21.15.19:52100) 2024-04-25T10:26:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.164+0000 7f2e37e00640 1 -- 172.21.15.19:0/3800464957 learned_addr learned my addr 172.21.15.19:0/3800464957 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.165+0000 7f2e3d600640 1 --2- 172.21.15.19:0/3800464957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e380ccdc0 0x7f2e380cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.165+0000 7f2e37400640 1 -- 172.21.15.19:0/3800464957 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277687418 0 0) 0x7f2e3815c5f0 con 0x7f2e381567a0 2024-04-25T10:26:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.165+0000 7f2e37400640 1 -- 172.21.15.19:0/3800464957 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e20003520 con 0x7f2e381567a0 2024-04-25T10:26:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.165+0000 7f2e3cc00640 1 -- 172.21.15.19:0/3800464957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e380ccdc0 msgr2=0x7f2e380cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:21.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.165+0000 7f2e3cc00640 1 --2- 172.21.15.19:0/3800464957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e380ccdc0 0x7f2e380cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.165+0000 7f2e3cc00640 1 -- 172.21.15.19:0/3800464957 >> v1:172.21.15.112:6789/0 conn(0x7f2e381567a0 legacy=0x7f2e380b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.165+0000 7f2e3cc00640 1 -- 172.21.15.19:0/3800464957 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3815cbb0 con 0x7f2e380b4090 2024-04-25T10:26:21.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.165+0000 7f2e3d600640 1 --2- 172.21.15.19:0/3800464957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e380ccdc0 0x7f2e380cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:21.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.166+0000 7f2e3cc00640 1 --2- 172.21.15.19:0/3800464957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e380b4090 0x7f2e380b50e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0097a0 tx=0x7f2e2c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3eb4263e5038be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:21.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.166+0000 7f2e37400640 1 -- 172.21.15.19:0/3800464957 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c037070 con 0x7f2e380b4090 2024-04-25T10:26:21.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.166+0000 7f2e37400640 1 -- 172.21.15.19:0/3800464957 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2c032440 con 0x7f2e380b4090 2024-04-25T10:26:21.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.166+0000 7f2e37400640 1 -- 172.21.15.19:0/3800464957 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c032810 con 0x7f2e380b4090 2024-04-25T10:26:21.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.167+0000 7f2e3e000640 1 -- 172.21.15.19:0/3800464957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e380b4090 msgr2=0x7f2e380b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.167+0000 7f2e3e000640 1 --2- 172.21.15.19:0/3800464957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e380b4090 0x7f2e380b50e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0097a0 tx=0x7f2e2c02a180 comp rx=0 tx=0).stop 2024-04-25T10:26:21.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.167+0000 7f2e3e000640 1 -- 172.21.15.19:0/3800464957 shutdown_connections 2024-04-25T10:26:21.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.167+0000 7f2e3e000640 1 --2- 172.21.15.19:0/3800464957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e380ccdc0 0x7f2e380cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.167+0000 7f2e3e000640 1 --2- 172.21.15.19:0/3800464957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e380b4090 0x7f2e380b50e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.167+0000 7f2e3e000640 1 -- 172.21.15.19:0/3800464957 >> 172.21.15.19:0/3800464957 conn(0x7f2e3808d940 msgr2=0x7f2e3808dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:21.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.167+0000 7f2e3e000640 1 -- 172.21.15.19:0/3800464957 shutdown_connections 2024-04-25T10:26:21.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.167+0000 7f2e3e000640 1 -- 172.21.15.19:0/3800464957 wait complete. 2024-04-25T10:26:21.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.171+0000 7f2e3e000640 1 Processor -- start 2024-04-25T10:26:21.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.171+0000 7f2e3e000640 1 -- start start 2024-04-25T10:26:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.173+0000 7f2e3e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e380b4090 0x7f2e38157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.173+0000 7f2e3e000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e380ccdc0 0x7f2e3814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e381567a0 0x7f2e3814ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3e000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e380b4cf0 con 0x7f2e380ccdc0 2024-04-25T10:26:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3e000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3815d170 con 0x7f2e380b4090 2024-04-25T10:26:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3e000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2e380b4e70 con 0x7f2e381567a0 2024-04-25T10:26:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e380b4090 0x7f2e38157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:21.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e380ccdc0 0x7f2e3814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:21.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e380b4090 0x7f2e38157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37110/0 (socket says 172.21.15.19:37110) 2024-04-25T10:26:21.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3cc00640 1 -- 172.21.15.19:0/4275292625 learned_addr learned my addr 172.21.15.19:0/4275292625 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:21.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3d600640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e381567a0 0x7f2e3814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:21.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3cc00640 1 -- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e381567a0 msgr2=0x7f2e3814ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3cc00640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e381567a0 0x7f2e3814ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3cc00640 1 -- 172.21.15.19:0/4275292625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e380ccdc0 msgr2=0x7f2e3814faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3cc00640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e380ccdc0 0x7f2e3814faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.174+0000 7f2e3cc00640 1 -- 172.21.15.19:0/4275292625 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e38157d60 con 0x7f2e380b4090 2024-04-25T10:26:21.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.175+0000 7f2e3cc00640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e380b4090 0x7f2e38157820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0098c0 tx=0x7f2e2c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:21.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.175+0000 7f2e34c00640 1 -- 172.21.15.19:0/4275292625 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c041030 con 0x7f2e380b4090 2024-04-25T10:26:21.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.175+0000 7f2e34c00640 1 -- 172.21.15.19:0/4275292625 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2c03d420 con 0x7f2e380b4090 2024-04-25T10:26:21.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.175+0000 7f2e3e000640 1 -- 172.21.15.19:0/4275292625 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e381f33b0 con 0x7f2e380b4090 2024-04-25T10:26:21.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.175+0000 7f2e34c00640 1 -- 172.21.15.19:0/4275292625 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c037040 con 0x7f2e380b4090 2024-04-25T10:26:21.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.175+0000 7f2e3e000640 1 -- 172.21.15.19:0/4275292625 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e38155c90 con 0x7f2e380b4090 2024-04-25T10:26:21.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.176+0000 7f2e3e000640 1 -- 172.21.15.19:0/4275292625 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e380b57f0 con 0x7f2e380b4090 2024-04-25T10:26:21.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.177+0000 7f2e34c00640 1 -- 172.21.15.19:0/4275292625 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2e2c044070 con 0x7f2e380b4090 2024-04-25T10:26:21.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.178+0000 7f2e34c00640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2e180744b0 0x7f2e180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:21.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.179+0000 7f2e34c00640 1 -- 172.21.15.19:0/4275292625 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f2e2c0b5ae0 con 0x7f2e380b4090 2024-04-25T10:26:21.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.179+0000 7f2e37e00640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2e180744b0 0x7f2e180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:21.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.179+0000 7f2e37e00640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2e180744b0 0x7f2e180769c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e24005880 tx=0x7f2e24009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:21.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.184+0000 7f2e34c00640 1 -- 172.21.15.19:0/4275292625 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e380b57f0 con 0x7f2e380b4090 2024-04-25T10:26:21.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.391+0000 7f2e3e000640 1 -- 172.21.15.19:0/4275292625 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e38050740 con 0x7f2e380b4090 2024-04-25T10:26:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.393+0000 7f2e34c00640 1 -- 172.21.15.19:0/4275292625 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f2e2c07ff00 con 0x7f2e380b4090 2024-04-25T10:26:21.396 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:21.396 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:26:18.399567+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.395+0000 7f2e3e000640 1 -- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2e180744b0 msgr2=0x7f2e180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.395+0000 7f2e3e000640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2e180744b0 0x7f2e180769c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e24005880 tx=0x7f2e24009040 comp rx=0 tx=0).stop 2024-04-25T10:26:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.395+0000 7f2e3e000640 1 -- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e380b4090 msgr2=0x7f2e38157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.395+0000 7f2e3e000640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e380b4090 0x7f2e38157820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0098c0 tx=0x7f2e2c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.395+0000 7f2e3e000640 1 -- 172.21.15.19:0/4275292625 shutdown_connections 2024-04-25T10:26:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.395+0000 7f2e3e000640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2e180744b0 0x7f2e180769c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.395+0000 7f2e3e000640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e381567a0 0x7f2e3814ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.395+0000 7f2e3e000640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e380ccdc0 0x7f2e3814faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.395+0000 7f2e3e000640 1 --2- 172.21.15.19:0/4275292625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e380b4090 0x7f2e38157820 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.395+0000 7f2e3e000640 1 -- 172.21.15.19:0/4275292625 >> 172.21.15.19:0/4275292625 conn(0x7f2e3808d940 msgr2=0x7f2e380b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.395+0000 7f2e3e000640 1 -- 172.21.15.19:0/4275292625 shutdown_connections 2024-04-25T10:26:21.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.396+0000 7f2e3e000640 1 -- 172.21.15.19:0/4275292625 wait complete. 2024-04-25T10:26:21.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:25:24.611615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:25:34.760347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:25:35.692430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:25:39.212157+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:26:21.423 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:26:21.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.689+0000 7f8c14a00640 1 Processor -- start 2024-04-25T10:26:21.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.689+0000 7f8c14a00640 1 -- start start 2024-04-25T10:26:21.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.692+0000 7f8c14a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8c100c80c0 0x7f8c100c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:21.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.692+0000 7f8c14a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c1015c450 con 0x7f8c100c6fd0 2024-04-25T10:26:21.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.692+0000 7f8c14a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c100c5550 con 0x7f8c10074260 2024-04-25T10:26:21.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.692+0000 7f8c14a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8c1015cd60 con 0x7f8c100c80c0 2024-04-25T10:26:21.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.692+0000 7f8c0f400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8c10074260 0x7f8c100c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:52102/0 (socket says 172.21.15.19:52102) 2024-04-25T10:26:21.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.692+0000 7f8c0f400640 1 -- 172.21.15.19:0/376535033 learned_addr learned my addr 172.21.15.19:0/376535033 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:21.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.692+0000 7f8c06a00640 1 --2- 172.21.15.19:0/376535033 >> v2:172.21.15.112:3300/0 conn(0x7f8c100c80c0 0x7f8c100c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:21.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.693+0000 7f8c0ea00640 1 -- 172.21.15.19:0/376535033 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3310587736 0 0) 0x7f8c100c5550 con 0x7f8c10074260 2024-04-25T10:26:21.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.693+0000 7f8c0ea00640 1 -- 172.21.15.19:0/376535033 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bf0003520 con 0x7f8c10074260 2024-04-25T10:26:21.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.693+0000 7f8c0ea00640 1 -- 172.21.15.19:0/376535033 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583321907 0 0) 0x7f8c1015c450 con 0x7f8c100c6fd0 2024-04-25T10:26:21.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.693+0000 7f8c0ea00640 1 -- 172.21.15.19:0/376535033 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c100c5550 con 0x7f8c100c6fd0 2024-04-25T10:26:21.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.693+0000 7f8c06a00640 1 -- 172.21.15.19:0/376535033 >> v1:172.21.15.112:6789/0 conn(0x7f8c10074260 legacy=0x7f8c100c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.693+0000 7f8c06a00640 1 -- 172.21.15.19:0/376535033 >> v1:172.21.15.19:6789/0 conn(0x7f8c100c6fd0 legacy=0x7f8c10166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.693+0000 7f8c06a00640 1 -- 172.21.15.19:0/376535033 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c100c5830 con 0x7f8c100c80c0 2024-04-25T10:26:21.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.695+0000 7f8c06a00640 1 --2- 172.21.15.19:0/376535033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c100c80c0 0x7f8c100c88d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c1015cee0 tx=0x7f8bf802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3769ea5b378d18b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:21.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.695+0000 7f8c0ea00640 1 -- 172.21.15.19:0/376535033 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8037070 con 0x7f8c100c80c0 2024-04-25T10:26:21.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.695+0000 7f8c0ea00640 1 -- 172.21.15.19:0/376535033 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf8032440 con 0x7f8c100c80c0 2024-04-25T10:26:21.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.695+0000 7f8c0ea00640 1 -- 172.21.15.19:0/376535033 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8032810 con 0x7f8c100c80c0 2024-04-25T10:26:21.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.696+0000 7f8c14a00640 1 -- 172.21.15.19:0/376535033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c100c80c0 msgr2=0x7f8c100c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.696+0000 7f8c14a00640 1 --2- 172.21.15.19:0/376535033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c100c80c0 0x7f8c100c88d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c1015cee0 tx=0x7f8bf802a210 comp rx=0 tx=0).stop 2024-04-25T10:26:21.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.696+0000 7f8c14a00640 1 -- 172.21.15.19:0/376535033 shutdown_connections 2024-04-25T10:26:21.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.696+0000 7f8c14a00640 1 --2- 172.21.15.19:0/376535033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c100c80c0 0x7f8c100c88d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.696+0000 7f8c14a00640 1 -- 172.21.15.19:0/376535033 >> 172.21.15.19:0/376535033 conn(0x7f8c100cabb0 msgr2=0x7f8c100cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:21.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.696+0000 7f8c14a00640 1 -- 172.21.15.19:0/376535033 shutdown_connections 2024-04-25T10:26:21.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.696+0000 7f8c14a00640 1 -- 172.21.15.19:0/376535033 wait complete. 2024-04-25T10:26:21.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.700+0000 7f8c14a00640 1 Processor -- start 2024-04-25T10:26:21.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.700+0000 7f8c14a00640 1 -- start start 2024-04-25T10:26:21.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.702+0000 7f8c14a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c10074260 0x7f8c10157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:21.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.702+0000 7f8c14a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c100c6fd0 0x7f8c10154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:21.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.702+0000 7f8c14a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c100c80c0 0x7f8c101511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:21.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.702+0000 7f8c14a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8c101567e0 con 0x7f8c100c80c0 2024-04-25T10:26:21.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.702+0000 7f8c14a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1015c9f0 con 0x7f8c10074260 2024-04-25T10:26:21.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.702+0000 7f8c14a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8c10156960 con 0x7f8c100c6fd0 2024-04-25T10:26:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.703+0000 7f8c0f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c10074260 0x7f8c10157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.703+0000 7f8c0fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c100c80c0 0x7f8c101511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.703+0000 7f8c0f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c10074260 0x7f8c10157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37132/0 (socket says 172.21.15.19:37132) 2024-04-25T10:26:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.703+0000 7f8c06a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c100c6fd0 0x7f8c10154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.703+0000 7f8c0f400640 1 -- 172.21.15.19:0/547126228 learned_addr learned my addr 172.21.15.19:0/547126228 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.703+0000 7f8c0f400640 1 -- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c100c6fd0 msgr2=0x7f8c10154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.703+0000 7f8c0f400640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c100c6fd0 0x7f8c10154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.703+0000 7f8c0f400640 1 -- 172.21.15.19:0/547126228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c100c80c0 msgr2=0x7f8c101511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.703+0000 7f8c0f400640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c100c80c0 0x7f8c101511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.703+0000 7f8c0f400640 1 -- 172.21.15.19:0/547126228 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c10157880 con 0x7f8c10074260 2024-04-25T10:26:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.703+0000 7f8c0fe00640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c100c80c0 0x7f8c101511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.704+0000 7f8c0f400640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c10074260 0x7f8c10157340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000c410 tx=0x7f8c0000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.704+0000 7f8c07e00640 1 -- 172.21.15.19:0/547126228 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00017070 con 0x7f8c10074260 2024-04-25T10:26:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.704+0000 7f8c07e00640 1 -- 172.21.15.19:0/547126228 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c00005ce0 con 0x7f8c10074260 2024-04-25T10:26:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.704+0000 7f8c07e00640 1 -- 172.21.15.19:0/547126228 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c000072f0 con 0x7f8c10074260 2024-04-25T10:26:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.704+0000 7f8c14a00640 1 -- 172.21.15.19:0/547126228 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c10155630 con 0x7f8c10074260 2024-04-25T10:26:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.704+0000 7f8c14a00640 1 -- 172.21.15.19:0/547126228 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c101e7970 con 0x7f8c10074260 2024-04-25T10:26:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.705+0000 7f8c14a00640 1 -- 172.21.15.19:0/547126228 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c100c7eb0 con 0x7f8c10074260 2024-04-25T10:26:21.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.706+0000 7f8c07e00640 1 -- 172.21.15.19:0/547126228 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8c0001a070 con 0x7f8c10074260 2024-04-25T10:26:21.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.707+0000 7f8c07e00640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8bec0744e0 0x7f8bec0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:21.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.708+0000 7f8c07e00640 1 -- 172.21.15.19:0/547126228 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f8c000948b0 con 0x7f8c10074260 2024-04-25T10:26:21.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.708+0000 7f8c06a00640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8bec0744e0 0x7f8bec0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:21.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.708+0000 7f8c06a00640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8bec0744e0 0x7f8bec0769f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8034000 tx=0x7f8bf802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:21.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.712+0000 7f8c07e00640 1 -- 172.21.15.19:0/547126228 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c100c7eb0 con 0x7f8c10074260 2024-04-25T10:26:21.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.911+0000 7f8c14a00640 1 -- 172.21.15.19:0/547126228 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8c10076520 con 0x7f8c10074260 2024-04-25T10:26:21.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.912+0000 7f8c07e00640 1 -- 172.21.15.19:0/547126228 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f8c0005e7c0 con 0x7f8c10074260 2024-04-25T10:26:21.915 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-04-25T10:26:21.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.914+0000 7f8c14a00640 1 -- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8bec0744e0 msgr2=0x7f8bec0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.914+0000 7f8c14a00640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8bec0744e0 0x7f8bec0769f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8034000 tx=0x7f8bf802e000 comp rx=0 tx=0).stop 2024-04-25T10:26:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.914+0000 7f8c14a00640 1 -- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c10074260 msgr2=0x7f8c10157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.914+0000 7f8c14a00640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c10074260 0x7f8c10157340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000c410 tx=0x7f8c0000c8d0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.915+0000 7f8c14a00640 1 -- 172.21.15.19:0/547126228 shutdown_connections 2024-04-25T10:26:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.915+0000 7f8c14a00640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c100c80c0 0x7f8c101511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.915+0000 7f8c14a00640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8bec0744e0 0x7f8bec0769f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.915+0000 7f8c14a00640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c100c6fd0 0x7f8c10154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.915+0000 7f8c14a00640 1 --2- 172.21.15.19:0/547126228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c10074260 0x7f8c10157340 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.915+0000 7f8c14a00640 1 -- 172.21.15.19:0/547126228 >> 172.21.15.19:0/547126228 conn(0x7f8c100cabb0 msgr2=0x7f8c100c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.915+0000 7f8c14a00640 1 -- 172.21.15.19:0/547126228 shutdown_connections 2024-04-25T10:26:21.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:21.915+0000 7f8c14a00640 1 -- 172.21.15.19:0/547126228 wait complete. 2024-04-25T10:26:21.945 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:26:22.127 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-04-25T10:26:22.124+0000 7fb28c600640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-25T10:26:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.212+0000 7ff04b200640 1 Processor -- start 2024-04-25T10:26:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.212+0000 7ff04b200640 1 -- start start 2024-04-25T10:26:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.215+0000 7ff04b200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff04c0ccfb0 0x7ff04c0b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.215+0000 7ff04b200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff04c156770 0x7ff04c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.215+0000 7ff04b200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04c15f6d0 con 0x7ff04c0cdb20 2024-04-25T10:26:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.215+0000 7ff04b200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff04c0b76d0 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.215+0000 7ff04b200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff04c15c7b0 con 0x7ff04c156770 2024-04-25T10:26:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.215+0000 7ff049e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff04c0ccfb0 0x7ff04c0b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.215+0000 7ff04a800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff04c0cdb20 0x7ff04c15ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39844/0 (socket says 172.21.15.19:39844) 2024-04-25T10:26:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.215+0000 7ff04a800640 1 -- 172.21.15.19:0/2925471554 learned_addr learned my addr 172.21.15.19:0/2925471554 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.215+0000 7ff049400640 1 --2- 172.21.15.19:0/2925471554 >> v2:172.21.15.112:3300/0 conn(0x7ff04c156770 0x7ff04c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.216+0000 7ff049e00640 1 -- 172.21.15.19:0/2925471554 >> v2:172.21.15.112:3300/0 conn(0x7ff04c156770 msgr2=0x7ff04c0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:22.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.216+0000 7ff049e00640 1 --2- 172.21.15.19:0/2925471554 >> v2:172.21.15.112:3300/0 conn(0x7ff04c156770 0x7ff04c0cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.216+0000 7ff049e00640 1 -- 172.21.15.19:0/2925471554 >> v1:172.21.15.19:6789/0 conn(0x7ff04c0cdb20 legacy=0x7ff04c15ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.216+0000 7ff049e00640 1 -- 172.21.15.19:0/2925471554 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c15d2f0 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.216+0000 7ff048a00640 1 -- 172.21.15.19:0/2925471554 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074948930 0 0) 0x7ff04c15f6d0 con 0x7ff04c0cdb20 2024-04-25T10:26:22.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.217+0000 7ff049e00640 1 --2- 172.21.15.19:0/2925471554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff04c0ccfb0 0x7ff04c0b7190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff04c08e8a0 tx=0x7ff03c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba35b1464d3f1e13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:22.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.217+0000 7ff048a00640 1 -- 172.21.15.19:0/2925471554 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c037070 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.217+0000 7ff048a00640 1 -- 172.21.15.19:0/2925471554 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03c032440 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.217+0000 7ff048a00640 1 -- 172.21.15.19:0/2925471554 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c032810 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.218+0000 7ff04b200640 1 -- 172.21.15.19:0/2925471554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff04c0ccfb0 msgr2=0x7ff04c0b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.218+0000 7ff04b200640 1 --2- 172.21.15.19:0/2925471554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff04c0ccfb0 0x7ff04c0b7190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff04c08e8a0 tx=0x7ff03c02a250 comp rx=0 tx=0).stop 2024-04-25T10:26:22.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.218+0000 7ff04b200640 1 -- 172.21.15.19:0/2925471554 shutdown_connections 2024-04-25T10:26:22.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.218+0000 7ff04b200640 1 --2- 172.21.15.19:0/2925471554 >> v2:172.21.15.112:3300/0 conn(0x7ff04c156770 0x7ff04c0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.218+0000 7ff04b200640 1 --2- 172.21.15.19:0/2925471554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff04c0ccfb0 0x7ff04c0b7190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.218+0000 7ff04b200640 1 -- 172.21.15.19:0/2925471554 >> 172.21.15.19:0/2925471554 conn(0x7ff04c068880 msgr2=0x7ff04c068c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:22.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.218+0000 7ff04b200640 1 -- 172.21.15.19:0/2925471554 shutdown_connections 2024-04-25T10:26:22.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.218+0000 7ff04b200640 1 -- 172.21.15.19:0/2925471554 wait complete. 2024-04-25T10:26:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.220+0000 7ff04b200640 1 Processor -- start 2024-04-25T10:26:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.221+0000 7ff04b200640 1 -- start start 2024-04-25T10:26:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.222+0000 7ff04b200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff04c0ccfb0 0x7ff04c1e9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.222+0000 7ff04b200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff04c0cdb20 0x7ff04c1f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.222+0000 7ff04b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff04c156770 0x7ff04c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.222+0000 7ff04b200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c15d010 con 0x7ff04c0cdb20 2024-04-25T10:26:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.222+0000 7ff04b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c15cd30 con 0x7ff04c156770 2024-04-25T10:26:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.222+0000 7ff04b200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff04c15fa20 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.222+0000 7ff049e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff04c0ccfb0 0x7ff04c1e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.222+0000 7ff04a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff04c156770 0x7ff04c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.222+0000 7ff049400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff04c0cdb20 0x7ff04c1f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.222+0000 7ff049e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff04c0ccfb0 0x7ff04c1e9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60066/0 (socket says 172.21.15.19:60066) 2024-04-25T10:26:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.222+0000 7ff049e00640 1 -- 172.21.15.19:0/1859202394 learned_addr learned my addr 172.21.15.19:0/1859202394 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.223+0000 7ff049e00640 1 -- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff04c156770 msgr2=0x7ff04c155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.223+0000 7ff049e00640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff04c156770 0x7ff04c155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.223+0000 7ff049e00640 1 -- 172.21.15.19:0/1859202394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff04c0cdb20 msgr2=0x7ff04c1f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.223+0000 7ff049e00640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff04c0cdb20 0x7ff04c1f6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.223+0000 7ff049e00640 1 -- 172.21.15.19:0/1859202394 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c1563b0 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.223+0000 7ff049400640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff04c0cdb20 0x7ff04c1f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.223+0000 7ff04a800640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff04c156770 0x7ff04c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.223+0000 7ff049e00640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff04c0ccfb0 0x7ff04c1e9210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff03c000c00 tx=0x7ff03c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.224+0000 7ff042000640 1 -- 172.21.15.19:0/1859202394 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c037040 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.224+0000 7ff042000640 1 -- 172.21.15.19:0/1859202394 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03c042070 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.224+0000 7ff042000640 1 -- 172.21.15.19:0/1859202394 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c030920 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.224+0000 7ff04b200640 1 -- 172.21.15.19:0/1859202394 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04c1e53c0 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.224+0000 7ff04b200640 1 -- 172.21.15.19:0/1859202394 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04c1e5960 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.225+0000 7ff04b200640 1 -- 172.21.15.19:0/1859202394 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff04c076520 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.227+0000 7ff042000640 1 -- 172.21.15.19:0/1859202394 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff03c030ac0 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.228+0000 7ff042000640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff02c0744b0 0x7ff02c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.228+0000 7ff042000640 1 -- 172.21.15.19:0/1859202394 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7ff03c0b6380 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.229+0000 7ff049400640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff02c0744b0 0x7ff02c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.229+0000 7ff049400640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff02c0744b0 0x7ff02c0769c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0c5110 tx=0x7ff038009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.231+0000 7ff042000640 1 -- 172.21.15.19:0/1859202394 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff04c1563b0 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.427+0000 7ff04b200640 1 -- 172.21.15.19:0/1859202394 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff04c15f480 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.428+0000 7ff042000640 1 -- 172.21.15.19:0/1859202394 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7ff03c0801c0 con 0x7ff04c0ccfb0 2024-04-25T10:26:22.430 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:26:22.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.430+0000 7ff04b200640 1 -- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff02c0744b0 msgr2=0x7ff02c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.430+0000 7ff04b200640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff02c0744b0 0x7ff02c0769c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0c5110 tx=0x7ff038009190 comp rx=0 tx=0).stop 2024-04-25T10:26:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.430+0000 7ff04b200640 1 -- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff04c0ccfb0 msgr2=0x7ff04c1e9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.430+0000 7ff04b200640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff04c0ccfb0 0x7ff04c1e9210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff03c000c00 tx=0x7ff03c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.431+0000 7ff04b200640 1 -- 172.21.15.19:0/1859202394 shutdown_connections 2024-04-25T10:26:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.431+0000 7ff04b200640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff04c156770 0x7ff04c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.431+0000 7ff04b200640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff04c0cdb20 0x7ff04c1f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.431+0000 7ff04b200640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff02c0744b0 0x7ff02c0769c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.431+0000 7ff04b200640 1 --2- 172.21.15.19:0/1859202394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff04c0ccfb0 0x7ff04c1e9210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.431+0000 7ff04b200640 1 -- 172.21.15.19:0/1859202394 >> 172.21.15.19:0/1859202394 conn(0x7ff04c068880 msgr2=0x7ff04c0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.431+0000 7ff04b200640 1 -- 172.21.15.19:0/1859202394 shutdown_connections 2024-04-25T10:26:22.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.431+0000 7ff04b200640 1 -- 172.21.15.19:0/1859202394 wait complete. 2024-04-25T10:26:22.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:26:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.716+0000 7f95ed800640 1 Processor -- start 2024-04-25T10:26:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.716+0000 7f95ed800640 1 -- start start 2024-04-25T10:26:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.719+0000 7f95ed800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80c7c50 0x7f95e80cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.719+0000 7f95ed800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f95e815c5c0 0x7f95e815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.719+0000 7f95ed800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e80cd340 con 0x7f95e80ce360 2024-04-25T10:26:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.719+0000 7f95ed800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f95e80b49e0 con 0x7f95e815c5c0 2024-04-25T10:26:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.719+0000 7f95ed800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f95e80cd5e0 con 0x7f95e80c7c50 2024-04-25T10:26:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.719+0000 7f95e7400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f95e80ce360 0x7f95e80ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39852/0 (socket says 172.21.15.19:39852) 2024-04-25T10:26:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.719+0000 7f95e7400640 1 -- 172.21.15.19:0/3172517173 learned_addr learned my addr 172.21.15.19:0/3172517173 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.719+0000 7f95e6a00640 1 --2- 172.21.15.19:0/3172517173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80c7c50 0x7f95e80cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.719+0000 7f95e6000640 1 --2- 172.21.15.19:0/3172517173 >> v2:172.21.15.112:3300/0 conn(0x7f95e815c5c0 0x7f95e815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.720+0000 7f95e6000640 1 -- 172.21.15.19:0/3172517173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80c7c50 msgr2=0x7f95e80cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.720+0000 7f95e6000640 1 --2- 172.21.15.19:0/3172517173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80c7c50 0x7f95e80cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.720+0000 7f95e6000640 1 -- 172.21.15.19:0/3172517173 >> v1:172.21.15.19:6789/0 conn(0x7f95e80ce360 legacy=0x7f95e80ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.720+0000 7f95e5600640 1 -- 172.21.15.19:0/3172517173 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101520421 0 0) 0x7f95e80cd340 con 0x7f95e80ce360 2024-04-25T10:26:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.720+0000 7f95e6000640 1 -- 172.21.15.19:0/3172517173 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e80cd8c0 con 0x7f95e815c5c0 2024-04-25T10:26:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.720+0000 7f95e6a00640 1 --2- 172.21.15.19:0/3172517173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80c7c50 0x7f95e80cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.721+0000 7f95e6000640 1 --2- 172.21.15.19:0/3172517173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95e815c5c0 0x7f95e815c9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f95d40097a0 tx=0x7f95d402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70fb65ca4dc3c82c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.721+0000 7f95e5600640 1 -- 172.21.15.19:0/3172517173 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4037070 con 0x7f95e815c5c0 2024-04-25T10:26:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.721+0000 7f95e5600640 1 -- 172.21.15.19:0/3172517173 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d4032440 con 0x7f95e815c5c0 2024-04-25T10:26:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.721+0000 7f95e5600640 1 -- 172.21.15.19:0/3172517173 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4032810 con 0x7f95e815c5c0 2024-04-25T10:26:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.722+0000 7f95ed800640 1 -- 172.21.15.19:0/3172517173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95e815c5c0 msgr2=0x7f95e815c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.722+0000 7f95ed800640 1 --2- 172.21.15.19:0/3172517173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95e815c5c0 0x7f95e815c9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f95d40097a0 tx=0x7f95d402a180 comp rx=0 tx=0).stop 2024-04-25T10:26:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.722+0000 7f95ed800640 1 -- 172.21.15.19:0/3172517173 shutdown_connections 2024-04-25T10:26:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.722+0000 7f95ed800640 1 --2- 172.21.15.19:0/3172517173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95e815c5c0 0x7f95e815c9d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.722+0000 7f95ed800640 1 --2- 172.21.15.19:0/3172517173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80c7c50 0x7f95e80cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.722+0000 7f95ed800640 1 -- 172.21.15.19:0/3172517173 >> 172.21.15.19:0/3172517173 conn(0x7f95e806f2c0 msgr2=0x7f95e8068460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.722+0000 7f95ed800640 1 -- 172.21.15.19:0/3172517173 shutdown_connections 2024-04-25T10:26:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.722+0000 7f95ed800640 1 -- 172.21.15.19:0/3172517173 wait complete. 2024-04-25T10:26:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.725+0000 7f95ed800640 1 Processor -- start 2024-04-25T10:26:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.725+0000 7f95ed800640 1 -- start start 2024-04-25T10:26:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.727+0000 7f95ed800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95e80c7c50 0x7f95e8160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.727+0000 7f95ed800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80ce360 0x7f95e81f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.727+0000 7f95ed800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95e815c5c0 0x7f95e81e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.727+0000 7f95ed800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f95e815cf10 con 0x7f95e815c5c0 2024-04-25T10:26:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.727+0000 7f95ed800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f95e80cde80 con 0x7f95e80c7c50 2024-04-25T10:26:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.727+0000 7f95ed800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f95e80ccbf0 con 0x7f95e80ce360 2024-04-25T10:26:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.727+0000 7f95e7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95e815c5c0 0x7f95e81e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.728+0000 7f95e6000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80ce360 0x7f95e81f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.728+0000 7f95e7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95e815c5c0 0x7f95e81e94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41680/0 (socket says 172.21.15.19:41680) 2024-04-25T10:26:22.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.728+0000 7f95e7400640 1 -- 172.21.15.19:0/2400645665 learned_addr learned my addr 172.21.15.19:0/2400645665 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:22.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.728+0000 7f95e6a00640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95e80c7c50 0x7f95e8160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.728+0000 7f95e6000640 1 -- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95e80c7c50 msgr2=0x7f95e8160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.728+0000 7f95e6000640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95e80c7c50 0x7f95e8160400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.728+0000 7f95e6000640 1 -- 172.21.15.19:0/2400645665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95e815c5c0 msgr2=0x7f95e81e94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.728+0000 7f95e6000640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95e815c5c0 0x7f95e81e94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.728+0000 7f95e6000640 1 -- 172.21.15.19:0/2400645665 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e81f30f0 con 0x7f95e80ce360 2024-04-25T10:26:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.728+0000 7f95e6a00640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95e80c7c50 0x7f95e8160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.728+0000 7f95e6000640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80ce360 0x7f95e81f2bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f95d4031000 tx=0x7f95d40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.729+0000 7f95dea00640 1 -- 172.21.15.19:0/2400645665 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4037050 con 0x7f95e80ce360 2024-04-25T10:26:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.729+0000 7f95dea00640 1 -- 172.21.15.19:0/2400645665 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d4038040 con 0x7f95e80ce360 2024-04-25T10:26:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.729+0000 7f95dea00640 1 -- 172.21.15.19:0/2400645665 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4030970 con 0x7f95e80ce360 2024-04-25T10:26:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.729+0000 7f95ed800640 1 -- 172.21.15.19:0/2400645665 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e8159bb0 con 0x7f95e80ce360 2024-04-25T10:26:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.729+0000 7f95ed800640 1 -- 172.21.15.19:0/2400645665 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e81595f0 con 0x7f95e80ce360 2024-04-25T10:26:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.730+0000 7f95ed800640 1 -- 172.21.15.19:0/2400645665 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e8076520 con 0x7f95e80ce360 2024-04-25T10:26:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.732+0000 7f95dea00640 1 -- 172.21.15.19:0/2400645665 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f95d4045020 con 0x7f95e80ce360 2024-04-25T10:26:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.733+0000 7f95dea00640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f95c80744e0 0x7f95c80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.733+0000 7f95dea00640 1 -- 172.21.15.19:0/2400645665 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f95d40b5a60 con 0x7f95e80ce360 2024-04-25T10:26:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.733+0000 7f95e6a00640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f95c80744e0 0x7f95c80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.734+0000 7f95e6a00640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f95c80744e0 0x7f95c80769f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009560 tx=0x7f95d8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.736+0000 7f95dea00640 1 -- 172.21.15.19:0/2400645665 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f95d407f930 con 0x7f95e80ce360 2024-04-25T10:26:22.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.931+0000 7f95ed800640 1 -- 172.21.15.19:0/2400645665 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f95e81f24f0 con 0x7f95e80ce360 2024-04-25T10:26:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.932+0000 7f95dea00640 1 -- 172.21.15.19:0/2400645665 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f95d4083c30 con 0x7f95e80ce360 2024-04-25T10:26:22.935 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-04-25T10:26:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 -- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f95c80744e0 msgr2=0x7f95c80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f95c80744e0 0x7f95c80769f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009560 tx=0x7f95d8009190 comp rx=0 tx=0).stop 2024-04-25T10:26:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 -- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80ce360 msgr2=0x7f95e81f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80ce360 0x7f95e81f2bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f95d4031000 tx=0x7f95d40046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 -- 172.21.15.19:0/2400645665 shutdown_connections 2024-04-25T10:26:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95e815c5c0 0x7f95e81e94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f95c80744e0 0x7f95c80769f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95e80ce360 0x7f95e81f2bb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 --2- 172.21.15.19:0/2400645665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95e80c7c50 0x7f95e8160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 -- 172.21.15.19:0/2400645665 >> 172.21.15.19:0/2400645665 conn(0x7f95e806f2c0 msgr2=0x7f95e80b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:22.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 -- 172.21.15.19:0/2400645665 shutdown_connections 2024-04-25T10:26:22.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:22.935+0000 7f95ed800640 1 -- 172.21.15.19:0/2400645665 wait complete. 2024-04-25T10:26:22.962 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:26:23.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.226+0000 7f1a51800640 1 Processor -- start 2024-04-25T10:26:23.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.226+0000 7f1a51800640 1 -- start start 2024-04-25T10:26:23.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.228+0000 7f1a51800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a4c0cde30 0x7f1a4c0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.228+0000 7f1a51800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a4c0b66b0 0x7f1a4c0b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.228+0000 7f1a51800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a4c0b4650 con 0x7f1a4c0b74a0 2024-04-25T10:26:23.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.228+0000 7f1a51800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f1a4c0b5f40 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.228+0000 7f1a51800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4c15cfc0 con 0x7f1a4c0cde30 2024-04-25T10:26:23.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.229+0000 7f1a50e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a4c0b66b0 0x7f1a4c0b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.229+0000 7f1a50e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a4c0b66b0 0x7f1a4c0b6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41692/0 (socket says 172.21.15.19:41692) 2024-04-25T10:26:23.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.229+0000 7f1a4be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a4c0cde30 0x7f1a4c0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.229+0000 7f1a43e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1a4c0b74a0 0x7f1a4c06dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:52108/0 (socket says 172.21.15.19:52108) 2024-04-25T10:26:23.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.229+0000 7f1a50e00640 1 -- 172.21.15.19:0/699060622 learned_addr learned my addr 172.21.15.19:0/699060622 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.229+0000 7f1a4be00640 1 -- 172.21.15.19:0/699060622 >> v2:172.21.15.19:3300/0 conn(0x7f1a4c0b66b0 msgr2=0x7f1a4c0b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.229+0000 7f1a4be00640 1 --2- 172.21.15.19:0/699060622 >> v2:172.21.15.19:3300/0 conn(0x7f1a4c0b66b0 0x7f1a4c0b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.229+0000 7f1a4b400640 1 -- 172.21.15.19:0/699060622 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987700168 0 0) 0x7f1a4c0b4650 con 0x7f1a4c0b74a0 2024-04-25T10:26:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.229+0000 7f1a4be00640 1 -- 172.21.15.19:0/699060622 >> v1:172.21.15.112:6789/0 conn(0x7f1a4c0b74a0 legacy=0x7f1a4c06dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.229+0000 7f1a4be00640 1 -- 172.21.15.19:0/699060622 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c15d2a0 con 0x7f1a4c0cde30 2024-04-25T10:26:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.230+0000 7f1a4be00640 1 --2- 172.21.15.19:0/699060622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a4c0cde30 0x7f1a4c0c66f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0097a0 tx=0x7f1a3c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1db14e2a5043487 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.231+0000 7f1a4b400640 1 -- 172.21.15.19:0/699060622 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c037070 con 0x7f1a4c0cde30 2024-04-25T10:26:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.231+0000 7f1a4b400640 1 -- 172.21.15.19:0/699060622 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3c032440 con 0x7f1a4c0cde30 2024-04-25T10:26:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.231+0000 7f1a4b400640 1 -- 172.21.15.19:0/699060622 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c032810 con 0x7f1a4c0cde30 2024-04-25T10:26:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.231+0000 7f1a51800640 1 -- 172.21.15.19:0/699060622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a4c0cde30 msgr2=0x7f1a4c0c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.231+0000 7f1a51800640 1 --2- 172.21.15.19:0/699060622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a4c0cde30 0x7f1a4c0c66f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0097a0 tx=0x7f1a3c02a1a0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.231+0000 7f1a51800640 1 -- 172.21.15.19:0/699060622 shutdown_connections 2024-04-25T10:26:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.231+0000 7f1a51800640 1 --2- 172.21.15.19:0/699060622 >> v2:172.21.15.19:3300/0 conn(0x7f1a4c0b66b0 0x7f1a4c0b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.231+0000 7f1a51800640 1 --2- 172.21.15.19:0/699060622 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a4c0cde30 0x7f1a4c0c66f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.232+0000 7f1a51800640 1 -- 172.21.15.19:0/699060622 >> 172.21.15.19:0/699060622 conn(0x7f1a4c068da0 msgr2=0x7f1a4c0d17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:23.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.232+0000 7f1a51800640 1 -- 172.21.15.19:0/699060622 shutdown_connections 2024-04-25T10:26:23.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.232+0000 7f1a51800640 1 -- 172.21.15.19:0/699060622 wait complete. 2024-04-25T10:26:23.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.234+0000 7f1a51800640 1 Processor -- start 2024-04-25T10:26:23.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.235+0000 7f1a51800640 1 -- start start 2024-04-25T10:26:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.236+0000 7f1a51800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a4c0b66b0 0x7f1a4c14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.236+0000 7f1a51800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a4c0b74a0 0x7f1a4c155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.236+0000 7f1a51800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a4c0cf6b0 0x7f1a4c155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.236+0000 7f1a51800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0b4910 con 0x7f1a4c0cf6b0 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.236+0000 7f1a51800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0b7000 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.236+0000 7f1a51800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4c06e400 con 0x7f1a4c0b74a0 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.237+0000 7f1a4be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a4c0b66b0 0x7f1a4c14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.237+0000 7f1a50e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a4c0cf6b0 0x7f1a4c155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.237+0000 7f1a43e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a4c0b74a0 0x7f1a4c155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.237+0000 7f1a4be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a4c0b66b0 0x7f1a4c14a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37178/0 (socket says 172.21.15.19:37178) 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.237+0000 7f1a4be00640 1 -- 172.21.15.19:0/4266058731 learned_addr learned my addr 172.21.15.19:0/4266058731 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.237+0000 7f1a4be00640 1 -- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a4c0b74a0 msgr2=0x7f1a4c155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.237+0000 7f1a4be00640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a4c0b74a0 0x7f1a4c155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.237+0000 7f1a4be00640 1 -- 172.21.15.19:0/4266058731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a4c0cf6b0 msgr2=0x7f1a4c155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.237+0000 7f1a4be00640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a4c0cf6b0 0x7f1a4c155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.237+0000 7f1a4be00640 1 -- 172.21.15.19:0/4266058731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c0d1050 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.237+0000 7f1a4be00640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a4c0b66b0 0x7f1a4c14a590 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c000c00 tx=0x7f1a3c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.238+0000 7f1a48c00640 1 -- 172.21.15.19:0/4266058731 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c041020 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.238+0000 7f1a48c00640 1 -- 172.21.15.19:0/4266058731 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3c03d700 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.238+0000 7f1a51800640 1 -- 172.21.15.19:0/4266058731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4c15ebc0 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.238+0000 7f1a48c00640 1 -- 172.21.15.19:0/4266058731 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c037040 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.238+0000 7f1a51800640 1 -- 172.21.15.19:0/4266058731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4c15f6a0 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.239+0000 7f1a51800640 1 -- 172.21.15.19:0/4266058731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a4c076520 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.240+0000 7f1a48c00640 1 -- 172.21.15.19:0/4266058731 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1a3c044020 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.241+0000 7f1a48c00640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f1a280744b0 0x7f1a280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.241+0000 7f1a48c00640 1 -- 172.21.15.19:0/4266058731 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f1a3c0b5d50 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.242+0000 7f1a43e00640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f1a280744b0 0x7f1a280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.242+0000 7f1a43e00640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f1a280744b0 0x7f1a280769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1a34000f60 tx=0x7f1a34007e00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:23.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.246+0000 7f1a48c00640 1 -- 172.21.15.19:0/4266058731 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a3c04b030 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.440+0000 7f1a51800640 1 -- 172.21.15.19:0/4266058731 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1a4c0cdc10 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.441+0000 7f1a48c00640 1 -- 172.21.15.19:0/4266058731 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f1a3c07fa80 con 0x7f1a4c0b66b0 2024-04-25T10:26:23.444 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:26:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.443+0000 7f1a51800640 1 -- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f1a280744b0 msgr2=0x7f1a280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.443+0000 7f1a51800640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f1a280744b0 0x7f1a280769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1a34000f60 tx=0x7f1a34007e00 comp rx=0 tx=0).stop 2024-04-25T10:26:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.443+0000 7f1a51800640 1 -- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a4c0b66b0 msgr2=0x7f1a4c14a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.443+0000 7f1a51800640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a4c0b66b0 0x7f1a4c14a590 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c000c00 tx=0x7f1a3c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.444+0000 7f1a51800640 1 -- 172.21.15.19:0/4266058731 shutdown_connections 2024-04-25T10:26:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.444+0000 7f1a51800640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a4c0cf6b0 0x7f1a4c155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.444+0000 7f1a51800640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f1a280744b0 0x7f1a280769c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.444+0000 7f1a51800640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1a4c0b74a0 0x7f1a4c155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.444+0000 7f1a51800640 1 --2- 172.21.15.19:0/4266058731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a4c0b66b0 0x7f1a4c14a590 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.444+0000 7f1a51800640 1 -- 172.21.15.19:0/4266058731 >> 172.21.15.19:0/4266058731 conn(0x7f1a4c068da0 msgr2=0x7f1a4c0c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.444+0000 7f1a51800640 1 -- 172.21.15.19:0/4266058731 shutdown_connections 2024-04-25T10:26:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.444+0000 7f1a51800640 1 -- 172.21.15.19:0/4266058731 wait complete. 2024-04-25T10:26:23.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:26:23.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.735+0000 7f00c9e00640 1 Processor -- start 2024-04-25T10:26:23.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.736+0000 7f00c9e00640 1 -- start start 2024-04-25T10:26:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.738+0000 7f00c9e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00c40c5c10 0x7f00c41546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.738+0000 7f00c9e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00c4071000 0x7f00c40c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.738+0000 7f00c9e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00c4070500 con 0x7f00c40c78f0 2024-04-25T10:26:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.738+0000 7f00c9e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f00c4154bf0 con 0x7f00c40c5c10 2024-04-25T10:26:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.738+0000 7f00c9e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f00c4070b90 con 0x7f00c4071000 2024-04-25T10:26:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.738+0000 7f00c8a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00c40c5c10 0x7f00c41546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.738+0000 7f00c9400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f00c40c78f0 0x7f00c415a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:52116/0 (socket says 172.21.15.19:52116) 2024-04-25T10:26:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.738+0000 7f00c3e00640 1 --2- 172.21.15.19:0/3821637435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00c4071000 0x7f00c40c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.738+0000 7f00c9400640 1 -- 172.21.15.19:0/3821637435 learned_addr learned my addr 172.21.15.19:0/3821637435 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:23.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.739+0000 7f00c3400640 1 -- 172.21.15.19:0/3821637435 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457061798 0 0) 0x7f00c4070500 con 0x7f00c40c78f0 2024-04-25T10:26:23.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.739+0000 7f00c3400640 1 -- 172.21.15.19:0/3821637435 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00ac003520 con 0x7f00c40c78f0 2024-04-25T10:26:23.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.739+0000 7f00c8a00640 1 -- 172.21.15.19:0/3821637435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00c4071000 msgr2=0x7f00c40c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:23.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.739+0000 7f00c8a00640 1 --2- 172.21.15.19:0/3821637435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00c4071000 0x7f00c40c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.739+0000 7f00c8a00640 1 -- 172.21.15.19:0/3821637435 >> v1:172.21.15.112:6789/0 conn(0x7f00c40c78f0 legacy=0x7f00c415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:23.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.739+0000 7f00c8a00640 1 -- 172.21.15.19:0/3821637435 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c40c8220 con 0x7f00c40c5c10 2024-04-25T10:26:23.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.740+0000 7f00c8a00640 1 --2- 172.21.15.19:0/3821637435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c40c5c10 0x7f00c41546b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00b80097d0 tx=0x7f00b802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b326b06a9578433d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.740+0000 7f00c3400640 1 -- 172.21.15.19:0/3821637435 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b8037070 con 0x7f00c40c5c10 2024-04-25T10:26:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.740+0000 7f00c3400640 1 -- 172.21.15.19:0/3821637435 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b8032440 con 0x7f00c40c5c10 2024-04-25T10:26:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.740+0000 7f00c3400640 1 -- 172.21.15.19:0/3821637435 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b80327f0 con 0x7f00c40c5c10 2024-04-25T10:26:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.741+0000 7f00c9e00640 1 -- 172.21.15.19:0/3821637435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c40c5c10 msgr2=0x7f00c41546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.741+0000 7f00c9e00640 1 --2- 172.21.15.19:0/3821637435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c40c5c10 0x7f00c41546b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00b80097d0 tx=0x7f00b802a250 comp rx=0 tx=0).stop 2024-04-25T10:26:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.741+0000 7f00c9e00640 1 -- 172.21.15.19:0/3821637435 shutdown_connections 2024-04-25T10:26:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.741+0000 7f00c9e00640 1 --2- 172.21.15.19:0/3821637435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00c4071000 0x7f00c40c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.741+0000 7f00c9e00640 1 --2- 172.21.15.19:0/3821637435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c40c5c10 0x7f00c41546b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.741+0000 7f00c9e00640 1 -- 172.21.15.19:0/3821637435 >> 172.21.15.19:0/3821637435 conn(0x7f00c40ce710 msgr2=0x7f00c40ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:23.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.741+0000 7f00c9e00640 1 -- 172.21.15.19:0/3821637435 shutdown_connections 2024-04-25T10:26:23.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.741+0000 7f00c9e00640 1 -- 172.21.15.19:0/3821637435 wait complete. 2024-04-25T10:26:23.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.743+0000 7f00c9e00640 1 Processor -- start 2024-04-25T10:26:23.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.743+0000 7f00c9e00640 1 -- start start 2024-04-25T10:26:23.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.745+0000 7f00c9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00c4071000 0x7f00c41f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.745+0000 7f00c9e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00c40c5c10 0x7f00c415d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.745+0000 7f00c9e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c40c78f0 0x7f00c41444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.745+0000 7f00c9e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f00c40c87c0 con 0x7f00c40c78f0 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.745+0000 7f00c9e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f00c40c84e0 con 0x7f00c4071000 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.745+0000 7f00c9e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f00c40c8aa0 con 0x7f00c40c5c10 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.745+0000 7f00c9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c40c78f0 0x7f00c41444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.745+0000 7f00c9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c40c78f0 0x7f00c41444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41724/0 (socket says 172.21.15.19:41724) 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.745+0000 7f00c9400640 1 -- 172.21.15.19:0/2306648292 learned_addr learned my addr 172.21.15.19:0/2306648292 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.745+0000 7f00c8a00640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00c4071000 0x7f00c41f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.745+0000 7f00c3e00640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00c40c5c10 0x7f00c415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.746+0000 7f00c9400640 1 -- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00c40c5c10 msgr2=0x7f00c415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.746+0000 7f00c9400640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00c40c5c10 0x7f00c415d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.746+0000 7f00c9400640 1 -- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00c4071000 msgr2=0x7f00c41f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.746+0000 7f00c9400640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00c4071000 0x7f00c41f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.746+0000 7f00c9400640 1 -- 172.21.15.19:0/2306648292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c415b600 con 0x7f00c40c78f0 2024-04-25T10:26:23.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.746+0000 7f00c9400640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c40c78f0 0x7f00c41444d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00caa0 tx=0x7f00bc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:23.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.746+0000 7f00c0c00640 1 -- 172.21.15.19:0/2306648292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc017070 con 0x7f00c40c78f0 2024-04-25T10:26:23.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.746+0000 7f00c0c00640 1 -- 172.21.15.19:0/2306648292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00bc00aba0 con 0x7f00c40c78f0 2024-04-25T10:26:23.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.746+0000 7f00c0c00640 1 -- 172.21.15.19:0/2306648292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc012400 con 0x7f00c40c78f0 2024-04-25T10:26:23.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.746+0000 7f00c9e00640 1 -- 172.21.15.19:0/2306648292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c415df90 con 0x7f00c40c78f0 2024-04-25T10:26:23.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.747+0000 7f00c9e00640 1 -- 172.21.15.19:0/2306648292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c415bb50 con 0x7f00c40c78f0 2024-04-25T10:26:23.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.748+0000 7f00c9e00640 1 -- 172.21.15.19:0/2306648292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c4050740 con 0x7f00c40c78f0 2024-04-25T10:26:23.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.749+0000 7f00c0c00640 1 -- 172.21.15.19:0/2306648292 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f00bc01a070 con 0x7f00c40c78f0 2024-04-25T10:26:23.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.750+0000 7f00c0c00640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f00a40744e0 0x7f00a40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:23.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.750+0000 7f00c0c00640 1 -- 172.21.15.19:0/2306648292 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f00bc0951d0 con 0x7f00c40c78f0 2024-04-25T10:26:23.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.750+0000 7f00c8a00640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f00a40744e0 0x7f00a40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:23.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.751+0000 7f00c8a00640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f00a40744e0 0x7f00a40769f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00b8034000 tx=0x7f00b802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.755+0000 7f00c0c00640 1 -- 172.21.15.19:0/2306648292 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f00bc05ef00 con 0x7f00c40c78f0 2024-04-25T10:26:24.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:23.999+0000 7f00c9e00640 1 -- 172.21.15.19:0/2306648292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00c4158610 con 0x7f00c40c78f0 2024-04-25T10:26:24.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.000+0000 7f00c0c00640 1 -- 172.21.15.19:0/2306648292 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f00bc063200 con 0x7f00c40c78f0 2024-04-25T10:26:24.002 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:24.003 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:26:24.003 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:26:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 -- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f00a40744e0 msgr2=0x7f00a40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f00a40744e0 0x7f00a40769f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00b8034000 tx=0x7f00b802e000 comp rx=0 tx=0).stop 2024-04-25T10:26:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 -- 172.21.15.19:0/2306648292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c40c78f0 msgr2=0x7f00c41444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c40c78f0 0x7f00c41444d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00caa0 tx=0x7f00bc00cf60 comp rx=0 tx=0).stop 2024-04-25T10:26:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 -- 172.21.15.19:0/2306648292 shutdown_connections 2024-04-25T10:26:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00c40c78f0 0x7f00c41444d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f00a40744e0 0x7f00a40769f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00c40c5c10 0x7f00c415d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 --2- 172.21.15.19:0/2306648292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00c4071000 0x7f00c41f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 -- 172.21.15.19:0/2306648292 >> 172.21.15.19:0/2306648292 conn(0x7f00c40ce710 msgr2=0x7f00c40b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 -- 172.21.15.19:0/2306648292 shutdown_connections 2024-04-25T10:26:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.002+0000 7f00c9e00640 1 -- 172.21.15.19:0/2306648292 wait complete. 2024-04-25T10:26:24.030 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:24.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.300+0000 7f3b41e00640 1 Processor -- start 2024-04-25T10:26:24.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.300+0000 7f3b41e00640 1 -- start start 2024-04-25T10:26:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.303+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c0ca6f0 0x7f3b3c1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.303+0000 7f3b41e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b3c0b3bb0 0x7f3b3c0c4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.303+0000 7f3b41e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c0c4db0 con 0x7f3b3c15d2d0 2024-04-25T10:26:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.303+0000 7f3b41e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3b3c160b10 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.303+0000 7f3b41e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3c0ca320 con 0x7f3b3c0ca6f0 2024-04-25T10:26:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.303+0000 7f3b3aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c0ca6f0 0x7f3b3c1605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.303+0000 7f3b3aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c0ca6f0 0x7f3b3c1605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60136/0 (socket says 172.21.15.19:60136) 2024-04-25T10:26:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.303+0000 7f3b3aa00640 1 -- 172.21.15.19:0/4002991708 learned_addr learned my addr 172.21.15.19:0/4002991708 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.303+0000 7f3b33e00640 1 --2- 172.21.15.19:0/4002991708 >> v2:172.21.15.19:3300/0 conn(0x7f3b3c0b3bb0 0x7f3b3c0c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.304+0000 7f3b3aa00640 1 -- 172.21.15.19:0/4002991708 >> v2:172.21.15.19:3300/0 conn(0x7f3b3c0b3bb0 msgr2=0x7f3b3c0c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.304+0000 7f3b3aa00640 1 --2- 172.21.15.19:0/4002991708 >> v2:172.21.15.19:3300/0 conn(0x7f3b3c0b3bb0 0x7f3b3c0c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.304+0000 7f3b3aa00640 1 -- 172.21.15.19:0/4002991708 >> v1:172.21.15.112:6789/0 conn(0x7f3b3c15d2d0 legacy=0x7f3b3c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.304+0000 7f3b3aa00640 1 -- 172.21.15.19:0/4002991708 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c0c9da0 con 0x7f3b3c0ca6f0 2024-04-25T10:26:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.304+0000 7f3b3a000640 1 -- 172.21.15.19:0/4002991708 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4039780776 0 0) 0x7f3b3c0c4db0 con 0x7f3b3c15d2d0 2024-04-25T10:26:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.305+0000 7f3b3aa00640 1 --2- 172.21.15.19:0/4002991708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c0ca6f0 0x7f3b3c1605d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009870 tx=0x7f3b2c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6aeaf18321aef29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:24.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.305+0000 7f3b3a000640 1 -- 172.21.15.19:0/4002991708 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c037070 con 0x7f3b3c0ca6f0 2024-04-25T10:26:24.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.305+0000 7f3b3a000640 1 -- 172.21.15.19:0/4002991708 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c02ae50 con 0x7f3b3c0ca6f0 2024-04-25T10:26:24.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.305+0000 7f3b3a000640 1 -- 172.21.15.19:0/4002991708 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c032860 con 0x7f3b3c0ca6f0 2024-04-25T10:26:24.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.306+0000 7f3b41e00640 1 -- 172.21.15.19:0/4002991708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c0ca6f0 msgr2=0x7f3b3c1605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.306+0000 7f3b41e00640 1 --2- 172.21.15.19:0/4002991708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c0ca6f0 0x7f3b3c1605d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009870 tx=0x7f3b2c02a300 comp rx=0 tx=0).stop 2024-04-25T10:26:24.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.306+0000 7f3b41e00640 1 -- 172.21.15.19:0/4002991708 shutdown_connections 2024-04-25T10:26:24.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.306+0000 7f3b41e00640 1 --2- 172.21.15.19:0/4002991708 >> v2:172.21.15.19:3300/0 conn(0x7f3b3c0b3bb0 0x7f3b3c0c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.306+0000 7f3b41e00640 1 --2- 172.21.15.19:0/4002991708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c0ca6f0 0x7f3b3c1605d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.306+0000 7f3b41e00640 1 -- 172.21.15.19:0/4002991708 >> 172.21.15.19:0/4002991708 conn(0x7f3b3c074670 msgr2=0x7f3b3c0700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.306+0000 7f3b41e00640 1 -- 172.21.15.19:0/4002991708 shutdown_connections 2024-04-25T10:26:24.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.306+0000 7f3b41e00640 1 -- 172.21.15.19:0/4002991708 wait complete. 2024-04-25T10:26:24.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.308+0000 7f3b41e00640 1 Processor -- start 2024-04-25T10:26:24.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.308+0000 7f3b41e00640 1 -- start start 2024-04-25T10:26:24.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.310+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c0b3bb0 0x7f3b3c160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:24.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.310+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c15d2d0 0x7f3b3c1f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:24.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.310+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b3c14e230 0x7f3b3c14e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.310+0000 7f3b41e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c15c7f0 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.310+0000 7f3b41e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c15ce40 con 0x7f3b3c14e230 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.310+0000 7f3b41e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3c15cad0 con 0x7f3b3c15d2d0 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.310+0000 7f3b3aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c0b3bb0 0x7f3b3c160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.310+0000 7f3b3aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c0b3bb0 0x7f3b3c160400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41730/0 (socket says 172.21.15.19:41730) 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.310+0000 7f3b3aa00640 1 -- 172.21.15.19:0/1947684069 learned_addr learned my addr 172.21.15.19:0/1947684069 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.310+0000 7f3b33e00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c15d2d0 0x7f3b3c1f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.310+0000 7f3b3b400640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b3c14e230 0x7f3b3c14e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.311+0000 7f3b3aa00640 1 -- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c15d2d0 msgr2=0x7f3b3c1f2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.311+0000 7f3b3aa00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c15d2d0 0x7f3b3c1f2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.311+0000 7f3b3aa00640 1 -- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b3c14e230 msgr2=0x7f3b3c14e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.311+0000 7f3b3aa00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b3c14e230 0x7f3b3c14e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.311+0000 7f3b3aa00640 1 -- 172.21.15.19:0/1947684069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c152950 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.311+0000 7f3b3aa00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c0b3bb0 0x7f3b3c160400 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c035040 tx=0x7f3b2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:24.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.311+0000 7f3b33400640 1 -- 172.21.15.19:0/1947684069 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c037040 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.311+0000 7f3b33400640 1 -- 172.21.15.19:0/1947684069 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c004230 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.311+0000 7f3b33400640 1 -- 172.21.15.19:0/1947684069 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c032e20 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.311+0000 7f3b41e00640 1 -- 172.21.15.19:0/1947684069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3c1f30c0 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.311+0000 7f3b41e00640 1 -- 172.21.15.19:0/1947684069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b3c150320 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.313+0000 7f3b41e00640 1 -- 172.21.15.19:0/1947684069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b3c076520 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.314+0000 7f3b33400640 1 -- 172.21.15.19:0/1947684069 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3b2c03a070 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.315+0000 7f3b33400640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3b180744b0 0x7f3b180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.315+0000 7f3b33400640 1 -- 172.21.15.19:0/1947684069 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f3b2c0b5aa0 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.315+0000 7f3b33e00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3b180744b0 0x7f3b180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:24.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.316+0000 7f3b33e00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3b180744b0 0x7f3b180769c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c06d840 tx=0x7f3b24008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.320+0000 7f3b33400640 1 -- 172.21.15.19:0/1947684069 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3b2c041020 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.527+0000 7f3b41e00640 1 -- 172.21.15.19:0/1947684069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b3c069d90 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.529+0000 7f3b33400640 1 -- 172.21.15.19:0/1947684069 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f3b2c07f860 con 0x7f3b3c0b3bb0 2024-04-25T10:26:24.533 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:24.533 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:26:18.399567+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 -- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3b180744b0 msgr2=0x7f3b180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3b180744b0 0x7f3b180769c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c06d840 tx=0x7f3b24008040 comp rx=0 tx=0).stop 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 -- 172.21.15.19:0/1947684069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c0b3bb0 msgr2=0x7f3b3c160400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c0b3bb0 0x7f3b3c160400 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c035040 tx=0x7f3b2c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 -- 172.21.15.19:0/1947684069 shutdown_connections 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b3c14e230 0x7f3b3c14e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3b180744b0 0x7f3b180769c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b3c15d2d0 0x7f3b3c1f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 --2- 172.21.15.19:0/1947684069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b3c0b3bb0 0x7f3b3c160400 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 -- 172.21.15.19:0/1947684069 >> 172.21.15.19:0/1947684069 conn(0x7f3b3c074670 msgr2=0x7f3b3c0cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 -- 172.21.15.19:0/1947684069 shutdown_connections 2024-04-25T10:26:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.532+0000 7f3b41e00640 1 -- 172.21.15.19:0/1947684069 wait complete. 2024-04-25T10:26:24.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:25:24.611615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:25:34.760347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:25:35.692430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:25:39.212157+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:26:24.562 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:26:24.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.835+0000 7fe3e5c00640 1 Processor -- start 2024-04-25T10:26:24.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.835+0000 7fe3e5c00640 1 -- start start 2024-04-25T10:26:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.837+0000 7fe3e5c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe3e00cdde0 0x7fe3e00ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.837+0000 7fe3e5c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e00af780 con 0x7fe3e0073d50 2024-04-25T10:26:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.837+0000 7fe3e5c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e0156c60 con 0x7fe3e0156850 2024-04-25T10:26:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.837+0000 7fe3e5c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe3e00af1c0 con 0x7fe3e00cdde0 2024-04-25T10:26:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.838+0000 7fe3de000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe3e00cdde0 0x7fe3e00ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.838+0000 7fe3dea00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe3e0156850 0x7fe3e015d000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:52140/0 (socket says 172.21.15.19:52140) 2024-04-25T10:26:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.838+0000 7fe3dea00640 1 -- 172.21.15.19:0/1982188769 learned_addr learned my addr 172.21.15.19:0/1982188769 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.838+0000 7fe3df400640 1 --1- 172.21.15.19:0/1982188769 >> v1:172.21.15.19:6789/0 conn(0x7fe3e0073d50 0x7fe3e0074160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39868/0 (socket says 172.21.15.19:39868) 2024-04-25T10:26:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.838+0000 7fe3de000640 1 -- 172.21.15.19:0/1982188769 >> v1:172.21.15.112:6789/0 conn(0x7fe3e0156850 legacy=0x7fe3e015d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.838+0000 7fe3de000640 1 -- 172.21.15.19:0/1982188769 >> v1:172.21.15.19:6789/0 conn(0x7fe3e0073d50 legacy=0x7fe3e0074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.838+0000 7fe3dd600640 1 -- 172.21.15.19:0/1982188769 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262826059 0 0) 0x7fe3e00af780 con 0x7fe3e0073d50 2024-04-25T10:26:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.839+0000 7fe3de000640 1 -- 172.21.15.19:0/1982188769 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e00af4a0 con 0x7fe3e00cdde0 2024-04-25T10:26:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.840+0000 7fe3de000640 1 --2- 172.21.15.19:0/1982188769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e00cdde0 0x7fe3e00ce1f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009d90 tx=0x7fe3c802a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c8c24bab750170e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.840+0000 7fe3dd600640 1 -- 172.21.15.19:0/1982188769 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8007540 con 0x7fe3e00cdde0 2024-04-25T10:26:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.840+0000 7fe3dd600640 1 -- 172.21.15.19:0/1982188769 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c80076e0 con 0x7fe3e00cdde0 2024-04-25T10:26:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.840+0000 7fe3dd600640 1 -- 172.21.15.19:0/1982188769 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8007ab0 con 0x7fe3e00cdde0 2024-04-25T10:26:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.841+0000 7fe3e5c00640 1 -- 172.21.15.19:0/1982188769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e00cdde0 msgr2=0x7fe3e00ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.841+0000 7fe3e5c00640 1 --2- 172.21.15.19:0/1982188769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e00cdde0 0x7fe3e00ce1f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009d90 tx=0x7fe3c802a6a0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.841+0000 7fe3e5c00640 1 -- 172.21.15.19:0/1982188769 shutdown_connections 2024-04-25T10:26:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.841+0000 7fe3e5c00640 1 --2- 172.21.15.19:0/1982188769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e00cdde0 0x7fe3e00ce1f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.841+0000 7fe3e5c00640 1 -- 172.21.15.19:0/1982188769 >> 172.21.15.19:0/1982188769 conn(0x7fe3e006f1f0 msgr2=0x7fe3e006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.841+0000 7fe3e5c00640 1 -- 172.21.15.19:0/1982188769 shutdown_connections 2024-04-25T10:26:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.841+0000 7fe3e5c00640 1 -- 172.21.15.19:0/1982188769 wait complete. 2024-04-25T10:26:24.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.843+0000 7fe3e5c00640 1 Processor -- start 2024-04-25T10:26:24.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.844+0000 7fe3e5c00640 1 -- start start 2024-04-25T10:26:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.845+0000 7fe3e5c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e0073d50 0x7fe3e0158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.845+0000 7fe3e5c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3e00cdde0 0x7fe3e0157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.845+0000 7fe3e5c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3e0156850 0x7fe3e0154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.845+0000 7fe3e5c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e0073830 con 0x7fe3e00cdde0 2024-04-25T10:26:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.845+0000 7fe3e5c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e0073550 con 0x7fe3e0073d50 2024-04-25T10:26:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.845+0000 7fe3e5c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e00b0620 con 0x7fe3e0156850 2024-04-25T10:26:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.845+0000 7fe3de000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3e00cdde0 0x7fe3e0157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.845+0000 7fe3de000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3e00cdde0 0x7fe3e0157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41740/0 (socket says 172.21.15.19:41740) 2024-04-25T10:26:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.845+0000 7fe3de000640 1 -- 172.21.15.19:0/4022552093 learned_addr learned my addr 172.21.15.19:0/4022552093 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.845+0000 7fe3df400640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3e0156850 0x7fe3e0154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.846+0000 7fe3de000640 1 -- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3e0156850 msgr2=0x7fe3e0154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.846+0000 7fe3de000640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3e0156850 0x7fe3e0154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.846+0000 7fe3de000640 1 -- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e0073d50 msgr2=0x7fe3e0158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.846+0000 7fe3de000640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e0073d50 0x7fe3e0158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.846+0000 7fe3de000640 1 -- 172.21.15.19:0/4022552093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e01592a0 con 0x7fe3e00cdde0 2024-04-25T10:26:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.846+0000 7fe3de000640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3e00cdde0 0x7fe3e0157670 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009d90 tx=0x7fe3c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.847+0000 7fe3d6a00640 1 -- 172.21.15.19:0/4022552093 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8040070 con 0x7fe3e00cdde0 2024-04-25T10:26:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.847+0000 7fe3d6a00640 1 -- 172.21.15.19:0/4022552093 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c8031c40 con 0x7fe3e00cdde0 2024-04-25T10:26:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.847+0000 7fe3d6a00640 1 -- 172.21.15.19:0/4022552093 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8007e70 con 0x7fe3e00cdde0 2024-04-25T10:26:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.847+0000 7fe3e5c00640 1 -- 172.21.15.19:0/4022552093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e01f36b0 con 0x7fe3e00cdde0 2024-04-25T10:26:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.849+0000 7fe3e5c00640 1 -- 172.21.15.19:0/4022552093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e0158840 con 0x7fe3e00cdde0 2024-04-25T10:26:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.850+0000 7fe3e5c00640 1 -- 172.21.15.19:0/4022552093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e00b3d90 con 0x7fe3e00cdde0 2024-04-25T10:26:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.851+0000 7fe3d6a00640 1 -- 172.21.15.19:0/4022552093 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe3c8039040 con 0x7fe3e00cdde0 2024-04-25T10:26:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.852+0000 7fe3d6a00640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe3bc0744b0 0x7fe3bc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.852+0000 7fe3d6a00640 1 -- 172.21.15.19:0/4022552093 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fe3c80b6310 con 0x7fe3e00cdde0 2024-04-25T10:26:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.853+0000 7fe3dea00640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe3bc0744b0 0x7fe3bc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.853+0000 7fe3dea00640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe3bc0744b0 0x7fe3bc0769c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0000c00 tx=0x7fe3d00079c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:24.857+0000 7fe3d6a00640 1 -- 172.21.15.19:0/4022552093 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe3e00b3d90 con 0x7fe3e00cdde0 2024-04-25T10:26:25.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.059+0000 7fe3e5c00640 1 -- 172.21.15.19:0/4022552093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe3e00c8d00 con 0x7fe3e00cdde0 2024-04-25T10:26:25.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.060+0000 7fe3d6a00640 1 -- 172.21.15.19:0/4022552093 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fe3e00c8d00 con 0x7fe3e00cdde0 2024-04-25T10:26:25.063 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-04-25T10:26:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 -- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe3bc0744b0 msgr2=0x7fe3bc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe3bc0744b0 0x7fe3bc0769c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0000c00 tx=0x7fe3d00079c0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 -- 172.21.15.19:0/4022552093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3e00cdde0 msgr2=0x7fe3e0157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3e00cdde0 0x7fe3e0157670 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009d90 tx=0x7fe3c8004a40 comp rx=0 tx=0).stop 2024-04-25T10:26:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 -- 172.21.15.19:0/4022552093 shutdown_connections 2024-04-25T10:26:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe3bc0744b0 0x7fe3bc0769c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3e0156850 0x7fe3e0154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3e00cdde0 0x7fe3e0157670 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 --2- 172.21.15.19:0/4022552093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e0073d50 0x7fe3e0158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 -- 172.21.15.19:0/4022552093 >> 172.21.15.19:0/4022552093 conn(0x7fe3e006f1f0 msgr2=0x7fe3e00ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 -- 172.21.15.19:0/4022552093 shutdown_connections 2024-04-25T10:26:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.063+0000 7fe3e5c00640 1 -- 172.21.15.19:0/4022552093 wait complete. 2024-04-25T10:26:25.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:26:25.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.384+0000 7f428fe00640 1 Processor -- start 2024-04-25T10:26:25.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.384+0000 7f428fe00640 1 -- start start 2024-04-25T10:26:25.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.386+0000 7f428fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 0x7f42900c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.386+0000 7f428fe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4290156710 0x7f429006ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.386+0000 7f428fe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4290070200 con 0x7f429006f2a0 2024-04-25T10:26:25.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.386+0000 7f428fe00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f429006ffd0 con 0x7f4290156710 2024-04-25T10:26:25.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.386+0000 7f428fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f42900c8b10 con 0x7f42900c2640 2024-04-25T10:26:25.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.387+0000 7f4286000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4290156710 0x7f429006ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.387+0000 7f428f400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f429006f2a0 0x7f429015f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:52152/0 (socket says 172.21.15.19:52152) 2024-04-25T10:26:25.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.387+0000 7f428f400640 1 -- 172.21.15.19:0/866110227 learned_addr learned my addr 172.21.15.19:0/866110227 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:25.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.387+0000 7f428ea00640 1 --2- 172.21.15.19:0/866110227 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 0x7f42900c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.387+0000 7f428e000640 1 -- 172.21.15.19:0/866110227 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 590753214 0 0) 0x7f4290070200 con 0x7f429006f2a0 2024-04-25T10:26:25.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.387+0000 7f428e000640 1 -- 172.21.15.19:0/866110227 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4274003520 con 0x7f429006f2a0 2024-04-25T10:26:25.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.387+0000 7f428ea00640 1 -- 172.21.15.19:0/866110227 >> v2:172.21.15.19:3300/0 conn(0x7f4290156710 msgr2=0x7f429006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:25.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.387+0000 7f428ea00640 1 --2- 172.21.15.19:0/866110227 >> v2:172.21.15.19:3300/0 conn(0x7f4290156710 0x7f429006ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.388+0000 7f428ea00640 1 -- 172.21.15.19:0/866110227 >> v1:172.21.15.112:6789/0 conn(0x7f429006f2a0 legacy=0x7f429015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.388+0000 7f428ea00640 1 -- 172.21.15.19:0/866110227 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42900c8d60 con 0x7f42900c2640 2024-04-25T10:26:25.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.389+0000 7f428ea00640 1 --2- 172.21.15.19:0/866110227 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 0x7f42900c9710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4280009d90 tx=0x7f428002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9125492c0972b0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:25.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.389+0000 7f428e000640 1 -- 172.21.15.19:0/866110227 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280031600 con 0x7f42900c2640 2024-04-25T10:26:25.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.389+0000 7f428e000640 1 -- 172.21.15.19:0/866110227 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42800317a0 con 0x7f42900c2640 2024-04-25T10:26:25.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.389+0000 7f428e000640 1 -- 172.21.15.19:0/866110227 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280031b70 con 0x7f42900c2640 2024-04-25T10:26:25.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.390+0000 7f428fe00640 1 -- 172.21.15.19:0/866110227 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 msgr2=0x7f42900c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.390+0000 7f428fe00640 1 --2- 172.21.15.19:0/866110227 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 0x7f42900c9710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4280009d90 tx=0x7f428002a5d0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.390+0000 7f428fe00640 1 -- 172.21.15.19:0/866110227 shutdown_connections 2024-04-25T10:26:25.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.390+0000 7f428fe00640 1 --2- 172.21.15.19:0/866110227 >> v2:172.21.15.19:3300/0 conn(0x7f4290156710 0x7f429006ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.390+0000 7f428fe00640 1 --2- 172.21.15.19:0/866110227 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 0x7f42900c9710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.390+0000 7f428fe00640 1 -- 172.21.15.19:0/866110227 >> 172.21.15.19:0/866110227 conn(0x7f42900ca120 msgr2=0x7f42900ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:25.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.390+0000 7f428fe00640 1 -- 172.21.15.19:0/866110227 shutdown_connections 2024-04-25T10:26:25.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.391+0000 7f428fe00640 1 -- 172.21.15.19:0/866110227 wait complete. 2024-04-25T10:26:25.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.393+0000 7f428fe00640 1 Processor -- start 2024-04-25T10:26:25.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.393+0000 7f428fe00640 1 -- start start 2024-04-25T10:26:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.394+0000 7f428fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429006f2a0 0x7f42901550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.394+0000 7f428fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 0x7f429014c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4290156710 0x7f4290155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428fe00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f42900c91f0 con 0x7f4290156710 2024-04-25T10:26:25.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f42900c84a0 con 0x7f429006f2a0 2024-04-25T10:26:25.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4290074990 con 0x7f42900c2640 2024-04-25T10:26:25.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4290156710 0x7f4290155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429006f2a0 0x7f42901550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f4286000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 0x7f429014c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429006f2a0 0x7f42901550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37236/0 (socket says 172.21.15.19:37236) 2024-04-25T10:26:25.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428ea00640 1 -- 172.21.15.19:0/1229853465 learned_addr learned my addr 172.21.15.19:0/1229853465 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:25.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428ea00640 1 -- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 msgr2=0x7f429014c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428ea00640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 0x7f429014c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428ea00640 1 -- 172.21.15.19:0/1229853465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4290156710 msgr2=0x7f4290155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428ea00640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4290156710 0x7f4290155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428ea00640 1 -- 172.21.15.19:0/1229853465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42901555f0 con 0x7f429006f2a0 2024-04-25T10:26:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f428f400640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4290156710 0x7f4290155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.395+0000 7f4286000640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 0x7f429014c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.396+0000 7f428ea00640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429006f2a0 0x7f42901550b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4280009eb0 tx=0x7f4280004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.396+0000 7f4287e00640 1 -- 172.21.15.19:0/1229853465 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428003f070 con 0x7f429006f2a0 2024-04-25T10:26:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.396+0000 7f4287e00640 1 -- 172.21.15.19:0/1229853465 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4280030830 con 0x7f429006f2a0 2024-04-25T10:26:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.396+0000 7f4287e00640 1 -- 172.21.15.19:0/1229853465 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280030c20 con 0x7f429006f2a0 2024-04-25T10:26:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.396+0000 7f428fe00640 1 -- 172.21.15.19:0/1229853465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4290073c10 con 0x7f429006f2a0 2024-04-25T10:26:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.396+0000 7f428fe00640 1 -- 172.21.15.19:0/1229853465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f429014fe70 con 0x7f429006f2a0 2024-04-25T10:26:25.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.398+0000 7f428fe00640 1 -- 172.21.15.19:0/1229853465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4290076520 con 0x7f429006f2a0 2024-04-25T10:26:25.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.399+0000 7f4287e00640 1 -- 172.21.15.19:0/1229853465 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4280044460 con 0x7f429006f2a0 2024-04-25T10:26:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.400+0000 7f4287e00640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f426c0744e0 0x7f426c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.400+0000 7f4287e00640 1 -- 172.21.15.19:0/1229853465 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f42800b68e0 con 0x7f429006f2a0 2024-04-25T10:26:25.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.400+0000 7f4286000640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f426c0744e0 0x7f426c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.401+0000 7f4286000640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f426c0744e0 0x7f426c0769f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4290153bb0 tx=0x7f4278009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:25.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.405+0000 7f4287e00640 1 -- 172.21.15.19:0/1229853465 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4280080730 con 0x7f429006f2a0 2024-04-25T10:26:25.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.612+0000 7f428fe00640 1 -- 172.21.15.19:0/1229853465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4290159d20 con 0x7f429006f2a0 2024-04-25T10:26:25.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.613+0000 7f4287e00640 1 -- 172.21.15.19:0/1229853465 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f4280084a30 con 0x7f429006f2a0 2024-04-25T10:26:25.617 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:26:25.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 -- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f426c0744e0 msgr2=0x7f426c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f426c0744e0 0x7f426c0769f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4290153bb0 tx=0x7f4278009190 comp rx=0 tx=0).stop 2024-04-25T10:26:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 -- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429006f2a0 msgr2=0x7f42901550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429006f2a0 0x7f42901550b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4280009eb0 tx=0x7f4280004a40 comp rx=0 tx=0).stop 2024-04-25T10:26:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 -- 172.21.15.19:0/1229853465 shutdown_connections 2024-04-25T10:26:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4290156710 0x7f4290155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f426c0744e0 0x7f426c0769f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42900c2640 0x7f429014c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 --2- 172.21.15.19:0/1229853465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f429006f2a0 0x7f42901550b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 -- 172.21.15.19:0/1229853465 >> 172.21.15.19:0/1229853465 conn(0x7f42900ca120 msgr2=0x7f429015ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:25.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 -- 172.21.15.19:0/1229853465 shutdown_connections 2024-04-25T10:26:25.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.616+0000 7f428fe00640 1 -- 172.21.15.19:0/1229853465 wait complete. 2024-04-25T10:26:25.646 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:26:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.931+0000 7f0760e00640 1 Processor -- start 2024-04-25T10:26:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.931+0000 7f0760e00640 1 -- start start 2024-04-25T10:26:25.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.933+0000 7f0760e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f075c0c9390 0x7f075c0c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.933+0000 7f0760e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f075c0c8c90 0x7f075c153150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.933+0000 7f0760e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f075c153690 con 0x7f075c0c8100 2024-04-25T10:26:25.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.933+0000 7f0760e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f075c0c2c50 con 0x7f075c0c8c90 2024-04-25T10:26:25.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.933+0000 7f0760e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f075c0c9a80 con 0x7f075c0c9390 2024-04-25T10:26:25.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.934+0000 7f075b400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f075c0c9390 0x7f075c0c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.934+0000 7f075aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f075c0c8c90 0x7f075c153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.934+0000 7f075be00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f075c0c8100 0x7f075c158fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:52154/0 (socket says 172.21.15.19:52154) 2024-04-25T10:26:25.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.934+0000 7f075be00640 1 -- 172.21.15.19:0/1286043988 learned_addr learned my addr 172.21.15.19:0/1286043988 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:25.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.934+0000 7f075b400640 1 -- 172.21.15.19:0/1286043988 >> v2:172.21.15.112:3300/0 conn(0x7f075c0c8c90 msgr2=0x7f075c153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:25.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.934+0000 7f075b400640 1 --2- 172.21.15.19:0/1286043988 >> v2:172.21.15.112:3300/0 conn(0x7f075c0c8c90 0x7f075c153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.934+0000 7f075b400640 1 -- 172.21.15.19:0/1286043988 >> v1:172.21.15.112:6789/0 conn(0x7f075c0c8100 legacy=0x7f075c158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.934+0000 7f075b400640 1 -- 172.21.15.19:0/1286043988 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075c0c9d60 con 0x7f075c0c9390 2024-04-25T10:26:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.934+0000 7f075aa00640 1 --2- 172.21.15.19:0/1286043988 >> v2:172.21.15.112:3300/0 conn(0x7f075c0c8c90 0x7f075c153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.934+0000 7f075a000640 1 -- 172.21.15.19:0/1286043988 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069221459 0 0) 0x7f075c153690 con 0x7f075c0c8100 2024-04-25T10:26:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.935+0000 7f075b400640 1 --2- 172.21.15.19:0/1286043988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f075c0c9390 0x7f075c0c44f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f075c0c2dd0 tx=0x7f074c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=408fd53543af0924 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.935+0000 7f075a000640 1 -- 172.21.15.19:0/1286043988 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c037070 con 0x7f075c0c9390 2024-04-25T10:26:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.936+0000 7f075a000640 1 -- 172.21.15.19:0/1286043988 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074c032440 con 0x7f075c0c9390 2024-04-25T10:26:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.936+0000 7f075a000640 1 -- 172.21.15.19:0/1286043988 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c032810 con 0x7f075c0c9390 2024-04-25T10:26:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.936+0000 7f0760e00640 1 -- 172.21.15.19:0/1286043988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f075c0c9390 msgr2=0x7f075c0c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.936+0000 7f0760e00640 1 --2- 172.21.15.19:0/1286043988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f075c0c9390 0x7f075c0c44f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f075c0c2dd0 tx=0x7f074c02a210 comp rx=0 tx=0).stop 2024-04-25T10:26:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.936+0000 7f0760e00640 1 -- 172.21.15.19:0/1286043988 shutdown_connections 2024-04-25T10:26:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.936+0000 7f0760e00640 1 --2- 172.21.15.19:0/1286043988 >> v2:172.21.15.112:3300/0 conn(0x7f075c0c8c90 0x7f075c153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.936+0000 7f0760e00640 1 --2- 172.21.15.19:0/1286043988 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f075c0c9390 0x7f075c0c44f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.936+0000 7f0760e00640 1 -- 172.21.15.19:0/1286043988 >> 172.21.15.19:0/1286043988 conn(0x7f075c06d120 msgr2=0x7f075c0cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.937+0000 7f0760e00640 1 -- 172.21.15.19:0/1286043988 shutdown_connections 2024-04-25T10:26:25.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.937+0000 7f0760e00640 1 -- 172.21.15.19:0/1286043988 wait complete. 2024-04-25T10:26:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.939+0000 7f0760e00640 1 Processor -- start 2024-04-25T10:26:25.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.939+0000 7f0760e00640 1 -- start start 2024-04-25T10:26:25.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f0760e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0c8100 0x7f075c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f0760e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f075c0c8c90 0x7f075c157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f0760e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f075c0c9390 0x7f075c158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f0760e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f075c159850 con 0x7f075c0c8c90 2024-04-25T10:26:25.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f0760e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f075c1596d0 con 0x7f075c0c8100 2024-04-25T10:26:25.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f0760e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f075c1599d0 con 0x7f075c0c9390 2024-04-25T10:26:25.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f075aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f075c0c8c90 0x7f075c157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f075be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f075c0c9390 0x7f075c158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f075b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0c8100 0x7f075c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f075b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0c8100 0x7f075c14ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37246/0 (socket says 172.21.15.19:37246) 2024-04-25T10:26:25.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f075aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f075c0c8c90 0x7f075c157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41764/0 (socket says 172.21.15.19:41764) 2024-04-25T10:26:25.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f075b400640 1 -- 172.21.15.19:0/3431822540 learned_addr learned my addr 172.21.15.19:0/3431822540 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:25.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f075b400640 1 -- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f075c0c9390 msgr2=0x7f075c158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f075b400640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f075c0c9390 0x7f075c158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f075b400640 1 -- 172.21.15.19:0/3431822540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f075c0c8c90 msgr2=0x7f075c157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:25.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f075b400640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f075c0c8c90 0x7f075c157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:25.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.941+0000 7f075b400640 1 -- 172.21.15.19:0/3431822540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075c14f100 con 0x7f075c0c8100 2024-04-25T10:26:25.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.942+0000 7f075b400640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0c8100 0x7f075c14ebc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f074c000c00 tx=0x7f074c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:25.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.942+0000 7f0753400640 1 -- 172.21.15.19:0/3431822540 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c037040 con 0x7f075c0c8100 2024-04-25T10:26:25.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.942+0000 7f0753400640 1 -- 172.21.15.19:0/3431822540 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074c042070 con 0x7f075c0c8100 2024-04-25T10:26:25.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.942+0000 7f0753400640 1 -- 172.21.15.19:0/3431822540 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c030920 con 0x7f075c0c8100 2024-04-25T10:26:25.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.942+0000 7f0760e00640 1 -- 172.21.15.19:0/3431822540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075c156fb0 con 0x7f075c0c8100 2024-04-25T10:26:25.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.942+0000 7f0760e00640 1 -- 172.21.15.19:0/3431822540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f075c157250 con 0x7f075c0c8100 2024-04-25T10:26:25.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.944+0000 7f0760e00640 1 -- 172.21.15.19:0/3431822540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f075c0c3710 con 0x7f075c0c8100 2024-04-25T10:26:25.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.945+0000 7f0753400640 1 -- 172.21.15.19:0/3431822540 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f074c030ac0 con 0x7f075c0c8100 2024-04-25T10:26:25.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.946+0000 7f0753400640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f073c0744e0 0x7f073c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:25.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.946+0000 7f0753400640 1 -- 172.21.15.19:0/3431822540 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f074c0b5ca0 con 0x7f075c0c8100 2024-04-25T10:26:25.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.946+0000 7f075aa00640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f073c0744e0 0x7f073c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:25.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.947+0000 7f075aa00640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f073c0744e0 0x7f073c0769f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f075c1effa0 tx=0x7f0748009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:25.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:25.951+0000 7f0753400640 1 -- 172.21.15.19:0/3431822540 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f074c07fa60 con 0x7f075c0c8100 2024-04-25T10:26:26.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.153+0000 7f0760e00640 1 -- 172.21.15.19:0/3431822540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f075c0c6790 con 0x7f075c0c8100 2024-04-25T10:26:26.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.154+0000 7f0753400640 1 -- 172.21.15.19:0/3431822540 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f074c083d60 con 0x7f075c0c8100 2024-04-25T10:26:26.156 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-04-25T10:26:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 -- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f073c0744e0 msgr2=0x7f073c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f073c0744e0 0x7f073c0769f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f075c1effa0 tx=0x7f0748009190 comp rx=0 tx=0).stop 2024-04-25T10:26:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 -- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0c8100 msgr2=0x7f075c14ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0c8100 0x7f075c14ebc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f074c000c00 tx=0x7f074c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 -- 172.21.15.19:0/3431822540 shutdown_connections 2024-04-25T10:26:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f073c0744e0 0x7f073c0769f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f075c0c9390 0x7f075c158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f075c0c8c90 0x7f075c157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 --2- 172.21.15.19:0/3431822540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0c8100 0x7f075c14ebc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 -- 172.21.15.19:0/3431822540 >> 172.21.15.19:0/3431822540 conn(0x7f075c06d120 msgr2=0x7f075c153150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 -- 172.21.15.19:0/3431822540 shutdown_connections 2024-04-25T10:26:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.157+0000 7f0760e00640 1 -- 172.21.15.19:0/3431822540 wait complete. 2024-04-25T10:26:26.189 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:26:26.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.482+0000 7fe2dc800640 1 Processor -- start 2024-04-25T10:26:26.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.482+0000 7fe2dc800640 1 -- start start 2024-04-25T10:26:26.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.484+0000 7fe2dc800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2d40c9940 0x7fe2d4161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:26.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.484+0000 7fe2dc800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe2d40c4730 0x7fe2d40c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:26.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.484+0000 7fe2dc800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d40c9e80 con 0x7fe2d415abc0 2024-04-25T10:26:26.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.484+0000 7fe2dc800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d40ca810 con 0x7fe2d40c4730 2024-04-25T10:26:26.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.484+0000 7fe2dc800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d4070b80 con 0x7fe2d40c9940 2024-04-25T10:26:26.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.485+0000 7fe2da800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe2d40c4730 0x7fe2d40c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:26.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.485+0000 7fe2d9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2d40c9940 0x7fe2d4161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:26.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.485+0000 7fe2da800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe2d40c4730 0x7fe2d40c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41772/0 (socket says 172.21.15.19:41772) 2024-04-25T10:26:26.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.485+0000 7fe2da800640 1 -- 172.21.15.19:0/3214914536 learned_addr learned my addr 172.21.15.19:0/3214914536 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:26.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.485+0000 7fe2d9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2d40c9940 0x7fe2d4161440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37248/0 (socket says 172.21.15.19:37248) 2024-04-25T10:26:26.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.485+0000 7fe2d9e00640 1 -- 172.21.15.19:0/3214914536 >> v2:172.21.15.19:3300/0 conn(0x7fe2d40c4730 msgr2=0x7fe2d40c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:26.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.485+0000 7fe2d9e00640 1 --2- 172.21.15.19:0/3214914536 >> v2:172.21.15.19:3300/0 conn(0x7fe2d40c4730 0x7fe2d40c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.485+0000 7fe2d9e00640 1 -- 172.21.15.19:0/3214914536 >> v1:172.21.15.19:6789/0 conn(0x7fe2d415abc0 legacy=0x7fe2d40cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:26.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.485+0000 7fe2d9e00640 1 -- 172.21.15.19:0/3214914536 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d406ff70 con 0x7fe2d40c9940 2024-04-25T10:26:26.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.486+0000 7fe2d9e00640 1 --2- 172.21.15.19:0/3214914536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2d40c9940 0x7fe2d4161440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4074d20 tx=0x7fe2c802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82d3765486afc3aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:26.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.487+0000 7fe2d8a00640 1 -- 172.21.15.19:0/3214914536 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8037070 con 0x7fe2d40c9940 2024-04-25T10:26:26.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.487+0000 7fe2d8a00640 1 -- 172.21.15.19:0/3214914536 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c8032440 con 0x7fe2d40c9940 2024-04-25T10:26:26.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.487+0000 7fe2d8a00640 1 -- 172.21.15.19:0/3214914536 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8032810 con 0x7fe2d40c9940 2024-04-25T10:26:26.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.488+0000 7fe2dc800640 1 -- 172.21.15.19:0/3214914536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2d40c9940 msgr2=0x7fe2d4161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:26.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.488+0000 7fe2dc800640 1 --2- 172.21.15.19:0/3214914536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2d40c9940 0x7fe2d4161440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4074d20 tx=0x7fe2c802a1a0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.488+0000 7fe2dc800640 1 -- 172.21.15.19:0/3214914536 shutdown_connections 2024-04-25T10:26:26.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.488+0000 7fe2dc800640 1 --2- 172.21.15.19:0/3214914536 >> v2:172.21.15.19:3300/0 conn(0x7fe2d40c4730 0x7fe2d40c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.488+0000 7fe2dc800640 1 --2- 172.21.15.19:0/3214914536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2d40c9940 0x7fe2d4161440 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.488+0000 7fe2dc800640 1 -- 172.21.15.19:0/3214914536 >> 172.21.15.19:0/3214914536 conn(0x7fe2d4072200 msgr2=0x7fe2d4072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:26.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.488+0000 7fe2dc800640 1 -- 172.21.15.19:0/3214914536 shutdown_connections 2024-04-25T10:26:26.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.488+0000 7fe2dc800640 1 -- 172.21.15.19:0/3214914536 wait complete. 2024-04-25T10:26:26.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.491+0000 7fe2dc800640 1 Processor -- start 2024-04-25T10:26:26.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.492+0000 7fe2dc800640 1 -- start start 2024-04-25T10:26:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.494+0000 7fe2dc800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2d40c4730 0x7fe2d41f7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.494+0000 7fe2dc800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2d40c9940 0x7fe2d415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.494+0000 7fe2dc800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2d415abc0 0x7fe2d415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.494+0000 7fe2dc800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d4070810 con 0x7fe2d40c9940 2024-04-25T10:26:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.494+0000 7fe2dc800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d4070530 con 0x7fe2d40c4730 2024-04-25T10:26:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.494+0000 7fe2dc800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d40c5080 con 0x7fe2d415abc0 2024-04-25T10:26:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.494+0000 7fe2d9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2d40c4730 0x7fe2d41f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.494+0000 7fe2d9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2d40c9940 0x7fe2d415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.494+0000 7fe2da800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2d415abc0 0x7fe2d415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.494+0000 7fe2d9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2d40c4730 0x7fe2d41f7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37252/0 (socket says 172.21.15.19:37252) 2024-04-25T10:26:26.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.494+0000 7fe2d9e00640 1 -- 172.21.15.19:0/2870477092 learned_addr learned my addr 172.21.15.19:0/2870477092 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.495+0000 7fe2d9e00640 1 -- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2d415abc0 msgr2=0x7fe2d415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.495+0000 7fe2d9e00640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2d415abc0 0x7fe2d415b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.495+0000 7fe2d9e00640 1 -- 172.21.15.19:0/2870477092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2d40c9940 msgr2=0x7fe2d415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.495+0000 7fe2d9e00640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2d40c9940 0x7fe2d415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.495+0000 7fe2d9e00640 1 -- 172.21.15.19:0/2870477092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d41f6af0 con 0x7fe2d40c4730 2024-04-25T10:26:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.495+0000 7fe2d9e00640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2d40c4730 0x7fe2d41f7290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009890 tx=0x7fe2c80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.495+0000 7fe2ce000640 1 -- 172.21.15.19:0/2870477092 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8037040 con 0x7fe2d40c4730 2024-04-25T10:26:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.495+0000 7fe2ce000640 1 -- 172.21.15.19:0/2870477092 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c8042070 con 0x7fe2d40c4730 2024-04-25T10:26:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.495+0000 7fe2ce000640 1 -- 172.21.15.19:0/2870477092 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8030960 con 0x7fe2d40c4730 2024-04-25T10:26:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.495+0000 7fe2dc800640 1 -- 172.21.15.19:0/2870477092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d41f77d0 con 0x7fe2d40c4730 2024-04-25T10:26:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.496+0000 7fe2dc800640 1 -- 172.21.15.19:0/2870477092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d415d3d0 con 0x7fe2d40c4730 2024-04-25T10:26:26.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.497+0000 7fe2dc800640 1 -- 172.21.15.19:0/2870477092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d41fa060 con 0x7fe2d40c4730 2024-04-25T10:26:26.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.498+0000 7fe2ce000640 1 -- 172.21.15.19:0/2870477092 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe2c8030b00 con 0x7fe2d40c4730 2024-04-25T10:26:26.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.499+0000 7fe2ce000640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe2b80744b0 0x7fe2b80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:26.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.499+0000 7fe2ce000640 1 -- 172.21.15.19:0/2870477092 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fe2c80b5e10 con 0x7fe2d40c4730 2024-04-25T10:26:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.499+0000 7fe2d9400640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe2b80744b0 0x7fe2b80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.500+0000 7fe2d9400640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe2b80744b0 0x7fe2b80769c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4151eb0 tx=0x7fe2c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:26.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.504+0000 7fe2ce000640 1 -- 172.21.15.19:0/2870477092 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe2d41fa060 con 0x7fe2d40c4730 2024-04-25T10:26:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.712+0000 7fe2dc800640 1 -- 172.21.15.19:0/2870477092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe2d4076520 con 0x7fe2d40c4730 2024-04-25T10:26:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.713+0000 7fe2ce000640 1 -- 172.21.15.19:0/2870477092 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fe2c80b9030 con 0x7fe2d40c4730 2024-04-25T10:26:26.716 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 -- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe2b80744b0 msgr2=0x7fe2b80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe2b80744b0 0x7fe2b80769c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4151eb0 tx=0x7fe2c4009040 comp rx=0 tx=0).stop 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 -- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2d40c4730 msgr2=0x7fe2d41f7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2d40c4730 0x7fe2d41f7290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009890 tx=0x7fe2c80046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 -- 172.21.15.19:0/2870477092 shutdown_connections 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe2b80744b0 0x7fe2b80769c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2d415abc0 0x7fe2d415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2d40c9940 0x7fe2d415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 --2- 172.21.15.19:0/2870477092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2d40c4730 0x7fe2d41f7290 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 -- 172.21.15.19:0/2870477092 >> 172.21.15.19:0/2870477092 conn(0x7fe2d4072200 msgr2=0x7fe2d406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 -- 172.21.15.19:0/2870477092 shutdown_connections 2024-04-25T10:26:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:26.716+0000 7fe2dc800640 1 -- 172.21.15.19:0/2870477092 wait complete. 2024-04-25T10:26:26.745 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:26:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.020+0000 7fe48a200640 1 Processor -- start 2024-04-25T10:26:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.020+0000 7fe48a200640 1 -- start start 2024-04-25T10:26:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.022+0000 7fe48a200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840b42e0 0x7fe48415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.022+0000 7fe48a200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe48415d0b0 0x7fe48415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.022+0000 7fe48a200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe484160310 con 0x7fe4840cd1f0 2024-04-25T10:26:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.022+0000 7fe48a200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe484160e50 con 0x7fe48415d0b0 2024-04-25T10:26:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.022+0000 7fe48a200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe4841605b0 con 0x7fe4840b42e0 2024-04-25T10:26:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.022+0000 7fe483400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840b42e0 0x7fe48415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.022+0000 7fe482a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe48415d0b0 0x7fe48415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.022+0000 7fe483e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe4840cd1f0 0x7fe4840ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:52166/0 (socket says 172.21.15.19:52166) 2024-04-25T10:26:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.022+0000 7fe483400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840b42e0 0x7fe48415c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:60206/0 (socket says 172.21.15.19:60206) 2024-04-25T10:26:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.022+0000 7fe483e00640 1 -- 172.21.15.19:0/2888764767 learned_addr learned my addr 172.21.15.19:0/2888764767 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.022+0000 7fe482a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe48415d0b0 0x7fe48415d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:37256/0 (socket says 172.21.15.19:37256) 2024-04-25T10:26:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.023+0000 7fe483400640 1 -- 172.21.15.19:0/2888764767 >> v2:172.21.15.112:3300/0 conn(0x7fe48415d0b0 msgr2=0x7fe48415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.023+0000 7fe483400640 1 --2- 172.21.15.19:0/2888764767 >> v2:172.21.15.112:3300/0 conn(0x7fe48415d0b0 0x7fe48415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.023+0000 7fe483400640 1 -- 172.21.15.19:0/2888764767 >> v1:172.21.15.112:6789/0 conn(0x7fe4840cd1f0 legacy=0x7fe4840ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.023+0000 7fe483400640 1 -- 172.21.15.19:0/2888764767 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe484160890 con 0x7fe4840b42e0 2024-04-25T10:26:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.024+0000 7fe483400640 1 --2- 172.21.15.19:0/2888764767 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840b42e0 0x7fe48415c2d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4740097a0 tx=0x7fe47402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa9f4592d2bd1f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.024+0000 7fe482000640 1 -- 172.21.15.19:0/2888764767 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474037070 con 0x7fe4840b42e0 2024-04-25T10:26:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.024+0000 7fe482000640 1 -- 172.21.15.19:0/2888764767 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47402ae50 con 0x7fe4840b42e0 2024-04-25T10:26:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.024+0000 7fe482000640 1 -- 172.21.15.19:0/2888764767 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474032660 con 0x7fe4840b42e0 2024-04-25T10:26:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.025+0000 7fe48a200640 1 -- 172.21.15.19:0/2888764767 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840b42e0 msgr2=0x7fe48415c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.025+0000 7fe48a200640 1 --2- 172.21.15.19:0/2888764767 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840b42e0 0x7fe48415c2d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4740097a0 tx=0x7fe47402a100 comp rx=0 tx=0).stop 2024-04-25T10:26:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.025+0000 7fe48a200640 1 -- 172.21.15.19:0/2888764767 shutdown_connections 2024-04-25T10:26:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.025+0000 7fe48a200640 1 --2- 172.21.15.19:0/2888764767 >> v2:172.21.15.112:3300/0 conn(0x7fe48415d0b0 0x7fe48415d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.025+0000 7fe48a200640 1 --2- 172.21.15.19:0/2888764767 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840b42e0 0x7fe48415c2d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.025+0000 7fe48a200640 1 -- 172.21.15.19:0/2888764767 >> 172.21.15.19:0/2888764767 conn(0x7fe48406ecf0 msgr2=0x7fe48406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.025+0000 7fe48a200640 1 -- 172.21.15.19:0/2888764767 shutdown_connections 2024-04-25T10:26:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.025+0000 7fe48a200640 1 -- 172.21.15.19:0/2888764767 wait complete. 2024-04-25T10:26:27.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.027+0000 7fe48a200640 1 Processor -- start 2024-04-25T10:26:27.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.028+0000 7fe48a200640 1 -- start start 2024-04-25T10:26:27.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.029+0000 7fe48a200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4840b42e0 0x7fe4840b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:27.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.029+0000 7fe48a200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840cd1f0 0x7fe4841f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:27.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.029+0000 7fe48a200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe48415d0b0 0x7fe4841e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:27.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.029+0000 7fe48a200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe4840b7950 con 0x7fe4840b42e0 2024-04-25T10:26:27.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.029+0000 7fe48a200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe48415cb90 con 0x7fe48415d0b0 2024-04-25T10:26:27.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.029+0000 7fe48a200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe48415c810 con 0x7fe4840cd1f0 2024-04-25T10:26:27.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.029+0000 7fe483400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4840b42e0 0x7fe4840b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:27.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.030+0000 7fe483400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4840b42e0 0x7fe4840b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41802/0 (socket says 172.21.15.19:41802) 2024-04-25T10:26:27.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.030+0000 7fe483400640 1 -- 172.21.15.19:0/3156484244 learned_addr learned my addr 172.21.15.19:0/3156484244 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:27.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.030+0000 7fe483e00640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe48415d0b0 0x7fe4841e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:27.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.030+0000 7fe482a00640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840cd1f0 0x7fe4841f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:27.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.030+0000 7fe482a00640 1 -- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe48415d0b0 msgr2=0x7fe4841e5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.030+0000 7fe482a00640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe48415d0b0 0x7fe4841e5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.030+0000 7fe482a00640 1 -- 172.21.15.19:0/3156484244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4840b42e0 msgr2=0x7fe4840b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.030+0000 7fe482a00640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4840b42e0 0x7fe4840b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.030+0000 7fe482a00640 1 -- 172.21.15.19:0/3156484244 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe484157aa0 con 0x7fe4840cd1f0 2024-04-25T10:26:27.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.030+0000 7fe482a00640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840cd1f0 0x7fe4841f6580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00ebc0 tx=0x7fe46c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:27.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.031+0000 7fe47b400640 1 -- 172.21.15.19:0/3156484244 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c018020 con 0x7fe4840cd1f0 2024-04-25T10:26:27.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.031+0000 7fe47b400640 1 -- 172.21.15.19:0/3156484244 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46c00cda0 con 0x7fe4840cd1f0 2024-04-25T10:26:27.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.031+0000 7fe48a200640 1 -- 172.21.15.19:0/3156484244 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4841f2950 con 0x7fe4840cd1f0 2024-04-25T10:26:27.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.031+0000 7fe47b400640 1 -- 172.21.15.19:0/3156484244 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0146c0 con 0x7fe4840cd1f0 2024-04-25T10:26:27.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.031+0000 7fe48a200640 1 -- 172.21.15.19:0/3156484244 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe484158330 con 0x7fe4840cd1f0 2024-04-25T10:26:27.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.032+0000 7fe48a200640 1 -- 172.21.15.19:0/3156484244 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe484076520 con 0x7fe4840cd1f0 2024-04-25T10:26:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.034+0000 7fe47b400640 1 -- 172.21.15.19:0/3156484244 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe46c005d10 con 0x7fe4840cd1f0 2024-04-25T10:26:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.034+0000 7fe47b400640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe4600744b0 0x7fe4600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.035+0000 7fe47b400640 1 -- 172.21.15.19:0/3156484244 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fe46c03de00 con 0x7fe4840cd1f0 2024-04-25T10:26:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.035+0000 7fe483400640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe4600744b0 0x7fe4600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.036+0000 7fe483400640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe4600744b0 0x7fe4600769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe47402a140 tx=0x7fe47402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:27.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.038+0000 7fe47b400640 1 -- 172.21.15.19:0/3156484244 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe46c022020 con 0x7fe4840cd1f0 2024-04-25T10:26:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.286+0000 7fe48a200640 1 -- 172.21.15.19:0/3156484244 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe48415f1b0 con 0x7fe4840cd1f0 2024-04-25T10:26:27.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.287+0000 7fe47b400640 1 -- 172.21.15.19:0/3156484244 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7fe46c010040 con 0x7fe4840cd1f0 2024-04-25T10:26:27.290 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:27.290 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:26:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 -- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe4600744b0 msgr2=0x7fe4600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe4600744b0 0x7fe4600769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe47402a140 tx=0x7fe47402e000 comp rx=0 tx=0).stop 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 -- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840cd1f0 msgr2=0x7fe4841f6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840cd1f0 0x7fe4841f6580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00ebc0 tx=0x7fe46c00c490 comp rx=0 tx=0).stop 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 -- 172.21.15.19:0/3156484244 shutdown_connections 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe48415d0b0 0x7fe4841e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fe4600744b0 0x7fe4600769c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe4840cd1f0 0x7fe4841f6580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 --2- 172.21.15.19:0/3156484244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4840b42e0 0x7fe4840b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 -- 172.21.15.19:0/3156484244 >> 172.21.15.19:0/3156484244 conn(0x7fe48406ecf0 msgr2=0x7fe48415e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 -- 172.21.15.19:0/3156484244 shutdown_connections 2024-04-25T10:26:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.290+0000 7fe48a200640 1 -- 172.21.15.19:0/3156484244 wait complete. 2024-04-25T10:26:27.322 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:27.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.600+0000 7fed37000640 1 Processor -- start 2024-04-25T10:26:27.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.600+0000 7fed37000640 1 -- start start 2024-04-25T10:26:27.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.603+0000 7fed37000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed30074460 0x7fed300ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.603+0000 7fed37000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed300af780 con 0x7fed300cdde0 2024-04-25T10:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.603+0000 7fed37000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed30156c60 con 0x7fed30156850 2024-04-25T10:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.603+0000 7fed37000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fed300af1c0 con 0x7fed30074460 2024-04-25T10:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.603+0000 7fed35000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed30074460 0x7fed300ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.603+0000 7fed35000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed30074460 0x7fed300ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41816/0 (socket says 172.21.15.19:41816) 2024-04-25T10:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.603+0000 7fed35000640 1 -- 172.21.15.19:0/986273125 learned_addr learned my addr 172.21.15.19:0/986273125 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.603+0000 7fed35000640 1 -- 172.21.15.19:0/986273125 >> v1:172.21.15.112:6789/0 conn(0x7fed30156850 legacy=0x7fed3015d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.603+0000 7fed35000640 1 -- 172.21.15.19:0/986273125 >> v1:172.21.15.19:6789/0 conn(0x7fed300cdde0 legacy=0x7fed30073d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.603+0000 7fed35000640 1 -- 172.21.15.19:0/986273125 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed300af4a0 con 0x7fed30074460 2024-04-25T10:26:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.604+0000 7fed35000640 1 --2- 172.21.15.19:0/986273125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed30074460 0x7fed300ce1f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fed28009e50 tx=0x7fed2802a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e511fa08ea285d0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:27.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.605+0000 7fed2ea00640 1 -- 172.21.15.19:0/986273125 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28037070 con 0x7fed30074460 2024-04-25T10:26:27.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.605+0000 7fed2ea00640 1 -- 172.21.15.19:0/986273125 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2802e050 con 0x7fed30074460 2024-04-25T10:26:27.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.605+0000 7fed2ea00640 1 -- 172.21.15.19:0/986273125 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28032860 con 0x7fed30074460 2024-04-25T10:26:27.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.605+0000 7fed37000640 1 -- 172.21.15.19:0/986273125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed30074460 msgr2=0x7fed300ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.605+0000 7fed37000640 1 --2- 172.21.15.19:0/986273125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed30074460 0x7fed300ce1f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fed28009e50 tx=0x7fed2802a850 comp rx=0 tx=0).stop 2024-04-25T10:26:27.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.606+0000 7fed37000640 1 -- 172.21.15.19:0/986273125 shutdown_connections 2024-04-25T10:26:27.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.606+0000 7fed37000640 1 --2- 172.21.15.19:0/986273125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed30074460 0x7fed300ce1f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.606+0000 7fed37000640 1 -- 172.21.15.19:0/986273125 >> 172.21.15.19:0/986273125 conn(0x7fed3006f1f0 msgr2=0x7fed3006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:27.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.606+0000 7fed37000640 1 -- 172.21.15.19:0/986273125 shutdown_connections 2024-04-25T10:26:27.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.606+0000 7fed37000640 1 -- 172.21.15.19:0/986273125 wait complete. 2024-04-25T10:26:27.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.608+0000 7fed37000640 1 Processor -- start 2024-04-25T10:26:27.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.608+0000 7fed37000640 1 -- start start 2024-04-25T10:26:27.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.609+0000 7fed37000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed30074460 0x7fed301f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:27.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.609+0000 7fed37000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed300cdde0 0x7fed301e6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:27.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.609+0000 7fed37000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed30156850 0x7fed301529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:27.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.609+0000 7fed37000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fed30073830 con 0x7fed30074460 2024-04-25T10:26:27.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.609+0000 7fed37000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fed30073550 con 0x7fed300cdde0 2024-04-25T10:26:27.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.610+0000 7fed37000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fed300b0620 con 0x7fed30156850 2024-04-25T10:26:27.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.610+0000 7fed2fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed30074460 0x7fed301f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:27.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.610+0000 7fed2f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed300cdde0 0x7fed301e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:27.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.610+0000 7fed35000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed30156850 0x7fed301529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:27.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.610+0000 7fed2fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed30074460 0x7fed301f6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41818/0 (socket says 172.21.15.19:41818) 2024-04-25T10:26:27.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.610+0000 7fed2fe00640 1 -- 172.21.15.19:0/163785877 learned_addr learned my addr 172.21.15.19:0/163785877 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:27.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.610+0000 7fed2fe00640 1 -- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed30156850 msgr2=0x7fed301529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.610+0000 7fed2fe00640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed30156850 0x7fed301529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.610+0000 7fed2fe00640 1 -- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed300cdde0 msgr2=0x7fed301e6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.610+0000 7fed2fe00640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed300cdde0 0x7fed301e6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.610+0000 7fed2fe00640 1 -- 172.21.15.19:0/163785877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed30153630 con 0x7fed30074460 2024-04-25T10:26:27.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.611+0000 7fed2fe00640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed30074460 0x7fed301f6c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fed2000c400 tx=0x7fed2000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:27.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.611+0000 7fed27e00640 1 -- 172.21.15.19:0/163785877 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20017070 con 0x7fed30074460 2024-04-25T10:26:27.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.611+0000 7fed27e00640 1 -- 172.21.15.19:0/163785877 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed200052d0 con 0x7fed30074460 2024-04-25T10:26:27.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.611+0000 7fed27e00640 1 -- 172.21.15.19:0/163785877 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20003830 con 0x7fed30074460 2024-04-25T10:26:27.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.611+0000 7fed37000640 1 -- 172.21.15.19:0/163785877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed301e6540 con 0x7fed30074460 2024-04-25T10:26:27.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.611+0000 7fed37000640 1 -- 172.21.15.19:0/163785877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed300b26a0 con 0x7fed30074460 2024-04-25T10:26:27.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.612+0000 7fed37000640 1 -- 172.21.15.19:0/163785877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed30076520 con 0x7fed30074460 2024-04-25T10:26:27.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.613+0000 7fed27e00640 1 -- 172.21.15.19:0/163785877 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fed2001a070 con 0x7fed30074460 2024-04-25T10:26:27.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.614+0000 7fed27e00640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fed100744e0 0x7fed100769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:27.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.614+0000 7fed27e00640 1 -- 172.21.15.19:0/163785877 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fed20094820 con 0x7fed30074460 2024-04-25T10:26:27.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.615+0000 7fed2f400640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fed100744e0 0x7fed100769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:27.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.615+0000 7fed2f400640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fed100744e0 0x7fed100769f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fed300c4b40 tx=0x7fed1c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:27.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.620+0000 7fed27e00640 1 -- 172.21.15.19:0/163785877 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed30153630 con 0x7fed30074460 2024-04-25T10:26:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.825+0000 7fed37000640 1 -- 172.21.15.19:0/163785877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed300b1410 con 0x7fed30074460 2024-04-25T10:26:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.828+0000 7fed27e00640 1 -- 172.21.15.19:0/163785877 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7fed2005e5f0 con 0x7fed30074460 2024-04-25T10:26:27.831 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:27.831 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:26:18.399567+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 -- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fed100744e0 msgr2=0x7fed100769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fed100744e0 0x7fed100769f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fed300c4b40 tx=0x7fed1c009040 comp rx=0 tx=0).stop 2024-04-25T10:26:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 -- 172.21.15.19:0/163785877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed30074460 msgr2=0x7fed301f6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed30074460 0x7fed301f6c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fed2000c400 tx=0x7fed2000c8c0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 -- 172.21.15.19:0/163785877 shutdown_connections 2024-04-25T10:26:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fed100744e0 0x7fed100769f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed30156850 0x7fed301529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed300cdde0 0x7fed301e6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 --2- 172.21.15.19:0/163785877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed30074460 0x7fed301f6c80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 -- 172.21.15.19:0/163785877 >> 172.21.15.19:0/163785877 conn(0x7fed3006f1f0 msgr2=0x7fed3006c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:27.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 -- 172.21.15.19:0/163785877 shutdown_connections 2024-04-25T10:26:27.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:27.831+0000 7fed37000640 1 -- 172.21.15.19:0/163785877 wait complete. 2024-04-25T10:26:27.859 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:26:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.135+0000 7fc61b200640 1 Processor -- start 2024-04-25T10:26:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.136+0000 7fc61b200640 1 -- start start 2024-04-25T10:26:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.138+0000 7fc61b200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc61415a370 0x7fc614070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.138+0000 7fc61b200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc614073d20 0x7fc614154060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.138+0000 7fc61b200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc61415a8b0 con 0x7fc6140c7f90 2024-04-25T10:26:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.138+0000 7fc61b200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc614072ea0 con 0x7fc61415a370 2024-04-25T10:26:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.138+0000 7fc61b200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc614073180 con 0x7fc614073d20 2024-04-25T10:26:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.139+0000 7fc619400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc6140c7f90 0x7fc614073610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52412/0 (socket says 172.21.15.19:52412) 2024-04-25T10:26:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.139+0000 7fc619400640 1 -- 172.21.15.19:0/2584429577 learned_addr learned my addr 172.21.15.19:0/2584429577 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.139+0000 7fc61a800640 1 --2- 172.21.15.19:0/2584429577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc614073d20 0x7fc614154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.139+0000 7fc619e00640 1 --2- 172.21.15.19:0/2584429577 >> v2:172.21.15.19:3300/0 conn(0x7fc61415a370 0x7fc614070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.139+0000 7fc61a800640 1 -- 172.21.15.19:0/2584429577 >> v2:172.21.15.19:3300/0 conn(0x7fc61415a370 msgr2=0x7fc614070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.139+0000 7fc61a800640 1 --2- 172.21.15.19:0/2584429577 >> v2:172.21.15.19:3300/0 conn(0x7fc61415a370 0x7fc614070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.139+0000 7fc61a800640 1 -- 172.21.15.19:0/2584429577 >> v1:172.21.15.19:6789/0 conn(0x7fc6140c7f90 legacy=0x7fc614073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.139+0000 7fc61a800640 1 -- 172.21.15.19:0/2584429577 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61415ab70 con 0x7fc614073d20 2024-04-25T10:26:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.141+0000 7fc61a800640 1 --2- 172.21.15.19:0/2584429577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc614073d20 0x7fc614154060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc610009d90 tx=0x7fc61002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89c7284cbd33247b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.141+0000 7fc618a00640 1 -- 172.21.15.19:0/2584429577 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610031600 con 0x7fc614073d20 2024-04-25T10:26:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.141+0000 7fc618a00640 1 -- 172.21.15.19:0/2584429577 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6100317a0 con 0x7fc614073d20 2024-04-25T10:26:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.141+0000 7fc618a00640 1 -- 172.21.15.19:0/2584429577 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610031b70 con 0x7fc614073d20 2024-04-25T10:26:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.142+0000 7fc61b200640 1 -- 172.21.15.19:0/2584429577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc614073d20 msgr2=0x7fc614154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.142+0000 7fc61b200640 1 --2- 172.21.15.19:0/2584429577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc614073d20 0x7fc614154060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc610009d90 tx=0x7fc61002a5d0 comp rx=0 tx=0).stop 2024-04-25T10:26:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.142+0000 7fc61b200640 1 -- 172.21.15.19:0/2584429577 shutdown_connections 2024-04-25T10:26:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.142+0000 7fc61b200640 1 --2- 172.21.15.19:0/2584429577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc614073d20 0x7fc614154060 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.142+0000 7fc61b200640 1 --2- 172.21.15.19:0/2584429577 >> v2:172.21.15.19:3300/0 conn(0x7fc61415a370 0x7fc614070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.142+0000 7fc61b200640 1 -- 172.21.15.19:0/2584429577 >> 172.21.15.19:0/2584429577 conn(0x7fc6140cdbc0 msgr2=0x7fc6140ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.142+0000 7fc61b200640 1 -- 172.21.15.19:0/2584429577 shutdown_connections 2024-04-25T10:26:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.142+0000 7fc61b200640 1 -- 172.21.15.19:0/2584429577 wait complete. 2024-04-25T10:26:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.145+0000 7fc61b200640 1 Processor -- start 2024-04-25T10:26:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.146+0000 7fc61b200640 1 -- start start 2024-04-25T10:26:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc61b200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6140c7f90 0x7fc6141e5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc61b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc61415a370 0x7fc61414f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc61b200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc614156410 0x7fc614156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc61b200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140c4b20 con 0x7fc614156410 2024-04-25T10:26:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc61b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc61415b130 con 0x7fc61415a370 2024-04-25T10:26:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc61b200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc614070da0 con 0x7fc6140c7f90 2024-04-25T10:26:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc619e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6140c7f90 0x7fc6141e5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc619e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6140c7f90 0x7fc6141e5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:37464/0 (socket says 172.21.15.19:37464) 2024-04-25T10:26:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc619400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc61415a370 0x7fc61414f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc619e00640 1 -- 172.21.15.19:0/1901336071 learned_addr learned my addr 172.21.15.19:0/1901336071 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc61a800640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc614156410 0x7fc614156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:28.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.148+0000 7fc619e00640 1 -- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc61415a370 msgr2=0x7fc61414f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:28.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.149+0000 7fc619e00640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc61415a370 0x7fc61414f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:28.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.149+0000 7fc619e00640 1 -- 172.21.15.19:0/1901336071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc614156410 msgr2=0x7fc614156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:28.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.149+0000 7fc619e00640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc614156410 0x7fc614156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.149+0000 7fc619e00640 1 -- 172.21.15.19:0/1901336071 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6141e6050 con 0x7fc6140c7f90 2024-04-25T10:26:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.149+0000 7fc619400640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc61415a370 0x7fc61414f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.149+0000 7fc619e00640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6140c7f90 0x7fc6141e5b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc60800e8a0 tx=0x7fc60800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.149+0000 7fc60e000640 1 -- 172.21.15.19:0/1901336071 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608017070 con 0x7fc6140c7f90 2024-04-25T10:26:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.149+0000 7fc60e000640 1 -- 172.21.15.19:0/1901336071 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60800c8e0 con 0x7fc6140c7f90 2024-04-25T10:26:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.149+0000 7fc60e000640 1 -- 172.21.15.19:0/1901336071 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60800ccd0 con 0x7fc6140c7f90 2024-04-25T10:26:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.149+0000 7fc61b200640 1 -- 172.21.15.19:0/1901336071 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc614157cb0 con 0x7fc6140c7f90 2024-04-25T10:26:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.149+0000 7fc61b200640 1 -- 172.21.15.19:0/1901336071 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6141579d0 con 0x7fc6140c7f90 2024-04-25T10:26:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.151+0000 7fc61b200640 1 -- 172.21.15.19:0/1901336071 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc614050740 con 0x7fc6140c7f90 2024-04-25T10:26:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.152+0000 7fc60e000640 1 -- 172.21.15.19:0/1901336071 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc60801a070 con 0x7fc6140c7f90 2024-04-25T10:26:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.153+0000 7fc60e000640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc5f80744e0 0x7fc5f80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:28.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.153+0000 7fc60e000640 1 -- 172.21.15.19:0/1901336071 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fc608095750 con 0x7fc6140c7f90 2024-04-25T10:26:28.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.153+0000 7fc619400640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc5f80744e0 0x7fc5f80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:28.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.154+0000 7fc619400640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc5f80744e0 0x7fc5f80769f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc6141e5270 tx=0x7fc604009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.158+0000 7fc60e000640 1 -- 172.21.15.19:0/1901336071 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc60805f480 con 0x7fc6140c7f90 2024-04-25T10:26:28.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.411+0000 7fc61b200640 1 -- 172.21.15.19:0/1901336071 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6140c59e0 con 0x7fc6140c7f90 2024-04-25T10:26:28.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.412+0000 7fc60e000640 1 -- 172.21.15.19:0/1901336071 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7fc608063780 con 0x7fc6140c7f90 2024-04-25T10:26:28.415 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:28.415 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:26:28.415 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:26:28.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.415+0000 7fc61b200640 1 -- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc5f80744e0 msgr2=0x7fc5f80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:28.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.415+0000 7fc61b200640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc5f80744e0 0x7fc5f80769f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc6141e5270 tx=0x7fc604009040 comp rx=0 tx=0).stop 2024-04-25T10:26:28.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.415+0000 7fc61b200640 1 -- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6140c7f90 msgr2=0x7fc6141e5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:28.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.415+0000 7fc61b200640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6140c7f90 0x7fc6141e5b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc60800e8a0 tx=0x7fc60800ed60 comp rx=0 tx=0).stop 2024-04-25T10:26:28.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.415+0000 7fc61b200640 1 -- 172.21.15.19:0/1901336071 shutdown_connections 2024-04-25T10:26:28.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.415+0000 7fc61b200640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc614156410 0x7fc614156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:28.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.415+0000 7fc61b200640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc61415a370 0x7fc61414f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:28.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.415+0000 7fc61b200640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc5f80744e0 0x7fc5f80769f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:28.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.415+0000 7fc61b200640 1 --2- 172.21.15.19:0/1901336071 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6140c7f90 0x7fc6141e5b10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:28.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.415+0000 7fc61b200640 1 -- 172.21.15.19:0/1901336071 >> 172.21.15.19:0/1901336071 conn(0x7fc6140cdbc0 msgr2=0x7fc6140c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:28.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.415+0000 7fc61b200640 1 -- 172.21.15.19:0/1901336071 shutdown_connections 2024-04-25T10:26:28.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:28.416+0000 7fc61b200640 1 -- 172.21.15.19:0/1901336071 wait complete. 2024-04-25T10:26:29.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:25:36.724799+0000', 'modified': '2024-04-25T10:26:19.423318+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4309, 'mds_1': 4288, 'mds_2': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.112:6837/3008138931', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 3008138931}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 3008138931}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4288': {'gid': 4288, 'name': 'f', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.112:6839/3638094761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 3638094761}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 3638094761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4309': {'gid': 4309, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.19:6835/1037719859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6834', 'nonce': 1037719859}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 1037719859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4309, 'qdb_cluster': [4285, 4288, 4309]} 2024-04-25T10:26:29.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-25T10:26:29.048 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T10:26:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.349+0000 7f2945000640 1 Processor -- start 2024-04-25T10:26:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.349+0000 7f2945000640 1 -- start start 2024-04-25T10:26:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.351+0000 7f2945000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f294015fb80 0x7f294015ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.351+0000 7f2945000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29400c7690 con 0x7f29400c6760 2024-04-25T10:26:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.351+0000 7f2945000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294015c610 con 0x7f29400c71a0 2024-04-25T10:26:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.351+0000 7f2945000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f294015d220 con 0x7f294015fb80 2024-04-25T10:26:29.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.352+0000 7f2937e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f29400c6760 0x7f29400d1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52426/0 (socket says 172.21.15.19:52426) 2024-04-25T10:26:29.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.352+0000 7f2937e00640 1 -- 172.21.15.19:0/3063184612 learned_addr learned my addr 172.21.15.19:0/3063184612 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:29.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.352+0000 7f293fe00640 1 --2- 172.21.15.19:0/3063184612 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f294015fb80 0x7f294015ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.352+0000 7f293ea00640 1 -- 172.21.15.19:0/3063184612 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330526331 0 0) 0x7f29400c7690 con 0x7f29400c6760 2024-04-25T10:26:29.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.352+0000 7f293ea00640 1 -- 172.21.15.19:0/3063184612 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2924003520 con 0x7f29400c6760 2024-04-25T10:26:29.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.352+0000 7f293ea00640 1 -- 172.21.15.19:0/3063184612 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1413668956 0 0) 0x7f294015c610 con 0x7f29400c71a0 2024-04-25T10:26:29.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.352+0000 7f293fe00640 1 -- 172.21.15.19:0/3063184612 >> v1:172.21.15.112:6789/0 conn(0x7f29400c71a0 legacy=0x7f2940156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.352+0000 7f293fe00640 1 -- 172.21.15.19:0/3063184612 >> v1:172.21.15.19:6789/0 conn(0x7f29400c6760 legacy=0x7f29400d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.352+0000 7f293fe00640 1 -- 172.21.15.19:0/3063184612 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294015c8f0 con 0x7f294015fb80 2024-04-25T10:26:29.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.354+0000 7f293fe00640 1 --2- 172.21.15.19:0/3063184612 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f294015fb80 0x7f294015ff90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2938009dc0 tx=0x7f293802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b4dd9225a9f21c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.354+0000 7f293ea00640 1 -- 172.21.15.19:0/3063184612 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938007740 con 0x7f294015fb80 2024-04-25T10:26:29.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.354+0000 7f293ea00640 1 -- 172.21.15.19:0/3063184612 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29380078e0 con 0x7f294015fb80 2024-04-25T10:26:29.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.354+0000 7f293ea00640 1 -- 172.21.15.19:0/3063184612 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938007c90 con 0x7f294015fb80 2024-04-25T10:26:29.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.355+0000 7f2945000640 1 -- 172.21.15.19:0/3063184612 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f294015fb80 msgr2=0x7f294015ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.355+0000 7f2945000640 1 --2- 172.21.15.19:0/3063184612 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f294015fb80 0x7f294015ff90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2938009dc0 tx=0x7f293802a6d0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.355+0000 7f2945000640 1 -- 172.21.15.19:0/3063184612 shutdown_connections 2024-04-25T10:26:29.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.355+0000 7f2945000640 1 --2- 172.21.15.19:0/3063184612 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f294015fb80 0x7f294015ff90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.355+0000 7f2945000640 1 -- 172.21.15.19:0/3063184612 >> 172.21.15.19:0/3063184612 conn(0x7f294008dad0 msgr2=0x7f294008dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.355+0000 7f2945000640 1 -- 172.21.15.19:0/3063184612 shutdown_connections 2024-04-25T10:26:29.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.355+0000 7f2945000640 1 -- 172.21.15.19:0/3063184612 wait complete. 2024-04-25T10:26:29.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.357+0000 7f2945000640 1 Processor -- start 2024-04-25T10:26:29.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.357+0000 7f2945000640 1 -- start start 2024-04-25T10:26:29.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.359+0000 7f2945000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29400c6760 0x7f294014f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.359+0000 7f2945000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29400c71a0 0x7f29400cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.359+0000 7f2945000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f294015fb80 0x7f29401f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.359+0000 7f2945000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f29401604d0 con 0x7f294015fb80 2024-04-25T10:26:29.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.359+0000 7f2945000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f294015ceb0 con 0x7f29400c6760 2024-04-25T10:26:29.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.359+0000 7f2945000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f29400b5850 con 0x7f29400c71a0 2024-04-25T10:26:29.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.359+0000 7f293fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f294015fb80 0x7f29401f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.359+0000 7f2937e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29400c71a0 0x7f29400cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.359+0000 7f293fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f294015fb80 0x7f29401f2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54940/0 (socket says 172.21.15.19:54940) 2024-04-25T10:26:29.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.359+0000 7f293fe00640 1 -- 172.21.15.19:0/3587815022 learned_addr learned my addr 172.21.15.19:0/3587815022 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:29.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.359+0000 7f293f400640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29400c6760 0x7f294014f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f293fe00640 1 -- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29400c71a0 msgr2=0x7f29400cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f293fe00640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29400c71a0 0x7f29400cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f293fe00640 1 -- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29400c6760 msgr2=0x7f294014f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f293fe00640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29400c6760 0x7f294014f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f293fe00640 1 -- 172.21.15.19:0/3587815022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29401f2c70 con 0x7f294015fb80 2024-04-25T10:26:29.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f293f400640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29400c6760 0x7f294014f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:29.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f2937e00640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29400c71a0 0x7f29400cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:29.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f293fe00640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f294015fb80 0x7f29401f2730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f293802acc0 tx=0x7f2938004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f2937400640 1 -- 172.21.15.19:0/3587815022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293803f070 con 0x7f294015fb80 2024-04-25T10:26:29.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f2937400640 1 -- 172.21.15.19:0/3587815022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2938031c40 con 0x7f294015fb80 2024-04-25T10:26:29.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f2937400640 1 -- 172.21.15.19:0/3587815022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938009450 con 0x7f294015fb80 2024-04-25T10:26:29.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.360+0000 7f2945000640 1 -- 172.21.15.19:0/3587815022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294015d650 con 0x7f294015fb80 2024-04-25T10:26:29.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.361+0000 7f2945000640 1 -- 172.21.15.19:0/3587815022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f294015dc10 con 0x7f294015fb80 2024-04-25T10:26:29.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.363+0000 7f2937400640 1 -- 172.21.15.19:0/3587815022 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2938044460 con 0x7f294015fb80 2024-04-25T10:26:29.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.364+0000 7f2937400640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f291c0744b0 0x7f291c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.364+0000 7f2937400640 1 -- 172.21.15.19:0/3587815022 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f29380b6d30 con 0x7f294015fb80 2024-04-25T10:26:29.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.365+0000 7f293f400640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f291c0744b0 0x7f291c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.365+0000 7f294d591740 1 Processor -- start 2024-04-25T10:26:29.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.365+0000 7f294d591740 1 -- start start 2024-04-25T10:26:29.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.366+0000 7f293f400640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f291c0744b0 0x7f291c0769c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2930000f60 tx=0x7f2930009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f294d591740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 0x559f1471dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f294d591740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f294d591740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f14319590 0x559f14701b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f294d591740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559f14640600 con 0x559f143113b0 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f294d591740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559f145dd100 con 0x559f1433a270 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f294d591740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x559f1463c5c0 con 0x559f14319590 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f2937e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f293f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 0x559f1471dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f2937e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54942/0 (socket says 172.21.15.19:54942) 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f293f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 0x559f1471dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:36022/0 (socket says 172.21.15.19:36022) 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f2937e00640 1 -- 172.21.15.19:0/2049636213 learned_addr learned my addr 172.21.15.19:0/2049636213 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.367+0000 7f293fe00640 1 --2- 172.21.15.19:0/2049636213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f14319590 0x559f14701b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.368+0000 7f2937e00640 1 -- 172.21.15.19:0/2049636213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f14319590 msgr2=0x559f14701b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.368+0000 7f2937e00640 1 --2- 172.21.15.19:0/2049636213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f14319590 0x559f14701b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.368+0000 7f2937e00640 1 -- 172.21.15.19:0/2049636213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 msgr2=0x559f1471dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.368+0000 7f2937e00640 1 --2- 172.21.15.19:0/2049636213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 0x559f1471dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.368+0000 7f2937e00640 1 -- 172.21.15.19:0/2049636213 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f143522d0 con 0x559f143113b0 2024-04-25T10:26:29.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.368+0000 7f293f400640 1 --2- 172.21.15.19:0/2049636213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 0x559f1471dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:29.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.368+0000 7f2937e00640 1 --2- 172.21.15.19:0/2049636213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2928001bf0 tx=0x7f2928000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef3e9d8c32d0bb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.368+0000 7f292fe00640 1 -- 172.21.15.19:0/2049636213 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292800fe50 con 0x559f143113b0 2024-04-25T10:26:29.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.368+0000 7f292fe00640 1 -- 172.21.15.19:0/2049636213 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2928018070 con 0x559f143113b0 2024-04-25T10:26:29.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.368+0000 7f292fe00640 1 -- 172.21.15.19:0/2049636213 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928005ad0 con 0x559f143113b0 2024-04-25T10:26:29.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.369+0000 7f294d591740 1 -- 172.21.15.19:0/2049636213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 msgr2=0x559f14701600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.369+0000 7f294d591740 1 --2- 172.21.15.19:0/2049636213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2928001bf0 tx=0x7f2928000bc0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.369+0000 7f294d591740 1 -- 172.21.15.19:0/2049636213 shutdown_connections 2024-04-25T10:26:29.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.369+0000 7f294d591740 1 --2- 172.21.15.19:0/2049636213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f14319590 0x559f14701b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.369+0000 7f294d591740 1 --2- 172.21.15.19:0/2049636213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.369+0000 7f294d591740 1 --2- 172.21.15.19:0/2049636213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 0x559f1471dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.369+0000 7f294d591740 1 -- 172.21.15.19:0/2049636213 >> 172.21.15.19:0/2049636213 conn(0x559f1432e3c0 msgr2=0x559f146dbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.369+0000 7f294d591740 1 -- 172.21.15.19:0/2049636213 shutdown_connections 2024-04-25T10:26:29.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.369+0000 7f294d591740 1 -- 172.21.15.19:0/2049636213 wait complete. 2024-04-25T10:26:29.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.370+0000 7f294d591740 1 -- start start 2024-04-25T10:26:29.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.371+0000 7f294d591740 1 Processor -- start 2024-04-25T10:26:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.372+0000 7f294d591740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f1471a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.372+0000 7f294d591740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f14319590 0x559f14714c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.372+0000 7f294d591740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 0x559f14718690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.372+0000 7f294d591740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559f146dba60 con 0x559f143113b0 2024-04-25T10:26:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.372+0000 7f294d591740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559f145c7f70 con 0x559f1433a270 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.372+0000 7f294d591740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x559f14715d20 con 0x559f14319590 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.372+0000 7f294d591740 10 client.0 _ll_register_callbacks cb 0x559f14636480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f293f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f1471a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f293f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f1471a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54944/0 (socket says 172.21.15.19:54944) 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f293f400640 1 -- 172.21.15.19:0/1706850514 learned_addr learned my addr 172.21.15.19:0/1706850514 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f293fe00640 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 0x559f14718690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f2937e00640 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f14319590 0x559f14714c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f293f400640 1 -- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f14319590 msgr2=0x559f14714c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f293f400640 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f14319590 0x559f14714c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f293f400640 1 -- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 msgr2=0x559f14718690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f293f400640 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 0x559f14718690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f293f400640 1 -- 172.21.15.19:0/1706850514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f1441c6b0 con 0x559f143113b0 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f293f400640 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f1471a200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2930014990 tx=0x7f2930001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf31b34f134c946 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.373+0000 7f292cc00640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-04-25T10:26:29.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.374+0000 7f292cc00640 1 -- 172.21.15.19:0/1706850514 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930025020 con 0x559f143113b0 2024-04-25T10:26:29.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.374+0000 7f292cc00640 1 -- 172.21.15.19:0/1706850514 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f2930013b40 con 0x559f143113b0 2024-04-25T10:26:29.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.374+0000 7f294d591740 1 -- 172.21.15.19:0/1706850514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2928018070 con 0x559f143113b0 2024-04-25T10:26:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.374+0000 7f292cc00640 1 -- 172.21.15.19:0/1706850514 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f293002f050 con 0x559f143113b0 2024-04-25T10:26:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.374+0000 7f294d591740 10 client.4776 fetch_fsmap learned FSMap version 14 2024-04-25T10:26:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.374+0000 7f294d591740 1 -- 172.21.15.19:0/1706850514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x559f147190a0 con 0x559f143113b0 2024-04-25T10:26:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.374+0000 7f292cc00640 1 -- 172.21.15.19:0/1706850514 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2928018070 con 0x559f143113b0 2024-04-25T10:26:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.375+0000 7f292cc00640 1 -- 172.21.15.19:0/1706850514 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f2930032020 con 0x559f143113b0 2024-04-25T10:26:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.375+0000 7f294d591740 10 client.4776 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T10:26:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.375+0000 7f294d591740 10 client.4776 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:26:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.375+0000 7f294d591740 20 client.4776 populate_metadata read hostname 'smithi019' 2024-04-25T10:26:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.375+0000 7f294d591740 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:6836/3008138931,v1:172.21.15.112:6837/3008138931] conn(0x559f142f8e40 0x559f14703170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.375+0000 7f294d591740 4 client.4776 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.375+0000 7f294d591740 1 -- 172.21.15.19:0/1706850514 --> [v2:172.21.15.112:6836/3008138931,v1:172.21.15.112:6837/3008138931] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f1464e210 con 0x559f142f8e40 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.375+0000 7f2937e00640 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:6836/3008138931,v1:172.21.15.112:6837/3008138931] conn(0x559f142f8e40 0x559f14703170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.376+0000 7f2937e00640 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:6836/3008138931,v1:172.21.15.112:6837/3008138931] conn(0x559f142f8e40 0x559f14703170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c97832f2bef5457 server_cookie=921aa320dd2f6bf3 in_seq=0 out_seq=0 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.376+0000 7f292cc00640 10 client.4776 ms_handle_connect on v2:172.21.15.112:6836/3008138931 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f292cc00640 1 -- 172.21.15.19:0/1706850514 <== mds.2 v2:172.21.15.112:6836/3008138931 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559f1464e210 con 0x559f142f8e40 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f292cc00640 10 client.4776 handle_command_reply: tid=0 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f294d591740 1 client.4776 shutdown 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f294d591740 1 -- 172.21.15.19:0/1706850514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 msgr2=0x559f1471a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f294d591740 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f1471a200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2930014990 tx=0x7f2930001080 comp rx=0 tx=0).stop 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f294d591740 1 -- 172.21.15.19:0/1706850514 shutdown_connections 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f294d591740 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1433a270 0x559f14718690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f294d591740 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:6836/3008138931,v1:172.21.15.112:6837/3008138931] conn(0x559f142f8e40 0x559f14703170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f294d591740 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f14319590 0x559f14714c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f294d591740 1 --2- 172.21.15.19:0/1706850514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f1471a200 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f292cc00640 0 client.4776 ms_handle_reset on v2:172.21.15.112:6836/3008138931 2024-04-25T10:26:29.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f294d591740 1 -- 172.21.15.19:0/1706850514 >> 172.21.15.19:0/1706850514 conn(0x559f1432e3c0 msgr2=0x559f147065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f294d591740 1 -- 172.21.15.19:0/1706850514 shutdown_connections 2024-04-25T10:26:29.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.377+0000 7f294d591740 1 -- 172.21.15.19:0/1706850514 wait complete. 2024-04-25T10:26:29.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.378+0000 7f294d591740 20 client.4776 trim_cache size 0 max 16384 2024-04-25T10:26:29.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.399+0000 7f294d591740 1 Processor -- start 2024-04-25T10:26:29.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.399+0000 7f294d591740 1 -- start start 2024-04-25T10:26:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.400+0000 7f294d591740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.400+0000 7f294d591740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f14319590 0x559f147017c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.400+0000 7f294d591740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f1433a270 0x559f14740ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.400+0000 7f294d591740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f29401feb90 con 0x559f143113b0 2024-04-25T10:26:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.400+0000 7f294d591740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559f14715150 con 0x559f14319590 2024-04-25T10:26:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.400+0000 7f294d591740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x559f14702a30 con 0x559f1433a270 2024-04-25T10:26:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.400+0000 7f293f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.400+0000 7f293f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54956/0 (socket says 172.21.15.19:54956) 2024-04-25T10:26:29.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.400+0000 7f293f400640 1 -- 172.21.15.19:0/2273148873 learned_addr learned my addr 172.21.15.19:0/2273148873 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:29.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.401+0000 7f2937e00640 1 --2- 172.21.15.19:0/2273148873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f14319590 0x559f147017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.401+0000 7f293fe00640 1 --2- 172.21.15.19:0/2273148873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f1433a270 0x559f14740ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.401+0000 7f293f400640 1 -- 172.21.15.19:0/2273148873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f1433a270 msgr2=0x559f14740ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.401+0000 7f293f400640 1 --2- 172.21.15.19:0/2273148873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f1433a270 0x559f14740ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.401+0000 7f293f400640 1 -- 172.21.15.19:0/2273148873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f14319590 msgr2=0x559f147017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.401+0000 7f293f400640 1 --2- 172.21.15.19:0/2273148873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f14319590 0x559f147017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.401+0000 7f293f400640 1 -- 172.21.15.19:0/2273148873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f14719d30 con 0x559f143113b0 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.401+0000 7f293f400640 1 --2- 172.21.15.19:0/2273148873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2930013880 tx=0x7f2930021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cda53728fd90f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.401+0000 7f292f400640 1 -- 172.21.15.19:0/2273148873 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930025070 con 0x559f143113b0 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.402+0000 7f292f400640 1 -- 172.21.15.19:0/2273148873 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f293001b070 con 0x559f143113b0 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.402+0000 7f292f400640 1 -- 172.21.15.19:0/2273148873 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29300067b0 con 0x559f143113b0 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.402+0000 7f294d591740 1 -- 172.21.15.19:0/2273148873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 msgr2=0x559f14701280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.402+0000 7f294d591740 1 --2- 172.21.15.19:0/2273148873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2930013880 tx=0x7f2930021000 comp rx=0 tx=0).stop 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.402+0000 7f294d591740 1 -- 172.21.15.19:0/2273148873 shutdown_connections 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.402+0000 7f294d591740 1 --2- 172.21.15.19:0/2273148873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f1433a270 0x559f14740ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.402+0000 7f294d591740 1 --2- 172.21.15.19:0/2273148873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f14319590 0x559f147017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.402+0000 7f294d591740 1 --2- 172.21.15.19:0/2273148873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f143113b0 0x559f14701280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.402+0000 7f294d591740 1 -- 172.21.15.19:0/2273148873 >> 172.21.15.19:0/2273148873 conn(0x559f1432e3c0 msgr2=0x559f1471a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.403+0000 7f294d591740 1 -- 172.21.15.19:0/2273148873 shutdown_connections 2024-04-25T10:26:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.403+0000 7f294d591740 1 -- 172.21.15.19:0/2273148873 wait complete. 2024-04-25T10:26:29.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.403+0000 7f294d591740 1 -- start start 2024-04-25T10:26:29.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.404+0000 7f294d591740 1 Processor -- start 2024-04-25T10:26:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.405+0000 7f294d591740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f143113b0 0x559f146dc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.405+0000 7f294d591740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f14319590 0x559f147a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.405+0000 7f294d591740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f1433a270 0x559f14703840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.405+0000 7f294d591740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559f147036c0 con 0x559f14319590 2024-04-25T10:26:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.405+0000 7f294d591740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559f14702ff0 con 0x559f143113b0 2024-04-25T10:26:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.405+0000 7f294d591740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x559f14730b60 con 0x559f1433a270 2024-04-25T10:26:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.405+0000 7f294d591740 10 client.0 _ll_register_callbacks cb 0x7f2930001850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:26:29.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f293f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f143113b0 0x559f146dc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f293f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f143113b0 0x559f146dc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:36042/0 (socket says 172.21.15.19:36042) 2024-04-25T10:26:29.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f293fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f1433a270 0x559f14703840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f293f400640 1 -- 172.21.15.19:0/625356724 learned_addr learned my addr 172.21.15.19:0/625356724 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:29.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f2937e00640 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f14319590 0x559f147a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f293f400640 1 -- 172.21.15.19:0/625356724 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f1433a270 msgr2=0x559f14703840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f293f400640 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f1433a270 0x559f14703840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f293f400640 1 -- 172.21.15.19:0/625356724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f14319590 msgr2=0x559f147a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f293f400640 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f14319590 0x559f147a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f293f400640 1 -- 172.21.15.19:0/625356724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f146db100 con 0x559f143113b0 2024-04-25T10:26:29.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f293f400640 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f143113b0 0x559f146dc1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f293002c040 tx=0x7f2930014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ef1c623ca4865dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.406+0000 7f292cc00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-04-25T10:26:29.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.407+0000 7f292cc00640 1 -- 172.21.15.19:0/625356724 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930025040 con 0x559f143113b0 2024-04-25T10:26:29.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.407+0000 7f294d591740 1 -- 172.21.15.19:0/625356724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f293001b070 con 0x559f143113b0 2024-04-25T10:26:29.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.407+0000 7f292cc00640 1 -- 172.21.15.19:0/625356724 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f2930007410 con 0x559f143113b0 2024-04-25T10:26:29.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.407+0000 7f292cc00640 1 -- 172.21.15.19:0/625356724 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f2930048050 con 0x559f143113b0 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.407+0000 7f294d591740 10 client.4852 fetch_fsmap learned FSMap version 14 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.407+0000 7f294d591740 1 -- 172.21.15.19:0/625356724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x559f146d6370 con 0x559f143113b0 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.407+0000 7f292cc00640 1 -- 172.21.15.19:0/625356724 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f293001b070 con 0x559f143113b0 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.407+0000 7f292cc00640 1 -- 172.21.15.19:0/625356724 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f293004b020 con 0x559f143113b0 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.407+0000 7f294d591740 10 client.4852 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.407+0000 7f294d591740 10 client.4852 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.407+0000 7f294d591740 20 client.4852 populate_metadata read hostname 'smithi019' 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.408+0000 7f294d591740 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.112:6836/3008138931,v1:172.21.15.112:6837/3008138931] conn(0x559f146d6770 0x559f14725020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.408+0000 7f294d591740 4 client.4852 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.408+0000 7f294d591740 1 -- 172.21.15.19:0/625356724 --> [v2:172.21.15.112:6836/3008138931,v1:172.21.15.112:6837/3008138931] -- command(tid 0: {"prefix": "status"}) -- 0x559f14648080 con 0x559f146d6770 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.408+0000 7f2937e00640 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.112:6836/3008138931,v1:172.21.15.112:6837/3008138931] conn(0x559f146d6770 0x559f14725020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.408+0000 7f2937e00640 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.112:6836/3008138931,v1:172.21.15.112:6837/3008138931] conn(0x559f146d6770 0x559f14725020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=140f2c8e903022eb server_cookie=7badf1a9c2f3a040 in_seq=0 out_seq=0 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.408+0000 7f292cc00640 10 client.4852 ms_handle_connect on v2:172.21.15.112:6836/3008138931 2024-04-25T10:26:29.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f292cc00640 1 -- 172.21.15.19:0/625356724 <== mds.2 v2:172.21.15.112:6836/3008138931 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559f14648080 con 0x559f146d6770 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f292cc00640 10 client.4852 handle_command_reply: tid=0 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 1 client.4852 shutdown 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 1 -- 172.21.15.19:0/625356724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f143113b0 msgr2=0x559f146dc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f143113b0 0x559f146dc1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f293002c040 tx=0x7f2930014000 comp rx=0 tx=0).stop 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 1 -- 172.21.15.19:0/625356724 shutdown_connections 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.112:6836/3008138931,v1:172.21.15.112:6837/3008138931] conn(0x559f146d6770 0x559f14725020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559f1433a270 0x559f14703840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f14319590 0x559f147a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 1 --2- 172.21.15.19:0/625356724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f143113b0 0x559f146dc1a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 1 -- 172.21.15.19:0/625356724 >> 172.21.15.19:0/625356724 conn(0x559f1432e3c0 msgr2=0x559f1471af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f292cc00640 0 client.4852 ms_handle_reset on v2:172.21.15.112:6836/3008138931 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 1 -- 172.21.15.19:0/625356724 shutdown_connections 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 1 -- 172.21.15.19:0/625356724 wait complete. 2024-04-25T10:26:29.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.409+0000 7f294d591740 20 client.4852 trim_cache size 0 max 16384 2024-04-25T10:26:29.415 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:26:29.415 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "03c2053f-8374-429e-9fda-d77b86219935", 2024-04-25T10:26:29.415 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 2, 2024-04-25T10:26:29.415 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4285, 2024-04-25T10:26:29.415 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-04-25T10:26:29.415 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-04-25T10:26:29.415 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-04-25T10:26:29.415 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 15.043662214999999, 2024-04-25T10:26:29.415 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 14, 2024-04-25T10:26:29.415 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 26, 2024-04-25T10:26:29.416 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T10:26:29.416 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 58.308860869999997 2024-04-25T10:26:29.416 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:26:29.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 -- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f291c0744b0 msgr2=0x7f291c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f291c0744b0 0x7f291c0769c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2930000f60 tx=0x7f2930009040 comp rx=0 tx=0).stop 2024-04-25T10:26:29.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 -- 172.21.15.19:0/3587815022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f294015fb80 msgr2=0x7f29401f2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f294015fb80 0x7f29401f2730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f293802acc0 tx=0x7f2938004a40 comp rx=0 tx=0).stop 2024-04-25T10:26:29.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 -- 172.21.15.19:0/3587815022 shutdown_connections 2024-04-25T10:26:29.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f294015fb80 0x7f29401f2730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f291c0744b0 0x7f291c0769c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29400c71a0 0x7f29400cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 --2- 172.21.15.19:0/3587815022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29400c6760 0x7f294014f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 -- 172.21.15.19:0/3587815022 >> 172.21.15.19:0/3587815022 conn(0x7f294008dad0 msgr2=0x7f2940075af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 -- 172.21.15.19:0/3587815022 shutdown_connections 2024-04-25T10:26:29.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.410+0000 7f2945000640 1 -- 172.21.15.19:0/3587815022 wait complete. 2024-04-25T10:26:29.438 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T10:26:29.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:26:29.612 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:26:29.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.715+0000 7f3295600640 1 Processor -- start 2024-04-25T10:26:29.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.715+0000 7f3295600640 1 -- start start 2024-04-25T10:26:29.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.717+0000 7f3295600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329015b2c0 0x7f32900c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.718+0000 7f3295600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3290073160 0x7f329015e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.718+0000 7f3295600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3290158010 con 0x7f329015e760 2024-04-25T10:26:29.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.718+0000 7f3295600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3290074970 con 0x7f3290073160 2024-04-25T10:26:29.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.718+0000 7f3295600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f32900c8600 con 0x7f329015b2c0 2024-04-25T10:26:29.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.718+0000 7f328f400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f329015e760 0x7f32900cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52434/0 (socket says 172.21.15.19:52434) 2024-04-25T10:26:29.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.718+0000 7f328f400640 1 -- 172.21.15.19:0/3659440423 learned_addr learned my addr 172.21.15.19:0/3659440423 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:29.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.718+0000 7f328e000640 1 --2- 172.21.15.19:0/3659440423 >> v2:172.21.15.19:3300/0 conn(0x7f3290073160 0x7f329015e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.718+0000 7f328ea00640 1 --2- 172.21.15.19:0/3659440423 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329015b2c0 0x7f32900c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.719+0000 7f328d600640 1 -- 172.21.15.19:0/3659440423 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327920551 0 0) 0x7f3290158010 con 0x7f329015e760 2024-04-25T10:26:29.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.719+0000 7f328ea00640 1 -- 172.21.15.19:0/3659440423 >> v2:172.21.15.19:3300/0 conn(0x7f3290073160 msgr2=0x7f329015e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.719+0000 7f328ea00640 1 --2- 172.21.15.19:0/3659440423 >> v2:172.21.15.19:3300/0 conn(0x7f3290073160 0x7f329015e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.719+0000 7f328ea00640 1 -- 172.21.15.19:0/3659440423 >> v1:172.21.15.19:6789/0 conn(0x7f329015e760 legacy=0x7f32900cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.719+0000 7f328ea00640 1 -- 172.21.15.19:0/3659440423 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32900c88e0 con 0x7f329015b2c0 2024-04-25T10:26:29.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.720+0000 7f328ea00640 1 --2- 172.21.15.19:0/3659440423 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329015b2c0 0x7f32900c9810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f32800097a0 tx=0x7f328002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbb4770d1b1a26ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.720+0000 7f328d600640 1 -- 172.21.15.19:0/3659440423 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280037070 con 0x7f329015b2c0 2024-04-25T10:26:29.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.720+0000 7f328d600640 1 -- 172.21.15.19:0/3659440423 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3280032440 con 0x7f329015b2c0 2024-04-25T10:26:29.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.720+0000 7f328d600640 1 -- 172.21.15.19:0/3659440423 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280032810 con 0x7f329015b2c0 2024-04-25T10:26:29.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.721+0000 7f3295600640 1 -- 172.21.15.19:0/3659440423 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329015b2c0 msgr2=0x7f32900c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.721+0000 7f3295600640 1 --2- 172.21.15.19:0/3659440423 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329015b2c0 0x7f32900c9810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f32800097a0 tx=0x7f328002a210 comp rx=0 tx=0).stop 2024-04-25T10:26:29.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.721+0000 7f3295600640 1 -- 172.21.15.19:0/3659440423 shutdown_connections 2024-04-25T10:26:29.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.721+0000 7f3295600640 1 --2- 172.21.15.19:0/3659440423 >> v2:172.21.15.19:3300/0 conn(0x7f3290073160 0x7f329015e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.721+0000 7f3295600640 1 --2- 172.21.15.19:0/3659440423 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329015b2c0 0x7f32900c9810 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.721+0000 7f3295600640 1 -- 172.21.15.19:0/3659440423 >> 172.21.15.19:0/3659440423 conn(0x7f329006f1f0 msgr2=0x7f329006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.721+0000 7f3295600640 1 -- 172.21.15.19:0/3659440423 shutdown_connections 2024-04-25T10:26:29.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.721+0000 7f3295600640 1 -- 172.21.15.19:0/3659440423 wait complete. 2024-04-25T10:26:29.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.723+0000 7f3295600640 1 Processor -- start 2024-04-25T10:26:29.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.724+0000 7f3295600640 1 -- start start 2024-04-25T10:26:29.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.725+0000 7f3295600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290073160 0x7f32900c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.725+0000 7f3295600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f329015e760 0x7f3290156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.725+0000 7f3295600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32900c4df0 0x7f32900c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.725+0000 7f3295600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f329006d4c0 con 0x7f329015e760 2024-04-25T10:26:29.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.725+0000 7f3295600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f329015a580 con 0x7f32900c4df0 2024-04-25T10:26:29.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.725+0000 7f3295600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f32900ce4f0 con 0x7f3290073160 2024-04-25T10:26:29.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.725+0000 7f328e000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f329015e760 0x7f3290156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.725+0000 7f328e000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f329015e760 0x7f3290156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54986/0 (socket says 172.21.15.19:54986) 2024-04-25T10:26:29.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.725+0000 7f328e000640 1 -- 172.21.15.19:0/1256721236 learned_addr learned my addr 172.21.15.19:0/1256721236 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:29.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.726+0000 7f328ea00640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290073160 0x7f32900c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.726+0000 7f328f400640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32900c4df0 0x7f32900c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.726+0000 7f328e000640 1 -- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290073160 msgr2=0x7f32900c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.726+0000 7f328e000640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290073160 0x7f32900c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.726+0000 7f328e000640 1 -- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32900c4df0 msgr2=0x7f32900c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.726+0000 7f328e000640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32900c4df0 0x7f32900c5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.726+0000 7f328e000640 1 -- 172.21.15.19:0/1256721236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32900c73d0 con 0x7f329015e760 2024-04-25T10:26:29.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.726+0000 7f328e000640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f329015e760 0x7f3290156270 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f327c00e8a0 tx=0x7f327c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.727+0000 7f3286a00640 1 -- 172.21.15.19:0/1256721236 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c017070 con 0x7f329015e760 2024-04-25T10:26:29.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.727+0000 7f3286a00640 1 -- 172.21.15.19:0/1256721236 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327c00c940 con 0x7f329015e760 2024-04-25T10:26:29.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.727+0000 7f3286a00640 1 -- 172.21.15.19:0/1256721236 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c009e60 con 0x7f329015e760 2024-04-25T10:26:29.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.727+0000 7f3295600640 1 -- 172.21.15.19:0/1256721236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32900c30a0 con 0x7f329015e760 2024-04-25T10:26:29.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.727+0000 7f3295600640 1 -- 172.21.15.19:0/1256721236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32900c3660 con 0x7f329015e760 2024-04-25T10:26:29.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.730+0000 7f3286a00640 1 -- 172.21.15.19:0/1256721236 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f327c01a070 con 0x7f329015e760 2024-04-25T10:26:29.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.731+0000 7f3286a00640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32700744b0 0x7f32700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.731+0000 7f3286a00640 1 -- 172.21.15.19:0/1256721236 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f327c0956a0 con 0x7f329015e760 2024-04-25T10:26:29.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.731+0000 7f328ea00640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32700744b0 0x7f32700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.731+0000 7f329c632740 1 Processor -- start 2024-04-25T10:26:29.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.731+0000 7f329c632740 1 -- start start 2024-04-25T10:26:29.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.732+0000 7f328ea00640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32700744b0 0x7f32700769c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3280034000 tx=0x7f328002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.733+0000 7f329c632740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 0x556848210e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.733+0000 7f329c632740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e043b0 0x5568481f4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.733+0000 7f329c632740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e0c590 0x5568481f4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.733+0000 7f329c632740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556848133600 con 0x556847e0c590 2024-04-25T10:26:29.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.733+0000 7f329c632740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5568480d0100 con 0x556847e2d270 2024-04-25T10:26:29.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.733+0000 7f329c632740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55684812f5c0 con 0x556847e043b0 2024-04-25T10:26:29.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.733+0000 7f328f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e0c590 0x5568481f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.733+0000 7f328ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 0x556848210e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.733+0000 7f328f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e0c590 0x5568481f4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54998/0 (socket says 172.21.15.19:54998) 2024-04-25T10:26:29.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.733+0000 7f328f400640 1 -- 172.21.15.19:0/896488230 learned_addr learned my addr 172.21.15.19:0/896488230 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:29.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.733+0000 7f328e000640 1 --2- 172.21.15.19:0/896488230 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e043b0 0x5568481f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.734+0000 7f328f400640 1 -- 172.21.15.19:0/896488230 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e043b0 msgr2=0x5568481f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.734+0000 7f328f400640 1 --2- 172.21.15.19:0/896488230 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e043b0 0x5568481f4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.734+0000 7f328f400640 1 -- 172.21.15.19:0/896488230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 msgr2=0x556848210e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.734+0000 7f328f400640 1 --2- 172.21.15.19:0/896488230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 0x556848210e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.734+0000 7f328f400640 1 -- 172.21.15.19:0/896488230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556847e452d0 con 0x556847e0c590 2024-04-25T10:26:29.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.734+0000 7f328ea00640 1 --2- 172.21.15.19:0/896488230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 0x556848210e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:29.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.734+0000 7f328f400640 1 --2- 172.21.15.19:0/896488230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e0c590 0x5568481f4970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3288001bc0 tx=0x7f3288002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e084b8be50ea595b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.734+0000 7f327b000640 1 -- 172.21.15.19:0/896488230 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288007850 con 0x556847e0c590 2024-04-25T10:26:29.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.734+0000 7f327b000640 1 -- 172.21.15.19:0/896488230 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3288018070 con 0x556847e0c590 2024-04-25T10:26:29.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.734+0000 7f327b000640 1 -- 172.21.15.19:0/896488230 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32880135f0 con 0x556847e0c590 2024-04-25T10:26:29.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.735+0000 7f329c632740 1 -- 172.21.15.19:0/896488230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e0c590 msgr2=0x5568481f4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.735+0000 7f329c632740 1 --2- 172.21.15.19:0/896488230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e0c590 0x5568481f4970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3288001bc0 tx=0x7f3288002080 comp rx=0 tx=0).stop 2024-04-25T10:26:29.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.735+0000 7f329c632740 1 -- 172.21.15.19:0/896488230 shutdown_connections 2024-04-25T10:26:29.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.735+0000 7f329c632740 1 --2- 172.21.15.19:0/896488230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e0c590 0x5568481f4970 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.735+0000 7f329c632740 1 --2- 172.21.15.19:0/896488230 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e043b0 0x5568481f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.735+0000 7f329c632740 1 --2- 172.21.15.19:0/896488230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 0x556848210e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.735+0000 7f329c632740 1 -- 172.21.15.19:0/896488230 >> 172.21.15.19:0/896488230 conn(0x556847e213c0 msgr2=0x5568481cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.735+0000 7f329c632740 1 -- 172.21.15.19:0/896488230 shutdown_connections 2024-04-25T10:26:29.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.735+0000 7f329c632740 1 -- 172.21.15.19:0/896488230 wait complete. 2024-04-25T10:26:29.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.736+0000 7f329c632740 1 -- start start 2024-04-25T10:26:29.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.737+0000 7f329c632740 1 Processor -- start 2024-04-25T10:26:29.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.738+0000 7f329c632740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e043b0 0x5568481cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.738+0000 7f329c632740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x556848208d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.738+0000 7f329c632740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 0x556848207620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.738+0000 7f329c632740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5568481ce890 con 0x556847e043b0 2024-04-25T10:26:29.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.738+0000 7f329c632740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5568480baf70 con 0x556847e2d270 2024-04-25T10:26:29.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.738+0000 7f329c632740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5568481f78d0 con 0x556847e0c590 2024-04-25T10:26:29.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.738+0000 7f329c632740 10 client.0 _ll_register_callbacks cb 0x556848129480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:26:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.738+0000 7f328f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 0x556848207620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f328e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x556848208d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f328f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 0x556848207620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:36074/0 (socket says 172.21.15.19:36074) 2024-04-25T10:26:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f328f400640 1 -- 172.21.15.19:0/108095454 learned_addr learned my addr 172.21.15.19:0/108095454 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f328e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x556848208d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:37568/0 (socket says 172.21.15.19:37568) 2024-04-25T10:26:29.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f328ea00640 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e043b0 0x5568481cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f328f400640 1 -- 172.21.15.19:0/108095454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 msgr2=0x556848208d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f328f400640 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x556848208d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f328f400640 1 -- 172.21.15.19:0/108095454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e043b0 msgr2=0x5568481cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f328f400640 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e043b0 0x5568481cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f328f400640 1 -- 172.21.15.19:0/108095454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556847f0f6b0 con 0x556847e2d270 2024-04-25T10:26:29.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f328f400640 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 0x556848207620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32880020c0 tx=0x7f32880015c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a7a9c9525928300 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.739+0000 7f326f400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.740+0000 7f326f400640 1 -- 172.21.15.19:0/108095454 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288013c30 con 0x556847e2d270 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.740+0000 7f329c632740 1 -- 172.21.15.19:0/108095454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3288018070 con 0x556847e2d270 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.740+0000 7f326f400640 1 -- 172.21.15.19:0/108095454 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f3288013dd0 con 0x556847e2d270 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.740+0000 7f326f400640 1 -- 172.21.15.19:0/108095454 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f328802d050 con 0x556847e2d270 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.740+0000 7f329c632740 10 client.4861 fetch_fsmap learned FSMap version 14 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.740+0000 7f329c632740 1 -- 172.21.15.19:0/108095454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x556848209530 con 0x556847e2d270 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.740+0000 7f326f400640 1 -- 172.21.15.19:0/108095454 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3288018070 con 0x556847e2d270 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.740+0000 7f326f400640 1 -- 172.21.15.19:0/108095454 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f3288030020 con 0x556847e2d270 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.740+0000 7f329c632740 10 client.4861 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.740+0000 7f329c632740 10 client.4861 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.740+0000 7f329c632740 20 client.4861 populate_metadata read hostname 'smithi019' 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.741+0000 7f329c632740 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.112:6838/3638094761,v1:172.21.15.112:6839/3638094761] conn(0x556847debe40 0x556848223d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.741+0000 7f329c632740 4 client.4861 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:26:29.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.741+0000 7f329c632740 1 -- 172.21.15.19:0/108095454 --> [v2:172.21.15.112:6838/3638094761,v1:172.21.15.112:6839/3638094761] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556848141210 con 0x556847debe40 2024-04-25T10:26:29.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.741+0000 7f328ea00640 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.112:6838/3638094761,v1:172.21.15.112:6839/3638094761] conn(0x556847debe40 0x556848223d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.741+0000 7f328ea00640 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.112:6838/3638094761,v1:172.21.15.112:6839/3638094761] conn(0x556847debe40 0x556848223d00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=74c558293d2a7885 server_cookie=6395353ea3620df5 in_seq=0 out_seq=0 2024-04-25T10:26:29.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.741+0000 7f326f400640 10 client.4861 ms_handle_connect on v2:172.21.15.112:6838/3638094761 2024-04-25T10:26:29.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.742+0000 7f326f400640 1 -- 172.21.15.19:0/108095454 <== mds.1 v2:172.21.15.112:6838/3638094761 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556848141210 con 0x556847debe40 2024-04-25T10:26:29.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.742+0000 7f326f400640 10 client.4861 handle_command_reply: tid=0 2024-04-25T10:26:29.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.742+0000 7f329c632740 1 client.4861 shutdown 2024-04-25T10:26:29.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f329c632740 1 -- 172.21.15.19:0/108095454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 msgr2=0x556848207620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f329c632740 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 0x556848207620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32880020c0 tx=0x7f32880015c0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f329c632740 1 -- 172.21.15.19:0/108095454 shutdown_connections 2024-04-25T10:26:29.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f329c632740 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.112:6838/3638094761,v1:172.21.15.112:6839/3638094761] conn(0x556847debe40 0x556848223d00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f329c632740 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e2d270 0x556848207620 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f329c632740 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x556848208d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f329c632740 1 --2- 172.21.15.19:0/108095454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e043b0 0x5568481cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f326f400640 0 client.4861 ms_handle_reset on v2:172.21.15.112:6838/3638094761 2024-04-25T10:26:29.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f329c632740 1 -- 172.21.15.19:0/108095454 >> 172.21.15.19:0/108095454 conn(0x556847e213c0 msgr2=0x5568481ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f329c632740 1 -- 172.21.15.19:0/108095454 shutdown_connections 2024-04-25T10:26:29.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f329c632740 1 -- 172.21.15.19:0/108095454 wait complete. 2024-04-25T10:26:29.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.743+0000 7f329c632740 20 client.4861 trim_cache size 0 max 16384 2024-04-25T10:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.764+0000 7f329c632740 1 Processor -- start 2024-04-25T10:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.764+0000 7f329c632740 1 -- start start 2024-04-25T10:26:29.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.765+0000 7f329c632740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 0x5568481d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f329c632740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x5568481f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f329c632740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 0x5568481f9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f329c632740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f32901fedd0 con 0x556847e2d270 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f329c632740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5568481f72a0 con 0x556847e043b0 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f329c632740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5568482081c0 con 0x556847e0c590 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 0x5568481f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 0x5568481d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x5568481f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x5568481f8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:37576/0 (socket says 172.21.15.19:37576) 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 0x5568481f9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55016/0 (socket says 172.21.15.19:55016) 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328e000640 1 -- 172.21.15.19:0/3322244172 learned_addr learned my addr 172.21.15.19:0/3322244172 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 0x5568481d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:36086/0 (socket says 172.21.15.19:36086) 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328ea00640 1 -- 172.21.15.19:0/3322244172 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 msgr2=0x5568481f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328ea00640 1 --2- 172.21.15.19:0/3322244172 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x5568481f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328ea00640 1 -- 172.21.15.19:0/3322244172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 msgr2=0x5568481f9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328ea00640 1 --2- 172.21.15.19:0/3322244172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 0x5568481f9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328ea00640 1 -- 172.21.15.19:0/3322244172 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55684812f780 con 0x556847e043b0 2024-04-25T10:26:29.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328f400640 1 --2- 172.21.15.19:0/3322244172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 0x5568481f9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:29.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.766+0000 7f328e000640 1 --2- 172.21.15.19:0/3322244172 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x5568481f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:29.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.767+0000 7f328ea00640 1 --2- 172.21.15.19:0/3322244172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 0x5568481d0f50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f329006c7a0 tx=0x7f328002c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1dbc67a001b249b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.767+0000 7f327a600640 1 -- 172.21.15.19:0/3322244172 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280057070 con 0x556847e043b0 2024-04-25T10:26:29.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.767+0000 7f327a600640 1 -- 172.21.15.19:0/3322244172 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3280052350 con 0x556847e043b0 2024-04-25T10:26:29.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.767+0000 7f327a600640 1 -- 172.21.15.19:0/3322244172 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280037040 con 0x556847e043b0 2024-04-25T10:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.768+0000 7f329c632740 1 -- 172.21.15.19:0/3322244172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 msgr2=0x5568481d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.768+0000 7f329c632740 1 --2- 172.21.15.19:0/3322244172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 0x5568481d0f50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f329006c7a0 tx=0x7f328002c000 comp rx=0 tx=0).stop 2024-04-25T10:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.768+0000 7f329c632740 1 -- 172.21.15.19:0/3322244172 shutdown_connections 2024-04-25T10:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.768+0000 7f329c632740 1 --2- 172.21.15.19:0/3322244172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 0x5568481f9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.768+0000 7f329c632740 1 --2- 172.21.15.19:0/3322244172 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x5568481f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.768+0000 7f329c632740 1 --2- 172.21.15.19:0/3322244172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 0x5568481d0f50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.768+0000 7f329c632740 1 -- 172.21.15.19:0/3322244172 >> 172.21.15.19:0/3322244172 conn(0x556847e213c0 msgr2=0x556848207430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.768+0000 7f329c632740 1 -- 172.21.15.19:0/3322244172 shutdown_connections 2024-04-25T10:26:29.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.768+0000 7f329c632740 1 -- 172.21.15.19:0/3322244172 wait complete. 2024-04-25T10:26:29.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.769+0000 7f329c632740 1 -- start start 2024-04-25T10:26:29.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.769+0000 7f329c632740 1 Processor -- start 2024-04-25T10:26:29.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f329c632740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 0x5568481f0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f329c632740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x556848217a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f329c632740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 0x556848287a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f329c632740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556848223b80 con 0x556847e2d270 2024-04-25T10:26:29.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f329c632740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556848223510 con 0x556847e043b0 2024-04-25T10:26:29.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f329c632740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5568481f3550 con 0x556847e0c590 2024-04-25T10:26:29.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f329c632740 10 client.0 _ll_register_callbacks cb 0x7f327c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f328e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x556848217a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f328f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 0x556848287a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f328ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 0x5568481f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f328e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x556848217a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:37592/0 (socket says 172.21.15.19:37592) 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.771+0000 7f328e000640 1 -- 172.21.15.19:0/1466673020 learned_addr learned my addr 172.21.15.19:0/1466673020 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f328e000640 1 -- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 msgr2=0x5568481f0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f328e000640 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 0x5568481f0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f328e000640 1 -- 172.21.15.19:0/1466673020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 msgr2=0x556848287a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f328e000640 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 0x556848287a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f328e000640 1 -- 172.21.15.19:0/1466673020 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5568481f09d0 con 0x556847e0c590 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f328f400640 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 0x556848287a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:29.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f328ea00640 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 0x5568481f0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f328e000640 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x556848217a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f327c093790 tx=0x7f327c05f0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5b37c453e7cf8b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f326f400640 10 client.0 ms_handle_connect on v2:172.21.15.112:3301/0 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f326f400640 1 -- 172.21.15.19:0/1466673020 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c090020 con 0x556847e0c590 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f326f400640 1 -- 172.21.15.19:0/1466673020 <== mon.2 v2:172.21.15.112:3301/0 2 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f327c05e6c0 con 0x556847e0c590 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f329c632740 1 -- 172.21.15.19:0/1466673020 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3280052350 con 0x556847e0c590 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f326f400640 1 -- 172.21.15.19:0/1466673020 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f327c07d050 con 0x556847e0c590 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f329c632740 10 client.4703 fetch_fsmap learned FSMap version 14 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.772+0000 7f329c632740 1 -- 172.21.15.19:0/1466673020 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x556848209130 con 0x556847e0c590 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.773+0000 7f326f400640 1 -- 172.21.15.19:0/1466673020 <== mon.2 v2:172.21.15.112:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3280052350 con 0x556847e0c590 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.773+0000 7f326f400640 1 -- 172.21.15.19:0/1466673020 <== mon.2 v2:172.21.15.112:3301/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f327c093300 con 0x556847e0c590 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.773+0000 7f329c632740 10 client.4703 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T10:26:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.773+0000 7f329c632740 10 client.4703 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.773+0000 7f329c632740 20 client.4703 populate_metadata read hostname 'smithi019' 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.773+0000 7f329c632740 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:6838/3638094761,v1:172.21.15.112:6839/3638094761] conn(0x5568482984e0 0x55684829a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.773+0000 7f329c632740 4 client.4703 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.773+0000 7f329c632740 1 -- 172.21.15.19:0/1466673020 --> [v2:172.21.15.112:6838/3638094761,v1:172.21.15.112:6839/3638094761] -- command(tid 0: {"prefix": "status"}) -- 0x55684813b080 con 0x5568482984e0 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.773+0000 7f328ea00640 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:6838/3638094761,v1:172.21.15.112:6839/3638094761] conn(0x5568482984e0 0x55684829a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.774+0000 7f328ea00640 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:6838/3638094761,v1:172.21.15.112:6839/3638094761] conn(0x5568482984e0 0x55684829a900 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d027ae43f9a891a9 server_cookie=e5f79dceaf580737 in_seq=0 out_seq=0 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.774+0000 7f326f400640 10 client.4703 ms_handle_connect on v2:172.21.15.112:6838/3638094761 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.774+0000 7f326f400640 1 -- 172.21.15.19:0/1466673020 <== mds.1 v2:172.21.15.112:6838/3638094761 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55684813b080 con 0x5568482984e0 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.774+0000 7f326f400640 10 client.4703 handle_command_reply: tid=0 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.774+0000 7f329c632740 1 client.4703 shutdown 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.774+0000 7f329c632740 1 -- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 msgr2=0x556848217a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.774+0000 7f329c632740 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x556848217a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f327c093790 tx=0x7f327c05f0b0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.775+0000 7f329c632740 1 -- 172.21.15.19:0/1466673020 shutdown_connections 2024-04-25T10:26:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.775+0000 7f329c632740 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:6838/3638094761,v1:172.21.15.112:6839/3638094761] conn(0x5568482984e0 0x55684829a900 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.775+0000 7f329c632740 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556847e2d270 0x556848287a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.775+0000 7f329c632740 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x556847e0c590 0x556848217a20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.775+0000 7f329c632740 1 --2- 172.21.15.19:0/1466673020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556847e043b0 0x5568481f0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.775+0000 7f329c632740 1 -- 172.21.15.19:0/1466673020 >> 172.21.15.19:0/1466673020 conn(0x556847e213c0 msgr2=0x556848207430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.775+0000 7f326f400640 0 client.4703 ms_handle_reset on v2:172.21.15.112:6838/3638094761 2024-04-25T10:26:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.775+0000 7f329c632740 1 -- 172.21.15.19:0/1466673020 shutdown_connections 2024-04-25T10:26:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.775+0000 7f329c632740 1 -- 172.21.15.19:0/1466673020 wait complete. 2024-04-25T10:26:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.775+0000 7f329c632740 20 client.4703 trim_cache size 0 max 16384 2024-04-25T10:26:29.780 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:26:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "03c2053f-8374-429e-9fda-d77b86219935", 2024-04-25T10:26:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 1, 2024-04-25T10:26:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4288, 2024-04-25T10:26:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-04-25T10:26:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-04-25T10:26:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-04-25T10:26:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 20.444714466000001, 2024-04-25T10:26:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 14, 2024-04-25T10:26:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 26, 2024-04-25T10:26:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T10:26:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 58.672719121999997 2024-04-25T10:26:29.781 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:26:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.775+0000 7f3295600640 1 -- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32700744b0 msgr2=0x7f32700769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.776+0000 7f3295600640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32700744b0 0x7f32700769c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3280034000 tx=0x7f328002e000 comp rx=0 tx=0).stop 2024-04-25T10:26:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.776+0000 7f3295600640 1 -- 172.21.15.19:0/1256721236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f329015e760 msgr2=0x7f3290156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.776+0000 7f3295600640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f329015e760 0x7f3290156270 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f327c00e8a0 tx=0x7f327c00ed60 comp rx=0 tx=0).stop 2024-04-25T10:26:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.776+0000 7f3295600640 1 -- 172.21.15.19:0/1256721236 shutdown_connections 2024-04-25T10:26:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.776+0000 7f3295600640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32900c4df0 0x7f32900c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.776+0000 7f3295600640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f329015e760 0x7f3290156270 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.776+0000 7f3295600640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32700744b0 0x7f32700769c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.776+0000 7f3295600640 1 --2- 172.21.15.19:0/1256721236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290073160 0x7f32900c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.776+0000 7f3295600640 1 -- 172.21.15.19:0/1256721236 >> 172.21.15.19:0/1256721236 conn(0x7f329006f1f0 msgr2=0x7f32900cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.776+0000 7f3295600640 1 -- 172.21.15.19:0/1256721236 shutdown_connections 2024-04-25T10:26:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:29.776+0000 7f3295600640 1 -- 172.21.15.19:0/1256721236 wait complete. 2024-04-25T10:26:29.804 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:26:30.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.135+0000 7f388f200640 1 Processor -- start 2024-04-25T10:26:30.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.136+0000 7f388f200640 1 -- start start 2024-04-25T10:26:30.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.138+0000 7f388f200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38900c37a0 0x7f3890156310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.138+0000 7f388f200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38900c9180 0x7f38900c5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.138+0000 7f388f200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f389015f8c0 con 0x7f3890071170 2024-04-25T10:26:30.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.138+0000 7f388f200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f38900cb490 con 0x7f38900c37a0 2024-04-25T10:26:30.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.138+0000 7f388f200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f38900cb770 con 0x7f38900c9180 2024-04-25T10:26:30.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.138+0000 7f388de00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3890071170 0x7f389015ca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52450/0 (socket says 172.21.15.19:52450) 2024-04-25T10:26:30.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.138+0000 7f388de00640 1 -- 172.21.15.19:0/2849166087 learned_addr learned my addr 172.21.15.19:0/2849166087 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:30.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.139+0000 7f388e800640 1 --2- 172.21.15.19:0/2849166087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38900c9180 0x7f38900c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.139+0000 7f3887e00640 1 --2- 172.21.15.19:0/2849166087 >> v2:172.21.15.112:3300/0 conn(0x7f38900c37a0 0x7f3890156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.139+0000 7f388d400640 1 -- 172.21.15.19:0/2849166087 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897134365 0 0) 0x7f389015f8c0 con 0x7f3890071170 2024-04-25T10:26:30.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.139+0000 7f388e800640 1 -- 172.21.15.19:0/2849166087 >> v2:172.21.15.112:3300/0 conn(0x7f38900c37a0 msgr2=0x7f3890156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:30.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.139+0000 7f388e800640 1 --2- 172.21.15.19:0/2849166087 >> v2:172.21.15.112:3300/0 conn(0x7f38900c37a0 0x7f3890156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.139+0000 7f388e800640 1 -- 172.21.15.19:0/2849166087 >> v1:172.21.15.19:6789/0 conn(0x7f3890071170 legacy=0x7f389015ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.139+0000 7f388e800640 1 -- 172.21.15.19:0/2849166087 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38900cba50 con 0x7f38900c9180 2024-04-25T10:26:30.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.140+0000 7f388e800640 1 --2- 172.21.15.19:0/2849166087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38900c9180 0x7f38900c5020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3888009d90 tx=0x7f388802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b0074d409eba539 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:30.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.140+0000 7f388d400640 1 -- 172.21.15.19:0/2849166087 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888007740 con 0x7f38900c9180 2024-04-25T10:26:30.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.141+0000 7f388d400640 1 -- 172.21.15.19:0/2849166087 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38880078e0 con 0x7f38900c9180 2024-04-25T10:26:30.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.141+0000 7f388d400640 1 -- 172.21.15.19:0/2849166087 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888007cb0 con 0x7f38900c9180 2024-04-25T10:26:30.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.141+0000 7f388f200640 1 -- 172.21.15.19:0/2849166087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38900c9180 msgr2=0x7f38900c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.141+0000 7f388f200640 1 --2- 172.21.15.19:0/2849166087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38900c9180 0x7f38900c5020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3888009d90 tx=0x7f388802a6f0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.141+0000 7f388f200640 1 -- 172.21.15.19:0/2849166087 shutdown_connections 2024-04-25T10:26:30.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.141+0000 7f388f200640 1 --2- 172.21.15.19:0/2849166087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38900c9180 0x7f38900c5020 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.141+0000 7f388f200640 1 --2- 172.21.15.19:0/2849166087 >> v2:172.21.15.112:3300/0 conn(0x7f38900c37a0 0x7f3890156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.141+0000 7f388f200640 1 -- 172.21.15.19:0/2849166087 >> 172.21.15.19:0/2849166087 conn(0x7f3890071db0 msgr2=0x7f38900721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:30.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.142+0000 7f388f200640 1 -- 172.21.15.19:0/2849166087 shutdown_connections 2024-04-25T10:26:30.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.142+0000 7f388f200640 1 -- 172.21.15.19:0/2849166087 wait complete. 2024-04-25T10:26:30.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.144+0000 7f388f200640 1 Processor -- start 2024-04-25T10:26:30.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.144+0000 7f388f200640 1 -- start start 2024-04-25T10:26:30.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.146+0000 7f388f200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3890071170 0x7f3890159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.146+0000 7f388f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38900c37a0 0x7f3890151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.146+0000 7f388f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38900c9180 0x7f3890152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.146+0000 7f388f200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f389006f730 con 0x7f38900c9180 2024-04-25T10:26:30.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.146+0000 7f388f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f389015d110 con 0x7f38900c37a0 2024-04-25T10:26:30.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.146+0000 7f388f200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f38900c5560 con 0x7f3890071170 2024-04-25T10:26:30.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.146+0000 7f388e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38900c9180 0x7f3890152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.146+0000 7f388e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38900c9180 0x7f3890152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55032/0 (socket says 172.21.15.19:55032) 2024-04-25T10:26:30.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.146+0000 7f388e800640 1 -- 172.21.15.19:0/3529574985 learned_addr learned my addr 172.21.15.19:0/3529574985 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:30.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.146+0000 7f388de00640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3890071170 0x7f3890159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.146+0000 7f3887e00640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38900c37a0 0x7f3890151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.147+0000 7f388e800640 1 -- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3890071170 msgr2=0x7f3890159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.147+0000 7f388e800640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3890071170 0x7f3890159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.147+0000 7f388e800640 1 -- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38900c37a0 msgr2=0x7f3890151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.147+0000 7f388e800640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38900c37a0 0x7f3890151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.147+0000 7f388e800640 1 -- 172.21.15.19:0/3529574985 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389015bbc0 con 0x7f38900c9180 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.147+0000 7f3887e00640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38900c37a0 0x7f3890151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.147+0000 7f388e800640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38900c9180 0x7f3890152410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f388802ace0 tx=0x7f3888004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.147+0000 7f3886000640 1 -- 172.21.15.19:0/3529574985 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388803f070 con 0x7f38900c9180 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.147+0000 7f3886000640 1 -- 172.21.15.19:0/3529574985 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888031bc0 con 0x7f38900c9180 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.148+0000 7f3886000640 1 -- 172.21.15.19:0/3529574985 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888009450 con 0x7f38900c9180 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.148+0000 7f388f200640 1 -- 172.21.15.19:0/3529574985 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389015bea0 con 0x7f38900c9180 2024-04-25T10:26:30.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.148+0000 7f388f200640 1 -- 172.21.15.19:0/3529574985 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38900c7140 con 0x7f38900c9180 2024-04-25T10:26:30.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.151+0000 7f3886000640 1 -- 172.21.15.19:0/3529574985 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f388803b410 con 0x7f38900c9180 2024-04-25T10:26:30.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.152+0000 7f3886000640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f386c0744b0 0x7f386c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.152+0000 7f3886000640 1 -- 172.21.15.19:0/3529574985 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f38880b6be0 con 0x7f38900c9180 2024-04-25T10:26:30.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.152+0000 7f389bc6b740 1 Processor -- start 2024-04-25T10:26:30.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.152+0000 7f389bc6b740 1 -- start start 2024-04-25T10:26:30.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.152+0000 7f388de00640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f386c0744b0 0x7f386c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.153+0000 7f388de00640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f386c0744b0 0x7f386c0769c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3880007fd0 tx=0x7f3880007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:30.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.154+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 0x5613da468fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.154+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da44c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.154+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 0x5613da44cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.154+0000 7f389bc6b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5613da38b600 con 0x5613da085270 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.154+0000 7f389bc6b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5613da328100 con 0x5613da064590 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.154+0000 7f389bc6b740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5613da3875c0 con 0x5613da05c3b0 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.154+0000 7f388de00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 0x5613da468fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.154+0000 7f388de00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 0x5613da468fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55044/0 (socket says 172.21.15.19:55044) 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.154+0000 7f388de00640 1 -- 172.21.15.19:0/3690655015 learned_addr learned my addr 172.21.15.19:0/3690655015 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.154+0000 7f3887e00640 1 --2- 172.21.15.19:0/3690655015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da44c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.154+0000 7f388e800640 1 --2- 172.21.15.19:0/3690655015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 0x5613da44cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.155+0000 7f388de00640 1 -- 172.21.15.19:0/3690655015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 msgr2=0x5613da44c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.155+0000 7f388de00640 1 --2- 172.21.15.19:0/3690655015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da44c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.155+0000 7f388de00640 1 -- 172.21.15.19:0/3690655015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 msgr2=0x5613da44cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.155+0000 7f388de00640 1 --2- 172.21.15.19:0/3690655015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 0x5613da44cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.155+0000 7f388de00640 1 -- 172.21.15.19:0/3690655015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613da09d2d0 con 0x5613da085270 2024-04-25T10:26:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.155+0000 7f388de00640 1 --2- 172.21.15.19:0/3690655015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 0x5613da468fe0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3880004fd0 tx=0x7f3880013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa788728143d08f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:30.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.155+0000 7f387e600640 1 -- 172.21.15.19:0/3690655015 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880026070 con 0x5613da085270 2024-04-25T10:26:30.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.155+0000 7f387e600640 1 -- 172.21.15.19:0/3690655015 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3880001cf0 con 0x5613da085270 2024-04-25T10:26:30.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.155+0000 7f387e600640 1 -- 172.21.15.19:0/3690655015 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880013da0 con 0x5613da085270 2024-04-25T10:26:30.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.156+0000 7f389bc6b740 1 -- 172.21.15.19:0/3690655015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 msgr2=0x5613da468fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.156+0000 7f389bc6b740 1 --2- 172.21.15.19:0/3690655015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 0x5613da468fe0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3880004fd0 tx=0x7f3880013000 comp rx=0 tx=0).stop 2024-04-25T10:26:30.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.156+0000 7f389bc6b740 1 -- 172.21.15.19:0/3690655015 shutdown_connections 2024-04-25T10:26:30.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.156+0000 7f389bc6b740 1 --2- 172.21.15.19:0/3690655015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 0x5613da44cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.156+0000 7f389bc6b740 1 --2- 172.21.15.19:0/3690655015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da44c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.156+0000 7f389bc6b740 1 --2- 172.21.15.19:0/3690655015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 0x5613da468fe0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.156+0000 7f389bc6b740 1 -- 172.21.15.19:0/3690655015 >> 172.21.15.19:0/3690655015 conn(0x5613da0793c0 msgr2=0x5613da426c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:30.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.156+0000 7f389bc6b740 1 -- 172.21.15.19:0/3690655015 shutdown_connections 2024-04-25T10:26:30.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.156+0000 7f389bc6b740 1 -- 172.21.15.19:0/3690655015 wait complete. 2024-04-25T10:26:30.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.157+0000 7f389bc6b740 1 -- start start 2024-04-25T10:26:30.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.158+0000 7f389bc6b740 1 Processor -- start 2024-04-25T10:26:30.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.159+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da464600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.159+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 0x5613da463e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.159+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 0x5613da479010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.159+0000 7f389bc6b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5613da426a60 con 0x5613da085270 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.159+0000 7f389bc6b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5613da312f70 con 0x5613da064590 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.159+0000 7f389bc6b740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5613da471d50 con 0x5613da05c3b0 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.159+0000 7f389bc6b740 10 client.0 _ll_register_callbacks cb 0x5613da381480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f3887e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 0x5613da463e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f388de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da464600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f388de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da464600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:37626/0 (socket says 172.21.15.19:37626) 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f3887e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 0x5613da463e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:36112/0 (socket says 172.21.15.19:36112) 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f388de00640 1 -- 172.21.15.19:0/1551510435 learned_addr learned my addr 172.21.15.19:0/1551510435 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f388e800640 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 0x5613da479010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f3887e00640 1 -- 172.21.15.19:0/1551510435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 msgr2=0x5613da464600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f3887e00640 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da464600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f3887e00640 1 -- 172.21.15.19:0/1551510435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 msgr2=0x5613da479010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:30.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f3887e00640 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 0x5613da479010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f3887e00640 1 -- 172.21.15.19:0/1551510435 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613da1676b0 con 0x5613da064590 2024-04-25T10:26:30.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f3887e00640 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 0x5613da463e90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f38900cf760 tx=0x7f3878014f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afa925a3d52a8ec8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.160+0000 7f3872a00640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.161+0000 7f3872a00640 1 -- 172.21.15.19:0/1551510435 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878012d30 con 0x5613da064590 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.161+0000 7f389bc6b740 1 -- 172.21.15.19:0/1551510435 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3880001cf0 con 0x5613da064590 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.161+0000 7f3872a00640 1 -- 172.21.15.19:0/1551510435 <== mon.1 v2:172.21.15.112:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f3878004030 con 0x5613da064590 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.161+0000 7f3872a00640 1 -- 172.21.15.19:0/1551510435 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f3878004230 con 0x5613da064590 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.161+0000 7f389bc6b740 10 client.4879 fetch_fsmap learned FSMap version 14 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.161+0000 7f389bc6b740 1 -- 172.21.15.19:0/1551510435 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5613da478810 con 0x5613da064590 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.161+0000 7f3872a00640 1 -- 172.21.15.19:0/1551510435 <== mon.1 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3880001cf0 con 0x5613da064590 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.162+0000 7f3872a00640 1 -- 172.21.15.19:0/1551510435 <== mon.1 v2:172.21.15.112:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f387802a080 con 0x5613da064590 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.162+0000 7f389bc6b740 10 client.4879 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.162+0000 7f389bc6b740 10 client.4879 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.162+0000 7f389bc6b740 20 client.4879 populate_metadata read hostname 'smithi019' 2024-04-25T10:26:30.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.162+0000 7f389bc6b740 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5613da043e40 0x5613da487400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.162+0000 7f389bc6b740 4 client.4879 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:26:30.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.162+0000 7f389bc6b740 1 -- 172.21.15.19:0/1551510435 --> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613da399210 con 0x5613da043e40 2024-04-25T10:26:30.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.162+0000 7f388de00640 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5613da043e40 0x5613da487400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.163+0000 7f388de00640 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5613da043e40 0x5613da487400 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f20f032a26f93291 server_cookie=5e92b683e9cfb5c3 in_seq=0 out_seq=0 2024-04-25T10:26:30.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.163+0000 7f3872a00640 10 client.4879 ms_handle_connect on v2:172.21.15.19:6834/1037719859 2024-04-25T10:26:30.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.163+0000 7f3872a00640 1 -- 172.21.15.19:0/1551510435 <== mds.0 v2:172.21.15.19:6834/1037719859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5613da399210 con 0x5613da043e40 2024-04-25T10:26:30.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.163+0000 7f3872a00640 10 client.4879 handle_command_reply: tid=0 2024-04-25T10:26:30.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 1 client.4879 shutdown 2024-04-25T10:26:30.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 1 -- 172.21.15.19:0/1551510435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 msgr2=0x5613da463e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 0x5613da463e90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f38900cf760 tx=0x7f3878014f30 comp rx=0 tx=0).stop 2024-04-25T10:26:30.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 1 -- 172.21.15.19:0/1551510435 shutdown_connections 2024-04-25T10:26:30.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5613da043e40 0x5613da487400 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da085270 0x5613da479010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da064590 0x5613da463e90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 1 --2- 172.21.15.19:0/1551510435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da464600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f3872a00640 0 client.4879 ms_handle_reset on v2:172.21.15.19:6834/1037719859 2024-04-25T10:26:30.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 1 -- 172.21.15.19:0/1551510435 >> 172.21.15.19:0/1551510435 conn(0x5613da0793c0 msgr2=0x5613da468f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:30.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 1 -- 172.21.15.19:0/1551510435 shutdown_connections 2024-04-25T10:26:30.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 1 -- 172.21.15.19:0/1551510435 wait complete. 2024-04-25T10:26:30.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.164+0000 7f389bc6b740 20 client.4879 trim_cache size 0 max 16384 2024-04-25T10:26:30.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.185+0000 7f389bc6b740 1 Processor -- start 2024-04-25T10:26:30.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.185+0000 7f389bc6b740 1 -- start start 2024-04-25T10:26:30.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.187+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da05c3b0 0x5613da4707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.187+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da064590 0x5613da475180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.187+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da085270 0x5613da4756c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.187+0000 7f389bc6b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f38901fec40 con 0x5613da05c3b0 2024-04-25T10:26:30.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.187+0000 7f389bc6b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5613da4658b0 con 0x5613da085270 2024-04-25T10:26:30.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.187+0000 7f389bc6b740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5613da464bd0 con 0x5613da064590 2024-04-25T10:26:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.187+0000 7f388de00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da05c3b0 0x5613da4707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.187+0000 7f388de00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da05c3b0 0x5613da4707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55064/0 (socket says 172.21.15.19:55064) 2024-04-25T10:26:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.187+0000 7f388de00640 1 -- 172.21.15.19:0/749696306 learned_addr learned my addr 172.21.15.19:0/749696306 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.187+0000 7f388e800640 1 --2- 172.21.15.19:0/749696306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da085270 0x5613da4756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.187+0000 7f3887e00640 1 --2- 172.21.15.19:0/749696306 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da064590 0x5613da475180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.188+0000 7f388e800640 1 -- 172.21.15.19:0/749696306 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da064590 msgr2=0x5613da475180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.188+0000 7f388e800640 1 --2- 172.21.15.19:0/749696306 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da064590 0x5613da475180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.188+0000 7f388e800640 1 -- 172.21.15.19:0/749696306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da05c3b0 msgr2=0x5613da4707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:30.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.188+0000 7f388e800640 1 --2- 172.21.15.19:0/749696306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da05c3b0 0x5613da4707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.188+0000 7f388e800640 1 -- 172.21.15.19:0/749696306 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613da472610 con 0x5613da085270 2024-04-25T10:26:30.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.188+0000 7f388de00640 1 --2- 172.21.15.19:0/749696306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da05c3b0 0x5613da4707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:30.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.188+0000 7f388e800640 1 --2- 172.21.15.19:0/749696306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da085270 0x5613da4756c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f38880b4d60 tx=0x7f3888033040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74118c3787d4add8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:30.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.188+0000 7f387dc00640 1 -- 172.21.15.19:0/749696306 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888080540 con 0x5613da085270 2024-04-25T10:26:30.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.188+0000 7f387dc00640 1 -- 172.21.15.19:0/749696306 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888099030 con 0x5613da085270 2024-04-25T10:26:30.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.188+0000 7f387dc00640 1 -- 172.21.15.19:0/749696306 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888080a30 con 0x5613da085270 2024-04-25T10:26:30.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.189+0000 7f389bc6b740 1 -- 172.21.15.19:0/749696306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da085270 msgr2=0x5613da4756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.189+0000 7f389bc6b740 1 --2- 172.21.15.19:0/749696306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da085270 0x5613da4756c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f38880b4d60 tx=0x7f3888033040 comp rx=0 tx=0).stop 2024-04-25T10:26:30.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.189+0000 7f389bc6b740 1 -- 172.21.15.19:0/749696306 shutdown_connections 2024-04-25T10:26:30.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.189+0000 7f389bc6b740 1 --2- 172.21.15.19:0/749696306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da085270 0x5613da4756c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.189+0000 7f389bc6b740 1 --2- 172.21.15.19:0/749696306 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da064590 0x5613da475180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.189+0000 7f389bc6b740 1 --2- 172.21.15.19:0/749696306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da05c3b0 0x5613da4707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.189+0000 7f389bc6b740 1 -- 172.21.15.19:0/749696306 >> 172.21.15.19:0/749696306 conn(0x5613da0793c0 msgr2=0x5613da463ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.189+0000 7f389bc6b740 1 -- 172.21.15.19:0/749696306 shutdown_connections 2024-04-25T10:26:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.189+0000 7f389bc6b740 1 -- 172.21.15.19:0/749696306 wait complete. 2024-04-25T10:26:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.190+0000 7f389bc6b740 1 -- start start 2024-04-25T10:26:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.191+0000 7f389bc6b740 1 Processor -- start 2024-04-25T10:26:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.192+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da4e0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.192+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da064590 0x5613da466710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.192+0000 7f389bc6b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da085270 0x5613da468ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.192+0000 7f389bc6b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5613da472e30 con 0x5613da064590 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.192+0000 7f389bc6b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5613da4727e0 con 0x5613da085270 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.192+0000 7f389bc6b740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5613da47c0b0 con 0x5613da05c3b0 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.192+0000 7f389bc6b740 10 client.0 _ll_register_callbacks cb 0x7f3878009bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.192+0000 7f3887e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da064590 0x5613da466710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.193+0000 7f3887e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da064590 0x5613da466710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55070/0 (socket says 172.21.15.19:55070) 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.193+0000 7f3887e00640 1 -- 172.21.15.19:0/713706703 learned_addr learned my addr 172.21.15.19:0/713706703 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.193+0000 7f388de00640 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da4e0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.193+0000 7f388e800640 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da085270 0x5613da468ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.193+0000 7f3887e00640 1 -- 172.21.15.19:0/713706703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 msgr2=0x5613da4e0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.193+0000 7f3887e00640 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da4e0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.193+0000 7f3887e00640 1 -- 172.21.15.19:0/713706703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da085270 msgr2=0x5613da468ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.193+0000 7f3887e00640 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da085270 0x5613da468ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.193+0000 7f3887e00640 1 -- 172.21.15.19:0/713706703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613da463c10 con 0x5613da064590 2024-04-25T10:26:30.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.193+0000 7f3887e00640 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da064590 0x5613da466710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5613da462900 tx=0x7f38780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfa143bf8a6455f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:30.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.193+0000 7f3872a00640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-04-25T10:26:30.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.194+0000 7f3872a00640 1 -- 172.21.15.19:0/713706703 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878005da0 con 0x5613da064590 2024-04-25T10:26:30.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.194+0000 7f3872a00640 1 -- 172.21.15.19:0/713706703 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f3878006040 con 0x5613da064590 2024-04-25T10:26:30.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.194+0000 7f389bc6b740 1 -- 172.21.15.19:0/713706703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3888099030 con 0x5613da064590 2024-04-25T10:26:30.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.194+0000 7f3872a00640 1 -- 172.21.15.19:0/713706703 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f3878039050 con 0x5613da064590 2024-04-25T10:26:30.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.194+0000 7f389bc6b740 10 client.4821 fetch_fsmap learned FSMap version 14 2024-04-25T10:26:30.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.194+0000 7f389bc6b740 1 -- 172.21.15.19:0/713706703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5613da479160 con 0x5613da064590 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.194+0000 7f3872a00640 1 -- 172.21.15.19:0/713706703 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888099030 con 0x5613da064590 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.194+0000 7f3872a00640 1 -- 172.21.15.19:0/713706703 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f387803c020 con 0x5613da064590 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.194+0000 7f389bc6b740 10 client.4821 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.194+0000 7f389bc6b740 10 client.4821 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.194+0000 7f389bc6b740 20 client.4821 populate_metadata read hostname 'smithi019' 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.195+0000 7f389bc6b740 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5613da469220 0x5613da4f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.195+0000 7f389bc6b740 4 client.4821 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.195+0000 7f389bc6b740 1 -- 172.21.15.19:0/713706703 --> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] -- command(tid 0: {"prefix": "status"}) -- 0x5613da393080 con 0x5613da469220 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.195+0000 7f388de00640 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5613da469220 0x5613da4f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.195+0000 7f388de00640 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5613da469220 0x5613da4f2d10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb0805ee2b5d8f7b server_cookie=3e3e7deff882fa85 in_seq=0 out_seq=0 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.195+0000 7f3872a00640 10 client.4821 ms_handle_connect on v2:172.21.15.19:6834/1037719859 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f3872a00640 1 -- 172.21.15.19:0/713706703 <== mds.0 v2:172.21.15.19:6834/1037719859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5613da393080 con 0x5613da469220 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f3872a00640 10 client.4821 handle_command_reply: tid=0 2024-04-25T10:26:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 1 client.4821 shutdown 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 1 -- 172.21.15.19:0/713706703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da064590 msgr2=0x5613da466710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da064590 0x5613da466710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5613da462900 tx=0x7f38780046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 1 -- 172.21.15.19:0/713706703 shutdown_connections 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.19:6834/1037719859,v1:172.21.15.19:6835/1037719859] conn(0x5613da469220 0x5613da4f2d10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5613da085270 0x5613da468ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613da064590 0x5613da466710 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 1 --2- 172.21.15.19:0/713706703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5613da05c3b0 0x5613da4e0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f3872a00640 0 client.4821 ms_handle_reset on v2:172.21.15.19:6834/1037719859 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 1 -- 172.21.15.19:0/713706703 >> 172.21.15.19:0/713706703 conn(0x5613da0793c0 msgr2=0x5613da422700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 1 -- 172.21.15.19:0/713706703 shutdown_connections 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 1 -- 172.21.15.19:0/713706703 wait complete. 2024-04-25T10:26:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.196+0000 7f389bc6b740 20 client.4821 trim_cache size 0 max 16384 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "03c2053f-8374-429e-9fda-d77b86219935", 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4309, 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 53.046297873, 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 14, 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 26, 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T10:26:30.202 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 58.952177091000003 2024-04-25T10:26:30.203 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:26:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 -- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f386c0744b0 msgr2=0x7f386c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f386c0744b0 0x7f386c0769c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3880007fd0 tx=0x7f3880007de0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 -- 172.21.15.19:0/3529574985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38900c9180 msgr2=0x7f3890152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38900c9180 0x7f3890152410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f388802ace0 tx=0x7f3888004a40 comp rx=0 tx=0).stop 2024-04-25T10:26:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 -- 172.21.15.19:0/3529574985 shutdown_connections 2024-04-25T10:26:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38900c9180 0x7f3890152410 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38900c37a0 0x7f3890151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f386c0744b0 0x7f386c0769c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 --2- 172.21.15.19:0/3529574985 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3890071170 0x7f3890159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 -- 172.21.15.19:0/3529574985 >> 172.21.15.19:0/3529574985 conn(0x7f3890071db0 msgr2=0x7f38900721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 -- 172.21.15.19:0/3529574985 shutdown_connections 2024-04-25T10:26:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.197+0000 7f388f200640 1 -- 172.21.15.19:0/3529574985 wait complete. 2024-04-25T10:26:30.225 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T10:26:30.235 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T10:26:30.235 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T10:26:30.236 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T10:26:30.236 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T10:26:30.253 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T10:26:30.253 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-25T10:26:30.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:26:30.253 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-04-25T10:26:30.309 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T10:26:30.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:26:30.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:26:30.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:26:30.407 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-04-25T10:26:30.525 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-25T10:26:30.526 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T10:26:30.526 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:26:30.526 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:26:30.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.781+0000 7f380d400640 1 Processor -- start 2024-04-25T10:26:30.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.781+0000 7f380d400640 1 -- start start 2024-04-25T10:26:30.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.783+0000 7f380d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f380815ad80 0x7f38080c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.783+0000 7f380d400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38080ca090 0x7f38080ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.783+0000 7f380d400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38080c9b30 con 0x7f38080c8e40 2024-04-25T10:26:30.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.783+0000 7f380d400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3808161830 con 0x7f380815ad80 2024-04-25T10:26:30.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.783+0000 7f380d400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3808074080 con 0x7f38080ca090 2024-04-25T10:26:30.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.784+0000 7f3807e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f380815ad80 0x7f38080c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.784+0000 7f380ca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38080ca090 0x7f38080ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.784+0000 7f3807400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f38080c8e40 0x7f38080c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52456/0 (socket says 172.21.15.19:52456) 2024-04-25T10:26:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.784+0000 7f3807400640 1 -- 172.21.15.19:0/3749978038 learned_addr learned my addr 172.21.15.19:0/3749978038 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.784+0000 7f380ca00640 1 -- 172.21.15.19:0/3749978038 >> v2:172.21.15.112:3300/0 conn(0x7f380815ad80 msgr2=0x7f38080c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.784+0000 7f380ca00640 1 --2- 172.21.15.19:0/3749978038 >> v2:172.21.15.112:3300/0 conn(0x7f380815ad80 0x7f38080c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.784+0000 7f380ca00640 1 -- 172.21.15.19:0/3749978038 >> v1:172.21.15.19:6789/0 conn(0x7f38080c8e40 legacy=0x7f38080c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.784+0000 7f380ca00640 1 -- 172.21.15.19:0/3749978038 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38081612b0 con 0x7f38080ca090 2024-04-25T10:26:30.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.784+0000 7f3807e00640 1 --2- 172.21.15.19:0/3749978038 >> v2:172.21.15.112:3300/0 conn(0x7f380815ad80 0x7f38080c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:30.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.785+0000 7f380ca00640 1 --2- 172.21.15.19:0/3749978038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38080ca090 0x7f38080ca4a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f38081619b0 tx=0x7f380002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81ab5729a923bf0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:30.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.785+0000 7f3806a00640 1 -- 172.21.15.19:0/3749978038 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3800007740 con 0x7f38080ca090 2024-04-25T10:26:30.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.786+0000 7f3806a00640 1 -- 172.21.15.19:0/3749978038 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38000078e0 con 0x7f38080ca090 2024-04-25T10:26:30.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.786+0000 7f3806a00640 1 -- 172.21.15.19:0/3749978038 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3800007cb0 con 0x7f38080ca090 2024-04-25T10:26:30.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.786+0000 7f380d400640 1 -- 172.21.15.19:0/3749978038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38080ca090 msgr2=0x7f38080ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.786+0000 7f380d400640 1 --2- 172.21.15.19:0/3749978038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38080ca090 0x7f38080ca4a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f38081619b0 tx=0x7f380002a6d0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.786+0000 7f380d400640 1 -- 172.21.15.19:0/3749978038 shutdown_connections 2024-04-25T10:26:30.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.786+0000 7f380d400640 1 --2- 172.21.15.19:0/3749978038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38080ca090 0x7f38080ca4a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.786+0000 7f380d400640 1 --2- 172.21.15.19:0/3749978038 >> v2:172.21.15.112:3300/0 conn(0x7f380815ad80 0x7f38080c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.786+0000 7f380d400640 1 -- 172.21.15.19:0/3749978038 >> 172.21.15.19:0/3749978038 conn(0x7f3808070d10 msgr2=0x7f3808071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.787+0000 7f380d400640 1 -- 172.21.15.19:0/3749978038 shutdown_connections 2024-04-25T10:26:30.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.787+0000 7f380d400640 1 -- 172.21.15.19:0/3749978038 wait complete. 2024-04-25T10:26:30.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.789+0000 7f380d400640 1 Processor -- start 2024-04-25T10:26:30.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.789+0000 7f380d400640 1 -- start start 2024-04-25T10:26:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.791+0000 7f380d400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38080c8e40 0x7f3808152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.791+0000 7f380d400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38080ca090 0x7f38080c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.791+0000 7f380d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380815ad80 0x7f380814d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.791+0000 7f380d400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f38080c4440 con 0x7f38080ca090 2024-04-25T10:26:30.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.791+0000 7f380d400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38080c4160 con 0x7f380815ad80 2024-04-25T10:26:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.791+0000 7f380d400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3808073d10 con 0x7f38080c8e40 2024-04-25T10:26:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.791+0000 7f3807400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38080ca090 0x7f38080c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.791+0000 7f3807400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38080ca090 0x7f38080c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55072/0 (socket says 172.21.15.19:55072) 2024-04-25T10:26:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.791+0000 7f3807400640 1 -- 172.21.15.19:0/629660938 learned_addr learned my addr 172.21.15.19:0/629660938 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.791+0000 7f3807e00640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38080c8e40 0x7f3808152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.791+0000 7f380ca00640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380815ad80 0x7f380814d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.792+0000 7f3807400640 1 -- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38080c8e40 msgr2=0x7f3808152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.792+0000 7f3807400640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38080c8e40 0x7f3808152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.792+0000 7f3807400640 1 -- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380815ad80 msgr2=0x7f380814d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.792+0000 7f3807400640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380815ad80 0x7f380814d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:30.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.792+0000 7f3807400640 1 -- 172.21.15.19:0/629660938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38081533c0 con 0x7f38080ca090 2024-04-25T10:26:30.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.792+0000 7f3807400640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38080ca090 0x7f38080c7c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f37f400c3f0 tx=0x7f37f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:30.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.792+0000 7f37ffe00640 1 -- 172.21.15.19:0/629660938 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4017070 con 0x7f38080ca090 2024-04-25T10:26:30.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.792+0000 7f37ffe00640 1 -- 172.21.15.19:0/629660938 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4005ce0 con 0x7f38080ca090 2024-04-25T10:26:30.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.792+0000 7f37ffe00640 1 -- 172.21.15.19:0/629660938 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f40072f0 con 0x7f38080ca090 2024-04-25T10:26:30.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.792+0000 7f380d400640 1 -- 172.21.15.19:0/629660938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38081fa730 con 0x7f38080ca090 2024-04-25T10:26:30.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.793+0000 7f380d400640 1 -- 172.21.15.19:0/629660938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38081facf0 con 0x7f38080ca090 2024-04-25T10:26:30.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.794+0000 7f380d400640 1 -- 172.21.15.19:0/629660938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3808050740 con 0x7f38080ca090 2024-04-25T10:26:30.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.795+0000 7f37ffe00640 1 -- 172.21.15.19:0/629660938 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f37f401a070 con 0x7f38080ca090 2024-04-25T10:26:30.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.796+0000 7f37ffe00640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744b0 0x7f37e80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:30.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.797+0000 7f37ffe00640 1 -- 172.21.15.19:0/629660938 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f37f40946f0 con 0x7f38080ca090 2024-04-25T10:26:30.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.797+0000 7f3807e00640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744b0 0x7f37e80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:30.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.798+0000 7f3807e00640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744b0 0x7f37e80769c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009560 tx=0x7f37f8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:30.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:30.802+0000 7f37ffe00640 1 -- 172.21.15.19:0/629660938 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f37f405e5e0 con 0x7f38080ca090 2024-04-25T10:26:31.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.052+0000 7f380d400640 1 -- 172.21.15.19:0/629660938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f38080747d0 con 0x7f38080ca090 2024-04-25T10:26:31.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.053+0000 7f37ffe00640 1 -- 172.21.15.19:0/629660938 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+88 (secure 0 0 0) 0x7f37f40628e0 con 0x7f38080ca090 2024-04-25T10:26:31.056 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 -- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744b0 msgr2=0x7f37e80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744b0 0x7f37e80769c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009560 tx=0x7f37f8009190 comp rx=0 tx=0).stop 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 -- 172.21.15.19:0/629660938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38080ca090 msgr2=0x7f38080c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38080ca090 0x7f38080c7c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f37f400c3f0 tx=0x7f37f400c8b0 comp rx=0 tx=0).stop 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 -- 172.21.15.19:0/629660938 shutdown_connections 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380815ad80 0x7f380814d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38080ca090 0x7f38080c7c20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744b0 0x7f37e80769c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 --2- 172.21.15.19:0/629660938 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38080c8e40 0x7f3808152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 -- 172.21.15.19:0/629660938 >> 172.21.15.19:0/629660938 conn(0x7f3808070d10 msgr2=0x7f38081568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 -- 172.21.15.19:0/629660938 shutdown_connections 2024-04-25T10:26:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31.056+0000 7f380d400640 1 -- 172.21.15.19:0/629660938 wait complete. 2024-04-25T10:26:31.087 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T10:26:31.087 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:26:31.087 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-04-25T10:26:31.087 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:26:31.087 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:26:31.087 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T10:26:31.087 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T10:26:31.087 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:26:31.087 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:26:31.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:26:31.088 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-04-25T10:26:31.140 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:26:31.141 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:26:31.141 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:26:31.141 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:26:31.141 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-04-25T10:26:31.141 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:26:31.141 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:26:31.141 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:26:31.141 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-04-25T10:26:31.141 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:26:31.141 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:26:31.141 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-04-25T10:26:31.142 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:26:31.142 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-04-25T10:26:31.142 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-04-25T10:26:31.142 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:26:31.142 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42625sec preferred_lft 42625sec 2024-04-25T10:26:31.142 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-04-25T10:26:31.142 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:26:31.142 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:26:31.142 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-04-25T10:26:31.142 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-04-25T10:26:31.143 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T10:26:31.143 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:26:31.143 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-04-25T10:26:31.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-04-25T10:26:31.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-04-25T10:26:31.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-04-25T10:26:31.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T10:26:31.144 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-04-25T10:26:31.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:26:31.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:26:31.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:26:31.395 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:26:31.458 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-04-25T10:26:31.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:26:31.461 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-04-25T10:26:31.509 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-04-25T10:26:31.509 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:26:31.509 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:26:31.510 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:26:31.510 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:26:31.510 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:26:31.510 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-04-25T10:26:31.510 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:26:31.510 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:26:31.510 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:26:31.510 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-04-25T10:26:31.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:26:31.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:26:31.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:26:31.737 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-04-25T10:26:31.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:26:31.790 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-04-25T10:26:31.845 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:26:31.845 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-04-25T10:26:31.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:26:31.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T10:26:31.845 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-04-25T10:26:31.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:26:32.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:26:32.039 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T10:26:32.039 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:26:32.039 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-04-25T10:26:32.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T10:26:32.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T10:26:32.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T10:26:32.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T10:26:32.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T10:26:32.039 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-04-25T10:26:32.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:26:32.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:26:32.312 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:26:32.312 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-04-25T10:26:32.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-04-25T10:26:32.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T10:26:32.312 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-04-25T10:26:32.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:26:32.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:26:32.526 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:26:32.526 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:26:32.577 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:26:32.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:26:32.578 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:26:32.628 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:26:32.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:26:32.628 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:26:32.830 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:26:32.830 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:26:33.565 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:26:33.565 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:26:33.565 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.112:3300,172.21.15.112:3301" 2024-04-25T10:26:33.565 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with new device syntax: 0@03c2053f-8374-429e-9fda-d77b86219935.cephfs=/ 2024-04-25T10:26:33.565 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.19:3300/172.21.15.112:3300/172.21.15.112:3301" will pass to kernel 2024-04-25T10:26:33.568 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T10:26:33.569 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-04-25T10:26:33.569 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T10:26:33.569 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T10:26:33.569 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T10:26:33.574 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:26:33.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:26:33.574 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:26:33.661 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:26:33.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T10:26:33.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:26:33.792 INFO:teuthology.orchestra.run.smithi019.stdout:client4894 2024-04-25T10:26:33.792 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:26:33.792 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:26:33.847 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:26:33.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T10:26:33.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:26:33.975 INFO:teuthology.orchestra.run.smithi019.stdout:client4894 2024-04-25T10:26:33.975 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:26:34.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T10:26:34.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:26:34.102 INFO:teuthology.orchestra.run.smithi019.stdout:client4894 2024-04-25T10:26:34.102 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/03c2053f-8374-429e-9fda-d77b86219935.client4894/status') 2024-04-25T10:26:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:26:34.247 INFO:teuthology.orchestra.run.smithi019.stdout:instance: client.4894 (3)172.21.15.19:0/4035740833 2024-04-25T10:26:34.248 INFO:teuthology.orchestra.run.smithi019.stdout:blocklisted: false 2024-04-25T10:26:34.248 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records in 2024-04-25T10:26:34.248 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records out 2024-04-25T10:26:34.248 INFO:teuthology.orchestra.run.smithi019.stderr:70 bytes copied, 8.5417e-05 s, 820 kB/s 2024-04-25T10:26:34.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:26:34.261 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-04-25T10:26:34.293 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:34.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.581+0000 7f67afa00640 1 Processor -- start 2024-04-25T10:26:34.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.581+0000 7f67afa00640 1 -- start start 2024-04-25T10:26:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.583+0000 7f67afa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67a81616c0 0x7f67a8073160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.583+0000 7f67afa00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a80c3670 con 0x7f67a80cdde0 2024-04-25T10:26:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.583+0000 7f67afa00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a806d4c0 con 0x7f67a80747d0 2024-04-25T10:26:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.583+0000 7f67afa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f67a80736a0 con 0x7f67a81616c0 2024-04-25T10:26:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.584+0000 7f67ada00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f67a80cdde0 0x7f67a816b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52468/0 (socket says 172.21.15.19:52468) 2024-04-25T10:26:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.584+0000 7f67ada00640 1 -- 172.21.15.19:0/259857108 learned_addr learned my addr 172.21.15.19:0/259857108 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.584+0000 7f67a7e00640 1 --2- 172.21.15.19:0/259857108 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67a81616c0 0x7f67a8073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.584+0000 7f67a7400640 1 -- 172.21.15.19:0/259857108 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267063523 0 0) 0x7f67a806d4c0 con 0x7f67a80747d0 2024-04-25T10:26:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.584+0000 7f67a7400640 1 -- 172.21.15.19:0/259857108 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f678c003520 con 0x7f67a80747d0 2024-04-25T10:26:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.584+0000 7f67a7e00640 1 -- 172.21.15.19:0/259857108 >> v1:172.21.15.112:6789/0 conn(0x7f67a80747d0 legacy=0x7f67a81648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.584+0000 7f67a7e00640 1 -- 172.21.15.19:0/259857108 >> v1:172.21.15.19:6789/0 conn(0x7f67a80cdde0 legacy=0x7f67a816b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.584+0000 7f67a7400640 1 -- 172.21.15.19:0/259857108 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1547250752 0 0) 0x7f67a80c3670 con 0x7f67a80cdde0 2024-04-25T10:26:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.584+0000 7f67a7e00640 1 -- 172.21.15.19:0/259857108 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a80c38e0 con 0x7f67a81616c0 2024-04-25T10:26:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.585+0000 7f67a7e00640 1 --2- 172.21.15.19:0/259857108 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67a81616c0 0x7f67a8073160 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6794009dc0 tx=0x7f679402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8b88640d20cdc75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.586+0000 7f67a7400640 1 -- 172.21.15.19:0/259857108 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794007740 con 0x7f67a81616c0 2024-04-25T10:26:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.586+0000 7f67a7400640 1 -- 172.21.15.19:0/259857108 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67940078e0 con 0x7f67a81616c0 2024-04-25T10:26:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.586+0000 7f67a7400640 1 -- 172.21.15.19:0/259857108 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794007cb0 con 0x7f67a81616c0 2024-04-25T10:26:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.587+0000 7f67afa00640 1 -- 172.21.15.19:0/259857108 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67a81616c0 msgr2=0x7f67a8073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.587+0000 7f67afa00640 1 --2- 172.21.15.19:0/259857108 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67a81616c0 0x7f67a8073160 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6794009dc0 tx=0x7f679402a6d0 comp rx=0 tx=0).stop 2024-04-25T10:26:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.587+0000 7f67afa00640 1 -- 172.21.15.19:0/259857108 shutdown_connections 2024-04-25T10:26:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.587+0000 7f67afa00640 1 --2- 172.21.15.19:0/259857108 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67a81616c0 0x7f67a8073160 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.587+0000 7f67afa00640 1 -- 172.21.15.19:0/259857108 >> 172.21.15.19:0/259857108 conn(0x7f67a806f1f0 msgr2=0x7f67a806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.587+0000 7f67afa00640 1 -- 172.21.15.19:0/259857108 shutdown_connections 2024-04-25T10:26:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.587+0000 7f67afa00640 1 -- 172.21.15.19:0/259857108 wait complete. 2024-04-25T10:26:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.589+0000 7f67afa00640 1 Processor -- start 2024-04-25T10:26:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.590+0000 7f67afa00640 1 -- start start 2024-04-25T10:26:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.591+0000 7f67afa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67a80747d0 0x7f67a81f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.591+0000 7f67afa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67a80cdde0 0x7f67a8151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.591+0000 7f67afa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67a81616c0 0x7f67a80b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.591+0000 7f67afa00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8164420 con 0x7f67a81616c0 2024-04-25T10:26:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.591+0000 7f67afa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8164140 con 0x7f67a80747d0 2024-04-25T10:26:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.591+0000 7f67afa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f67a80c3ea0 con 0x7f67a80cdde0 2024-04-25T10:26:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.592+0000 7f67ad000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67a80747d0 0x7f67a81f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.592+0000 7f67ada00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67a81616c0 0x7f67a80b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.592+0000 7f67ad000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67a80747d0 0x7f67a81f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:36162/0 (socket says 172.21.15.19:36162) 2024-04-25T10:26:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.592+0000 7f67ad000640 1 -- 172.21.15.19:0/2130605205 learned_addr learned my addr 172.21.15.19:0/2130605205 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.592+0000 7f67a7e00640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67a80cdde0 0x7f67a8151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.592+0000 7f67ad000640 1 -- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67a80cdde0 msgr2=0x7f67a8151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.592+0000 7f67ad000640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67a80cdde0 0x7f67a8151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.592+0000 7f67ad000640 1 -- 172.21.15.19:0/2130605205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67a81616c0 msgr2=0x7f67a80b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.592+0000 7f67ad000640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67a81616c0 0x7f67a80b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.592+0000 7f67ad000640 1 -- 172.21.15.19:0/2130605205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a81f7260 con 0x7f67a80747d0 2024-04-25T10:26:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.592+0000 7f67ad000640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67a80747d0 0x7f67a81f6d20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f679800c430 tx=0x7f679800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.593+0000 7f67a4c00640 1 -- 172.21.15.19:0/2130605205 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798017070 con 0x7f67a80747d0 2024-04-25T10:26:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.593+0000 7f67a4c00640 1 -- 172.21.15.19:0/2130605205 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67980052f0 con 0x7f67a80747d0 2024-04-25T10:26:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.593+0000 7f67a4c00640 1 -- 172.21.15.19:0/2130605205 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798003830 con 0x7f67a80747d0 2024-04-25T10:26:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.593+0000 7f67afa00640 1 -- 172.21.15.19:0/2130605205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a815a570 con 0x7f67a80747d0 2024-04-25T10:26:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.593+0000 7f67afa00640 1 -- 172.21.15.19:0/2130605205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a815ab30 con 0x7f67a80747d0 2024-04-25T10:26:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.594+0000 7f67afa00640 1 -- 172.21.15.19:0/2130605205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a8076520 con 0x7f67a80747d0 2024-04-25T10:26:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.596+0000 7f67a4c00640 1 -- 172.21.15.19:0/2130605205 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f679801a070 con 0x7f67a80747d0 2024-04-25T10:26:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.596+0000 7f67a4c00640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6788074530 0x7f6788076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.597+0000 7f67a4c00640 1 -- 172.21.15.19:0/2130605205 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f6798094940 con 0x7f67a80747d0 2024-04-25T10:26:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.597+0000 7f67a7e00640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6788074530 0x7f6788076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.598+0000 7f67a7e00640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6788074530 0x7f6788076a40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6794034000 tx=0x7f679402f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:34.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.601+0000 7f67a4c00640 1 -- 172.21.15.19:0/2130605205 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f679805e780 con 0x7f67a80747d0 2024-04-25T10:26:34.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.817+0000 7f67afa00640 1 -- 172.21.15.19:0/2130605205 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67a80caf90 con 0x7f67a80747d0 2024-04-25T10:26:34.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.819+0000 7f67a4c00640 1 -- 172.21.15.19:0/2130605205 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f6798062a80 con 0x7f67a80747d0 2024-04-25T10:26:34.822 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:34.822 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:26:18.399567+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 -- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6788074530 msgr2=0x7f6788076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6788074530 0x7f6788076a40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6794034000 tx=0x7f679402f000 comp rx=0 tx=0).stop 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 -- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67a80747d0 msgr2=0x7f67a81f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67a80747d0 0x7f67a81f6d20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f679800c430 tx=0x7f679800c8f0 comp rx=0 tx=0).stop 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 -- 172.21.15.19:0/2130605205 shutdown_connections 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67a81616c0 0x7f67a80b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6788074530 0x7f6788076a40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67a80cdde0 0x7f67a8151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 --2- 172.21.15.19:0/2130605205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67a80747d0 0x7f67a81f6d20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 -- 172.21.15.19:0/2130605205 >> 172.21.15.19:0/2130605205 conn(0x7f67a806f1f0 msgr2=0x7f67a815dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 -- 172.21.15.19:0/2130605205 shutdown_connections 2024-04-25T10:26:34.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:34.822+0000 7f67afa00640 1 -- 172.21.15.19:0/2130605205 wait complete. 2024-04-25T10:26:34.855 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:25:24.611615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:25:34.760347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:25:35.692430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:25:39.212157+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:26:34.855 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:26:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.143+0000 7f4fdce00640 1 Processor -- start 2024-04-25T10:26:35.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.143+0000 7f4fdce00640 1 -- start start 2024-04-25T10:26:35.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.145+0000 7f4fdce00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4fd80c74c0 0x7f4fd8153450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.145+0000 7f4fdce00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd80c2a50 0x7f4fd8074120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.145+0000 7f4fdce00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd80c9730 con 0x7f4fd80c2640 2024-04-25T10:26:35.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.145+0000 7f4fdce00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd80703c0 con 0x7f4fd80c74c0 2024-04-25T10:26:35.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.145+0000 7f4fdce00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd80c2fe0 con 0x7f4fd80c2a50 2024-04-25T10:26:35.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.145+0000 7f4fd7400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4fd80c74c0 0x7f4fd8153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.145+0000 7f4fd6a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4fd80c2640 0x7f4fd81590b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52472/0 (socket says 172.21.15.19:52472) 2024-04-25T10:26:35.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.145+0000 7f4fd6a00640 1 -- 172.21.15.19:0/3637646661 learned_addr learned my addr 172.21.15.19:0/3637646661 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:35.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.145+0000 7f4fd7400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4fd80c74c0 0x7f4fd8153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55086/0 (socket says 172.21.15.19:55086) 2024-04-25T10:26:35.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.145+0000 7f4fd7e00640 1 --2- 172.21.15.19:0/3637646661 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd80c2a50 0x7f4fd8074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.146+0000 7f4fd7400640 1 -- 172.21.15.19:0/3637646661 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd80c2a50 msgr2=0x7f4fd8074120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:35.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.146+0000 7f4fd7400640 1 --2- 172.21.15.19:0/3637646661 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd80c2a50 0x7f4fd8074120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.146+0000 7f4fd7400640 1 -- 172.21.15.19:0/3637646661 >> v1:172.21.15.19:6789/0 conn(0x7f4fd80c2640 legacy=0x7f4fd81590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.146+0000 7f4fd7400640 1 -- 172.21.15.19:0/3637646661 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd80c99d0 con 0x7f4fd80c74c0 2024-04-25T10:26:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.147+0000 7f4fd7400640 1 --2- 172.21.15.19:0/3637646661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80c74c0 0x7f4fd8153450 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097a0 tx=0x7f4fc802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c5800ee9a11161 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.147+0000 7f4fd6000640 1 -- 172.21.15.19:0/3637646661 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8037070 con 0x7f4fd80c74c0 2024-04-25T10:26:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.147+0000 7f4fd6000640 1 -- 172.21.15.19:0/3637646661 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc8032440 con 0x7f4fd80c74c0 2024-04-25T10:26:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.147+0000 7f4fd6000640 1 -- 172.21.15.19:0/3637646661 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8032810 con 0x7f4fd80c74c0 2024-04-25T10:26:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.148+0000 7f4fdce00640 1 -- 172.21.15.19:0/3637646661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80c74c0 msgr2=0x7f4fd8153450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.148+0000 7f4fdce00640 1 --2- 172.21.15.19:0/3637646661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80c74c0 0x7f4fd8153450 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097a0 tx=0x7f4fc802a210 comp rx=0 tx=0).stop 2024-04-25T10:26:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.148+0000 7f4fdce00640 1 -- 172.21.15.19:0/3637646661 shutdown_connections 2024-04-25T10:26:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.148+0000 7f4fdce00640 1 --2- 172.21.15.19:0/3637646661 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd80c2a50 0x7f4fd8074120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.148+0000 7f4fdce00640 1 --2- 172.21.15.19:0/3637646661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80c74c0 0x7f4fd8153450 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.148+0000 7f4fdce00640 1 -- 172.21.15.19:0/3637646661 >> 172.21.15.19:0/3637646661 conn(0x7f4fd80ca120 msgr2=0x7f4fd80ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.148+0000 7f4fdce00640 1 -- 172.21.15.19:0/3637646661 shutdown_connections 2024-04-25T10:26:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.148+0000 7f4fdce00640 1 -- 172.21.15.19:0/3637646661 wait complete. 2024-04-25T10:26:35.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.151+0000 7f4fdce00640 1 Processor -- start 2024-04-25T10:26:35.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.151+0000 7f4fdce00640 1 -- start start 2024-04-25T10:26:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.152+0000 7f4fdce00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd80c2640 0x7f4fd80cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.152+0000 7f4fdce00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80c2a50 0x7f4fd81527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.152+0000 7f4fdce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fd80c74c0 0x7f4fd81f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.152+0000 7f4fdce00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd80c3580 con 0x7f4fd80c2a50 2024-04-25T10:26:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.152+0000 7f4fdce00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd80c32a0 con 0x7f4fd80c74c0 2024-04-25T10:26:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.152+0000 7f4fdce00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd80c3aa0 con 0x7f4fd80c2640 2024-04-25T10:26:35.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.152+0000 7f4fd6a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80c2a50 0x7f4fd81527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.153+0000 7f4fd6a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80c2a50 0x7f4fd81527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55100/0 (socket says 172.21.15.19:55100) 2024-04-25T10:26:35.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.153+0000 7f4fd6a00640 1 -- 172.21.15.19:0/2429883544 learned_addr learned my addr 172.21.15.19:0/2429883544 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:35.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.153+0000 7f4fd7400640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd80c2640 0x7f4fd80cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.153+0000 7f4fd7e00640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fd80c74c0 0x7f4fd81f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.153+0000 7f4fd6a00640 1 -- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd80c2640 msgr2=0x7f4fd80cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.153+0000 7f4fd6a00640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd80c2640 0x7f4fd80cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.153+0000 7f4fd6a00640 1 -- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fd80c74c0 msgr2=0x7f4fd81f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.153+0000 7f4fd6a00640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fd80c74c0 0x7f4fd81f5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.153+0000 7f4fd6a00640 1 -- 172.21.15.19:0/2429883544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd81f6b90 con 0x7f4fd80c2a50 2024-04-25T10:26:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.153+0000 7f4fd6a00640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80c2a50 0x7f4fd81527a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400c4b0 tx=0x7f4fc400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.154+0000 7f4fcf400640 1 -- 172.21.15.19:0/2429883544 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4017070 con 0x7f4fd80c2a50 2024-04-25T10:26:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.154+0000 7f4fcf400640 1 -- 172.21.15.19:0/2429883544 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc4005ce0 con 0x7f4fd80c2a50 2024-04-25T10:26:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.154+0000 7f4fcf400640 1 -- 172.21.15.19:0/2429883544 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4007270 con 0x7f4fd80c2a50 2024-04-25T10:26:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.154+0000 7f4fdce00640 1 -- 172.21.15.19:0/2429883544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd815a270 con 0x7f4fd80c2a50 2024-04-25T10:26:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.154+0000 7f4fdce00640 1 -- 172.21.15.19:0/2429883544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd814ade0 con 0x7f4fd80c2a50 2024-04-25T10:26:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.155+0000 7f4fdce00640 1 -- 172.21.15.19:0/2429883544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd8076520 con 0x7f4fd80c2a50 2024-04-25T10:26:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.156+0000 7f4fcf400640 1 -- 172.21.15.19:0/2429883544 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4fc401a070 con 0x7f4fd80c2a50 2024-04-25T10:26:35.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.157+0000 7f4fcf400640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4fb80744e0 0x7f4fb80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.157+0000 7f4fcf400640 1 -- 172.21.15.19:0/2429883544 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f4fc40947a0 con 0x7f4fd80c2a50 2024-04-25T10:26:35.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.158+0000 7f4fd7400640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4fb80744e0 0x7f4fb80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.158+0000 7f4fd7400640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4fb80744e0 0x7f4fb80769f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8034000 tx=0x7f4fc802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.162+0000 7f4fcf400640 1 -- 172.21.15.19:0/2429883544 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4fc405e5f0 con 0x7f4fd80c2a50 2024-04-25T10:26:35.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.366+0000 7f4fdce00640 1 -- 172.21.15.19:0/2429883544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4fd80c8af0 con 0x7f4fd80c2a50 2024-04-25T10:26:35.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.367+0000 7f4fcf400640 1 -- 172.21.15.19:0/2429883544 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f4fc40628f0 con 0x7f4fd80c2a50 2024-04-25T10:26:35.370 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-04-25T10:26:35.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.370+0000 7f4fdce00640 1 -- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4fb80744e0 msgr2=0x7f4fb80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.370+0000 7f4fdce00640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4fb80744e0 0x7f4fb80769f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8034000 tx=0x7f4fc802e000 comp rx=0 tx=0).stop 2024-04-25T10:26:35.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.370+0000 7f4fdce00640 1 -- 172.21.15.19:0/2429883544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80c2a50 msgr2=0x7f4fd81527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.370+0000 7f4fdce00640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80c2a50 0x7f4fd81527a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400c4b0 tx=0x7f4fc400c970 comp rx=0 tx=0).stop 2024-04-25T10:26:35.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.370+0000 7f4fdce00640 1 -- 172.21.15.19:0/2429883544 shutdown_connections 2024-04-25T10:26:35.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.370+0000 7f4fdce00640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fd80c74c0 0x7f4fd81f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.370+0000 7f4fdce00640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80c2a50 0x7f4fd81527a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.370+0000 7f4fdce00640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4fb80744e0 0x7f4fb80769f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.370+0000 7f4fdce00640 1 --2- 172.21.15.19:0/2429883544 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd80c2640 0x7f4fd80cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.370+0000 7f4fdce00640 1 -- 172.21.15.19:0/2429883544 >> 172.21.15.19:0/2429883544 conn(0x7f4fd80ca120 msgr2=0x7f4fd8072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:35.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.371+0000 7f4fdce00640 1 -- 172.21.15.19:0/2429883544 shutdown_connections 2024-04-25T10:26:35.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.371+0000 7f4fdce00640 1 -- 172.21.15.19:0/2429883544 wait complete. 2024-04-25T10:26:35.400 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:26:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.687+0000 7f02b5200640 1 Processor -- start 2024-04-25T10:26:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.687+0000 7f02b5200640 1 -- start start 2024-04-25T10:26:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.689+0000 7f02b5200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02b00ccfb0 0x7f02b00b7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.689+0000 7f02b5200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b0156770 0x7f02b00cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.689+0000 7f02b5200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b015f6d0 con 0x7f02b00cdb20 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.689+0000 7f02b5200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f02b00b76d0 con 0x7f02b00ccfb0 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.689+0000 7f02b5200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f02b015c7b0 con 0x7f02b0156770 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.690+0000 7f02afe00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f02b00cdb20 0x7f02b015ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52480/0 (socket says 172.21.15.19:52480) 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.690+0000 7f02afe00640 1 -- 172.21.15.19:0/3719542085 learned_addr learned my addr 172.21.15.19:0/3719542085 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.690+0000 7f02aea00640 1 --2- 172.21.15.19:0/3719542085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b0156770 0x7f02b00cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.690+0000 7f02af400640 1 --2- 172.21.15.19:0/3719542085 >> v2:172.21.15.112:3300/0 conn(0x7f02b00ccfb0 0x7f02b00b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.690+0000 7f02ae000640 1 -- 172.21.15.19:0/3719542085 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998163694 0 0) 0x7f02b015f6d0 con 0x7f02b00cdb20 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.690+0000 7f02ae000640 1 -- 172.21.15.19:0/3719542085 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0294003520 con 0x7f02b00cdb20 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.690+0000 7f02aea00640 1 -- 172.21.15.19:0/3719542085 >> v2:172.21.15.112:3300/0 conn(0x7f02b00ccfb0 msgr2=0x7f02b00b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.690+0000 7f02aea00640 1 --2- 172.21.15.19:0/3719542085 >> v2:172.21.15.112:3300/0 conn(0x7f02b00ccfb0 0x7f02b00b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.691+0000 7f02aea00640 1 -- 172.21.15.19:0/3719542085 >> v1:172.21.15.19:6789/0 conn(0x7f02b00cdb20 legacy=0x7f02b015ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.691+0000 7f02aea00640 1 -- 172.21.15.19:0/3719542085 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b015d2f0 con 0x7f02b0156770 2024-04-25T10:26:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.691+0000 7f02af400640 1 --2- 172.21.15.19:0/3719542085 >> v2:172.21.15.112:3300/0 conn(0x7f02b00ccfb0 0x7f02b00b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.692+0000 7f02aea00640 1 --2- 172.21.15.19:0/3719542085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b0156770 0x7f02b00cd5e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f02980097a0 tx=0x7f029802a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c8ad51fcb67b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.692+0000 7f02ae000640 1 -- 172.21.15.19:0/3719542085 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0298037070 con 0x7f02b0156770 2024-04-25T10:26:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.692+0000 7f02ae000640 1 -- 172.21.15.19:0/3719542085 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0298032440 con 0x7f02b0156770 2024-04-25T10:26:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.692+0000 7f02ae000640 1 -- 172.21.15.19:0/3719542085 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0298032810 con 0x7f02b0156770 2024-04-25T10:26:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.693+0000 7f02b5200640 1 -- 172.21.15.19:0/3719542085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b0156770 msgr2=0x7f02b00cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.693+0000 7f02b5200640 1 --2- 172.21.15.19:0/3719542085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b0156770 0x7f02b00cd5e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f02980097a0 tx=0x7f029802a230 comp rx=0 tx=0).stop 2024-04-25T10:26:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.693+0000 7f02b5200640 1 -- 172.21.15.19:0/3719542085 shutdown_connections 2024-04-25T10:26:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.693+0000 7f02b5200640 1 --2- 172.21.15.19:0/3719542085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b0156770 0x7f02b00cd5e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.693+0000 7f02b5200640 1 --2- 172.21.15.19:0/3719542085 >> v2:172.21.15.112:3300/0 conn(0x7f02b00ccfb0 0x7f02b00b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.693+0000 7f02b5200640 1 -- 172.21.15.19:0/3719542085 >> 172.21.15.19:0/3719542085 conn(0x7f02b0068880 msgr2=0x7f02b0068c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:35.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.693+0000 7f02b5200640 1 -- 172.21.15.19:0/3719542085 shutdown_connections 2024-04-25T10:26:35.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.693+0000 7f02b5200640 1 -- 172.21.15.19:0/3719542085 wait complete. 2024-04-25T10:26:35.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.695+0000 7f02b5200640 1 Processor -- start 2024-04-25T10:26:35.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.696+0000 7f02b5200640 1 -- start start 2024-04-25T10:26:35.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.697+0000 7f02b5200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b00ccfb0 0x7f02b01f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.697+0000 7f02b5200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b00cdb20 0x7f02b0150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.697+0000 7f02b5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b0156770 0x7f02b00d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.697+0000 7f02b5200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02b015d010 con 0x7f02b00cdb20 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.697+0000 7f02b5200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f02b015cd30 con 0x7f02b0156770 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.697+0000 7f02b5200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f02b015fa20 con 0x7f02b00ccfb0 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.698+0000 7f02af400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b00ccfb0 0x7f02b01f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.698+0000 7f02aea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b00cdb20 0x7f02b0150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.698+0000 7f02af400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b00ccfb0 0x7f02b01f28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:37732/0 (socket says 172.21.15.19:37732) 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.698+0000 7f02afe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b0156770 0x7f02b00d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.698+0000 7f02af400640 1 -- 172.21.15.19:0/473156867 learned_addr learned my addr 172.21.15.19:0/473156867 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.698+0000 7f02af400640 1 -- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b0156770 msgr2=0x7f02b00d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.698+0000 7f02af400640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b0156770 0x7f02b00d0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.698+0000 7f02af400640 1 -- 172.21.15.19:0/473156867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b00cdb20 msgr2=0x7f02b0150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.698+0000 7f02af400640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b00cdb20 0x7f02b0150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.698+0000 7f02af400640 1 -- 172.21.15.19:0/473156867 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b015aeb0 con 0x7f02b00ccfb0 2024-04-25T10:26:35.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.698+0000 7f02af400640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b00ccfb0 0x7f02b01f28b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009ec0 tx=0x7f02a000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:35.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.699+0000 7f02a7400640 1 -- 172.21.15.19:0/473156867 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a0018020 con 0x7f02b00ccfb0 2024-04-25T10:26:35.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.699+0000 7f02a7400640 1 -- 172.21.15.19:0/473156867 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a0014680 con 0x7f02b00ccfb0 2024-04-25T10:26:35.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.699+0000 7f02a7400640 1 -- 172.21.15.19:0/473156867 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a0014a50 con 0x7f02b00ccfb0 2024-04-25T10:26:35.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.699+0000 7f02b5200640 1 -- 172.21.15.19:0/473156867 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b01e5ed0 con 0x7f02b00ccfb0 2024-04-25T10:26:35.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.699+0000 7f02b5200640 1 -- 172.21.15.19:0/473156867 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b00c7110 con 0x7f02b00ccfb0 2024-04-25T10:26:35.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.700+0000 7f02b5200640 1 -- 172.21.15.19:0/473156867 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b01e60a0 con 0x7f02b00ccfb0 2024-04-25T10:26:35.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.701+0000 7f02a7400640 1 -- 172.21.15.19:0/473156867 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f02a0005d10 con 0x7f02b00ccfb0 2024-04-25T10:26:35.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.702+0000 7f02a7400640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f028c0744e0 0x7f028c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:35.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.702+0000 7f02a7400640 1 -- 172.21.15.19:0/473156867 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f02a0096180 con 0x7f02b00ccfb0 2024-04-25T10:26:35.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.703+0000 7f02aea00640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f028c0744e0 0x7f028c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:35.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.703+0000 7f02aea00640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f028c0744e0 0x7f028c0769f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0298034000 tx=0x7f029802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:35.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.707+0000 7f02a7400640 1 -- 172.21.15.19:0/473156867 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02a0022030 con 0x7f02b00ccfb0 2024-04-25T10:26:35.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.912+0000 7f02b5200640 1 -- 172.21.15.19:0/473156867 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f02b0076520 con 0x7f02b00ccfb0 2024-04-25T10:26:35.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.913+0000 7f02a7400640 1 -- 172.21.15.19:0/473156867 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f02a0010040 con 0x7f02b00ccfb0 2024-04-25T10:26:35.916 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:26:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.916+0000 7f02b5200640 1 -- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f028c0744e0 msgr2=0x7f028c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.916+0000 7f02b5200640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f028c0744e0 0x7f028c0769f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0298034000 tx=0x7f029802e000 comp rx=0 tx=0).stop 2024-04-25T10:26:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.916+0000 7f02b5200640 1 -- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b00ccfb0 msgr2=0x7f02b01f28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.916+0000 7f02b5200640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b00ccfb0 0x7f02b01f28b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009ec0 tx=0x7f02a000c490 comp rx=0 tx=0).stop 2024-04-25T10:26:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.916+0000 7f02b5200640 1 -- 172.21.15.19:0/473156867 shutdown_connections 2024-04-25T10:26:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.916+0000 7f02b5200640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02b0156770 0x7f02b00d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.916+0000 7f02b5200640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02b00cdb20 0x7f02b0150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.916+0000 7f02b5200640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f028c0744e0 0x7f028c0769f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.916+0000 7f02b5200640 1 --2- 172.21.15.19:0/473156867 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02b00ccfb0 0x7f02b01f28b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.916+0000 7f02b5200640 1 -- 172.21.15.19:0/473156867 >> 172.21.15.19:0/473156867 conn(0x7f02b0068880 msgr2=0x7f02b015a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.917+0000 7f02b5200640 1 -- 172.21.15.19:0/473156867 shutdown_connections 2024-04-25T10:26:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:35.917+0000 7f02b5200640 1 -- 172.21.15.19:0/473156867 wait complete. 2024-04-25T10:26:35.945 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:26:36.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.228+0000 7ff83d600640 1 Processor -- start 2024-04-25T10:26:36.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.228+0000 7ff83d600640 1 -- start start 2024-04-25T10:26:36.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.230+0000 7ff83d600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8380c98b0 0x7ff83815fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.230+0000 7ff83d600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8381563b0 0x7ff8381567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.230+0000 7ff83d600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8380c5720 con 0x7ff838074930 2024-04-25T10:26:36.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.230+0000 7ff83d600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff838156d00 con 0x7ff8380c98b0 2024-04-25T10:26:36.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.230+0000 7ff83d600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff838160a80 con 0x7ff8381563b0 2024-04-25T10:26:36.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.230+0000 7ff836a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff838074930 0x7ff8380c5010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52484/0 (socket says 172.21.15.19:52484) 2024-04-25T10:26:36.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.230+0000 7ff836a00640 1 -- 172.21.15.19:0/457754125 learned_addr learned my addr 172.21.15.19:0/457754125 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:36.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.230+0000 7ff836000640 1 --2- 172.21.15.19:0/457754125 >> v2:172.21.15.112:3300/0 conn(0x7ff8380c98b0 0x7ff83815fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.230+0000 7ff837400640 1 --2- 172.21.15.19:0/457754125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8381563b0 0x7ff8381567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.231+0000 7ff835600640 1 -- 172.21.15.19:0/457754125 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802279831 0 0) 0x7ff8380c5720 con 0x7ff838074930 2024-04-25T10:26:36.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.231+0000 7ff836000640 1 -- 172.21.15.19:0/457754125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8381563b0 msgr2=0x7ff8381567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:36.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.231+0000 7ff836000640 1 --2- 172.21.15.19:0/457754125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8381563b0 0x7ff8381567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.231+0000 7ff836000640 1 -- 172.21.15.19:0/457754125 >> v1:172.21.15.19:6789/0 conn(0x7ff838074930 legacy=0x7ff8380c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:36.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.231+0000 7ff836000640 1 -- 172.21.15.19:0/457754125 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8380c94b0 con 0x7ff8380c98b0 2024-04-25T10:26:36.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.232+0000 7ff836000640 1 --2- 172.21.15.19:0/457754125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8380c98b0 0x7ff83815fdd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff8240097a0 tx=0x7ff82402a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8330690bb1f9795 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:36.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.232+0000 7ff835600640 1 -- 172.21.15.19:0/457754125 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff824037070 con 0x7ff8380c98b0 2024-04-25T10:26:36.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.232+0000 7ff835600640 1 -- 172.21.15.19:0/457754125 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff82402ae40 con 0x7ff8380c98b0 2024-04-25T10:26:36.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.232+0000 7ff835600640 1 -- 172.21.15.19:0/457754125 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff824032660 con 0x7ff8380c98b0 2024-04-25T10:26:36.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.233+0000 7ff83d600640 1 -- 172.21.15.19:0/457754125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8380c98b0 msgr2=0x7ff83815fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:36.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.233+0000 7ff83d600640 1 --2- 172.21.15.19:0/457754125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8380c98b0 0x7ff83815fdd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff8240097a0 tx=0x7ff82402a0f0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.233+0000 7ff83d600640 1 -- 172.21.15.19:0/457754125 shutdown_connections 2024-04-25T10:26:36.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.233+0000 7ff83d600640 1 --2- 172.21.15.19:0/457754125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8381563b0 0x7ff8381567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.233+0000 7ff83d600640 1 --2- 172.21.15.19:0/457754125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8380c98b0 0x7ff83815fdd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.233+0000 7ff83d600640 1 -- 172.21.15.19:0/457754125 >> 172.21.15.19:0/457754125 conn(0x7ff8380cdb10 msgr2=0x7ff8380cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:36.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.233+0000 7ff83d600640 1 -- 172.21.15.19:0/457754125 shutdown_connections 2024-04-25T10:26:36.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.233+0000 7ff83d600640 1 -- 172.21.15.19:0/457754125 wait complete. 2024-04-25T10:26:36.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.235+0000 7ff83d600640 1 Processor -- start 2024-04-25T10:26:36.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.236+0000 7ff83d600640 1 -- start start 2024-04-25T10:26:36.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.237+0000 7ff83d600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff838074930 0x7ff838158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.237+0000 7ff83d600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8380c98b0 0x7ff838157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.237+0000 7ff83d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8381563b0 0x7ff838157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.237+0000 7ff83d600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff8380cae60 con 0x7ff8380c98b0 2024-04-25T10:26:36.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.237+0000 7ff83d600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff8380ca9d0 con 0x7ff8381563b0 2024-04-25T10:26:36.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.237+0000 7ff83d600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff8380c8e00 con 0x7ff838074930 2024-04-25T10:26:36.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff836000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8380c98b0 0x7ff838157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff836a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff838074930 0x7ff838158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff836000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8380c98b0 0x7ff838157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55106/0 (socket says 172.21.15.19:55106) 2024-04-25T10:26:36.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff836000640 1 -- 172.21.15.19:0/2805220565 learned_addr learned my addr 172.21.15.19:0/2805220565 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:36.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff837400640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8381563b0 0x7ff838157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff836a00640 1 -- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8381563b0 msgr2=0x7ff838157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:36.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff836a00640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8381563b0 0x7ff838157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff836a00640 1 -- 172.21.15.19:0/2805220565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8380c98b0 msgr2=0x7ff838157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff836a00640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8380c98b0 0x7ff838157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff836a00640 1 -- 172.21.15.19:0/2805220565 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8380cd920 con 0x7ff838074930 2024-04-25T10:26:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff836000640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8380c98b0 0x7ff838157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.238+0000 7ff836a00640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff838074930 0x7ff838158a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c440 tx=0x7ff82800c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.239+0000 7ff82ea00640 1 -- 172.21.15.19:0/2805220565 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8280074e0 con 0x7ff838074930 2024-04-25T10:26:36.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.239+0000 7ff82ea00640 1 -- 172.21.15.19:0/2805220565 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8280047e0 con 0x7ff838074930 2024-04-25T10:26:36.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.239+0000 7ff83d600640 1 -- 172.21.15.19:0/2805220565 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8380cc680 con 0x7ff838074930 2024-04-25T10:26:36.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.239+0000 7ff82ea00640 1 -- 172.21.15.19:0/2805220565 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828004bd0 con 0x7ff838074930 2024-04-25T10:26:36.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.239+0000 7ff83d600640 1 -- 172.21.15.19:0/2805220565 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8381479f0 con 0x7ff838074930 2024-04-25T10:26:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.240+0000 7ff83d600640 1 -- 172.21.15.19:0/2805220565 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8380cd430 con 0x7ff838074930 2024-04-25T10:26:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.242+0000 7ff82ea00640 1 -- 172.21.15.19:0/2805220565 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff828011070 con 0x7ff838074930 2024-04-25T10:26:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.243+0000 7ff82ea00640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8180744b0 0x7ff8180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.243+0000 7ff82ea00640 1 -- 172.21.15.19:0/2805220565 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7ff828094fb0 con 0x7ff838074930 2024-04-25T10:26:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.243+0000 7ff836000640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8180744b0 0x7ff8180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.244+0000 7ff836000640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8180744b0 0x7ff8180769c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff82402a130 tx=0x7ff82402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.248+0000 7ff82ea00640 1 -- 172.21.15.19:0/2805220565 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff82805eec0 con 0x7ff838074930 2024-04-25T10:26:36.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.453+0000 7ff83d600640 1 -- 172.21.15.19:0/2805220565 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff838076520 con 0x7ff838074930 2024-04-25T10:26:36.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.454+0000 7ff82ea00640 1 -- 172.21.15.19:0/2805220565 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7ff8280631c0 con 0x7ff838074930 2024-04-25T10:26:36.456 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-04-25T10:26:36.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.456+0000 7ff83d600640 1 -- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8180744b0 msgr2=0x7ff8180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.456+0000 7ff83d600640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8180744b0 0x7ff8180769c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff82402a130 tx=0x7ff82402e000 comp rx=0 tx=0).stop 2024-04-25T10:26:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.456+0000 7ff83d600640 1 -- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff838074930 msgr2=0x7ff838158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.456+0000 7ff83d600640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff838074930 0x7ff838158a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c440 tx=0x7ff82800c900 comp rx=0 tx=0).stop 2024-04-25T10:26:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.457+0000 7ff83d600640 1 -- 172.21.15.19:0/2805220565 shutdown_connections 2024-04-25T10:26:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.457+0000 7ff83d600640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8381563b0 0x7ff838157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.457+0000 7ff83d600640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8380c98b0 0x7ff838157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.457+0000 7ff83d600640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8180744b0 0x7ff8180769c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.457+0000 7ff83d600640 1 --2- 172.21.15.19:0/2805220565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff838074930 0x7ff838158a60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.457+0000 7ff83d600640 1 -- 172.21.15.19:0/2805220565 >> 172.21.15.19:0/2805220565 conn(0x7ff8380cdb10 msgr2=0x7ff8380c75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.457+0000 7ff83d600640 1 -- 172.21.15.19:0/2805220565 shutdown_connections 2024-04-25T10:26:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.457+0000 7ff83d600640 1 -- 172.21.15.19:0/2805220565 wait complete. 2024-04-25T10:26:36.486 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:26:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.772+0000 7f4ae4400640 1 Processor -- start 2024-04-25T10:26:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.772+0000 7f4ae4400640 1 -- start start 2024-04-25T10:26:36.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.774+0000 7f4ae4400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4adc15b2c0 0x7f4adc0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.774+0000 7f4ae4400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4adc073160 0x7f4adc15e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.775+0000 7f4ae4400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4adc158010 con 0x7f4adc15e760 2024-04-25T10:26:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.775+0000 7f4ae4400640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f4adc074970 con 0x7f4adc073160 2024-04-25T10:26:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.775+0000 7f4ae4400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4adc0c8600 con 0x7f4adc15b2c0 2024-04-25T10:26:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.775+0000 7f4ae1000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4adc073160 0x7f4adc15e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.775+0000 7f4ae1000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4adc073160 0x7f4adc15e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55116/0 (socket says 172.21.15.19:55116) 2024-04-25T10:26:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.775+0000 7f4ae1000640 1 -- 172.21.15.19:0/2409076466 learned_addr learned my addr 172.21.15.19:0/2409076466 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.775+0000 7f4ae1a00640 1 --2- 172.21.15.19:0/2409076466 >> v2:172.21.15.112:3300/0 conn(0x7f4adc15b2c0 0x7f4adc0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.775+0000 7f4ae1000640 1 -- 172.21.15.19:0/2409076466 >> v2:172.21.15.112:3300/0 conn(0x7f4adc15b2c0 msgr2=0x7f4adc0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.775+0000 7f4ae1000640 1 --2- 172.21.15.19:0/2409076466 >> v2:172.21.15.112:3300/0 conn(0x7f4adc15b2c0 0x7f4adc0c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.775+0000 7f4ae1000640 1 -- 172.21.15.19:0/2409076466 >> v1:172.21.15.112:6789/0 conn(0x7f4adc15e760 legacy=0x7f4adc0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.775+0000 7f4ae1000640 1 -- 172.21.15.19:0/2409076466 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc0c88e0 con 0x7f4adc073160 2024-04-25T10:26:36.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.777+0000 7f4ae1000640 1 --2- 172.21.15.19:0/2409076466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4adc073160 0x7f4adc15e220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0cea20 tx=0x7f4ac802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4045e5a258e0972 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:36.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.777+0000 7f4adbe00640 1 -- 172.21.15.19:0/2409076466 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8037070 con 0x7f4adc073160 2024-04-25T10:26:36.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.777+0000 7f4adbe00640 1 -- 172.21.15.19:0/2409076466 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac802ae50 con 0x7f4adc073160 2024-04-25T10:26:36.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.777+0000 7f4adbe00640 1 -- 172.21.15.19:0/2409076466 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8032860 con 0x7f4adc073160 2024-04-25T10:26:36.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.778+0000 7f4ae4400640 1 -- 172.21.15.19:0/2409076466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4adc073160 msgr2=0x7f4adc15e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:36.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.778+0000 7f4ae4400640 1 --2- 172.21.15.19:0/2409076466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4adc073160 0x7f4adc15e220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0cea20 tx=0x7f4ac802a300 comp rx=0 tx=0).stop 2024-04-25T10:26:36.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.778+0000 7f4ae4400640 1 -- 172.21.15.19:0/2409076466 shutdown_connections 2024-04-25T10:26:36.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.778+0000 7f4ae4400640 1 --2- 172.21.15.19:0/2409076466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4adc073160 0x7f4adc15e220 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.778+0000 7f4ae4400640 1 --2- 172.21.15.19:0/2409076466 >> v2:172.21.15.112:3300/0 conn(0x7f4adc15b2c0 0x7f4adc0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.778+0000 7f4ae4400640 1 -- 172.21.15.19:0/2409076466 >> 172.21.15.19:0/2409076466 conn(0x7f4adc06f1f0 msgr2=0x7f4adc06f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:36.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.778+0000 7f4ae4400640 1 -- 172.21.15.19:0/2409076466 shutdown_connections 2024-04-25T10:26:36.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.778+0000 7f4ae4400640 1 -- 172.21.15.19:0/2409076466 wait complete. 2024-04-25T10:26:36.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.780+0000 7f4ae4400640 1 Processor -- start 2024-04-25T10:26:36.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.781+0000 7f4ae4400640 1 -- start start 2024-04-25T10:26:36.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.782+0000 7f4ae4400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4adc073160 0x7f4adc0c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.782+0000 7f4ae4400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4adc15e760 0x7f4adc14d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.782+0000 7f4ae4400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4adc0af040 0x7f4adc0af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.782+0000 7f4ae4400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc06d4c0 con 0x7f4adc15e760 2024-04-25T10:26:36.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.782+0000 7f4ae4400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc15a580 con 0x7f4adc073160 2024-04-25T10:26:36.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.782+0000 7f4ae4400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4adc0ce4f0 con 0x7f4adc0af040 2024-04-25T10:26:36.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.782+0000 7f4ae1a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4adc073160 0x7f4adc0c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae1000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4adc15e760 0x7f4adc14d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae1a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4adc073160 0x7f4adc0c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:36202/0 (socket says 172.21.15.19:36202) 2024-04-25T10:26:36.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae1a00640 1 -- 172.21.15.19:0/3711600765 learned_addr learned my addr 172.21.15.19:0/3711600765 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:36.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae2400640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4adc0af040 0x7f4adc0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae1a00640 1 -- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4adc0af040 msgr2=0x7f4adc0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae1a00640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4adc0af040 0x7f4adc0af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae1a00640 1 -- 172.21.15.19:0/3711600765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4adc15e760 msgr2=0x7f4adc14d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae1a00640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4adc15e760 0x7f4adc14d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae1a00640 1 -- 172.21.15.19:0/3711600765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc076290 con 0x7f4adc073160 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae1000640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4adc15e760 0x7f4adc14d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae2400640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4adc0af040 0x7f4adc0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.783+0000 7f4ae1a00640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4adc073160 0x7f4adc0c3870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000e8d0 tx=0x7f4ad000ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.784+0000 7f4ad9600640 1 -- 172.21.15.19:0/3711600765 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0017070 con 0x7f4adc073160 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.784+0000 7f4ad9600640 1 -- 172.21.15.19:0/3711600765 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad000c940 con 0x7f4adc073160 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.784+0000 7f4ad9600640 1 -- 172.21.15.19:0/3711600765 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000cd30 con 0x7f4adc073160 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.784+0000 7f4ae4400640 1 -- 172.21.15.19:0/3711600765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4adc0c3db0 con 0x7f4adc073160 2024-04-25T10:26:36.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.784+0000 7f4ae4400640 1 -- 172.21.15.19:0/3711600765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4adc0c2cd0 con 0x7f4adc073160 2024-04-25T10:26:36.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.785+0000 7f4ae4400640 1 -- 172.21.15.19:0/3711600765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4adc076520 con 0x7f4adc073160 2024-04-25T10:26:36.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.786+0000 7f4ad9600640 1 -- 172.21.15.19:0/3711600765 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4ad001a070 con 0x7f4adc073160 2024-04-25T10:26:36.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.787+0000 7f4ad9600640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4abc0744b0 0x7f4abc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:36.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.787+0000 7f4ad9600640 1 -- 172.21.15.19:0/3711600765 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f4ad0095330 con 0x7f4adc073160 2024-04-25T10:26:36.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.788+0000 7f4ae1000640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4abc0744b0 0x7f4abc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:36.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.788+0000 7f4ae1000640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4abc0744b0 0x7f4abc0769c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8034000 tx=0x7f4ac802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:36.793+0000 7f4ad9600640 1 -- 172.21.15.19:0/3711600765 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ad005f240 con 0x7f4adc073160 2024-04-25T10:26:37.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.000+0000 7f4ae4400640 1 -- 172.21.15.19:0/3711600765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4adc074100 con 0x7f4adc073160 2024-04-25T10:26:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.001+0000 7f4ad9600640 1 -- 172.21.15.19:0/3711600765 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f4ad0063540 con 0x7f4adc073160 2024-04-25T10:26:37.004 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:26:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 -- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4abc0744b0 msgr2=0x7f4abc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4abc0744b0 0x7f4abc0769c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8034000 tx=0x7f4ac802e000 comp rx=0 tx=0).stop 2024-04-25T10:26:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 -- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4adc073160 msgr2=0x7f4adc0c3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4adc073160 0x7f4adc0c3870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000e8d0 tx=0x7f4ad000ed90 comp rx=0 tx=0).stop 2024-04-25T10:26:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 -- 172.21.15.19:0/3711600765 shutdown_connections 2024-04-25T10:26:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4abc0744b0 0x7f4abc0769c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4adc0af040 0x7f4adc0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4adc15e760 0x7f4adc14d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 --2- 172.21.15.19:0/3711600765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4adc073160 0x7f4adc0c3870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 -- 172.21.15.19:0/3711600765 >> 172.21.15.19:0/3711600765 conn(0x7f4adc06f1f0 msgr2=0x7f4adc0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 -- 172.21.15.19:0/3711600765 shutdown_connections 2024-04-25T10:26:37.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.004+0000 7f4ae4400640 1 -- 172.21.15.19:0/3711600765 wait complete. 2024-04-25T10:26:37.034 INFO:tasks.mds_thrash:mds thrasher using random seed: 1714040797 2024-04-25T10:26:37.035 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:37.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.329+0000 7f28c7e00640 1 Processor -- start 2024-04-25T10:26:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.330+0000 7f28c7e00640 1 -- start start 2024-04-25T10:26:37.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.332+0000 7f28c7e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28c0073160 0x7f28c015af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.332+0000 7f28c7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f28c00ca410 0x7f28c00ca820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.332+0000 7f28c7e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c00c4670 con 0x7f28c00746e0 2024-04-25T10:26:37.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.332+0000 7f28c7e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f28c00c3ce0 con 0x7f28c0073160 2024-04-25T10:26:37.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.332+0000 7f28c7e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f28c00cad60 con 0x7f28c00ca410 2024-04-25T10:26:37.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.333+0000 7f28c4a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28c0073160 0x7f28c015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.333+0000 7f28c5e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f28c00ca410 0x7f28c00ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.333+0000 7f28c4a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28c0073160 0x7f28c015af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55142/0 (socket says 172.21.15.19:55142) 2024-04-25T10:26:37.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.333+0000 7f28c5400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f28c00746e0 0x7f28c00c8c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52490/0 (socket says 172.21.15.19:52490) 2024-04-25T10:26:37.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.333+0000 7f28c4a00640 1 -- 172.21.15.19:0/3477942776 learned_addr learned my addr 172.21.15.19:0/3477942776 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:37.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.333+0000 7f28c4a00640 1 -- 172.21.15.19:0/3477942776 >> v2:172.21.15.112:3300/0 conn(0x7f28c00ca410 msgr2=0x7f28c00ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:37.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.333+0000 7f28c4a00640 1 --2- 172.21.15.19:0/3477942776 >> v2:172.21.15.112:3300/0 conn(0x7f28c00ca410 0x7f28c00ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.333+0000 7f28c4a00640 1 -- 172.21.15.19:0/3477942776 >> v1:172.21.15.19:6789/0 conn(0x7f28c00746e0 legacy=0x7f28c00c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.333+0000 7f28c4a00640 1 -- 172.21.15.19:0/3477942776 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c00c4950 con 0x7f28c0073160 2024-04-25T10:26:37.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.335+0000 7f28c4a00640 1 --2- 172.21.15.19:0/3477942776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c0073160 0x7f28c015af90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f28c00cb5b0 tx=0x7f28ac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59f48ab623e4019 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:37.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.335+0000 7f28bfe00640 1 -- 172.21.15.19:0/3477942776 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac037070 con 0x7f28c0073160 2024-04-25T10:26:37.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.335+0000 7f28bfe00640 1 -- 172.21.15.19:0/3477942776 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ac02ae50 con 0x7f28c0073160 2024-04-25T10:26:37.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.335+0000 7f28bfe00640 1 -- 172.21.15.19:0/3477942776 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac032860 con 0x7f28c0073160 2024-04-25T10:26:37.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.336+0000 7f28c7e00640 1 -- 172.21.15.19:0/3477942776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c0073160 msgr2=0x7f28c015af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.336+0000 7f28c7e00640 1 --2- 172.21.15.19:0/3477942776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c0073160 0x7f28c015af90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f28c00cb5b0 tx=0x7f28ac02a300 comp rx=0 tx=0).stop 2024-04-25T10:26:37.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.336+0000 7f28c7e00640 1 -- 172.21.15.19:0/3477942776 shutdown_connections 2024-04-25T10:26:37.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.336+0000 7f28c7e00640 1 --2- 172.21.15.19:0/3477942776 >> v2:172.21.15.112:3300/0 conn(0x7f28c00ca410 0x7f28c00ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.336+0000 7f28c7e00640 1 --2- 172.21.15.19:0/3477942776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c0073160 0x7f28c015af90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.336+0000 7f28c7e00640 1 -- 172.21.15.19:0/3477942776 >> 172.21.15.19:0/3477942776 conn(0x7f28c006f1f0 msgr2=0x7f28c006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:37.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.337+0000 7f28c7e00640 1 -- 172.21.15.19:0/3477942776 shutdown_connections 2024-04-25T10:26:37.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.337+0000 7f28c7e00640 1 -- 172.21.15.19:0/3477942776 wait complete. 2024-04-25T10:26:37.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.339+0000 7f28c7e00640 1 Processor -- start 2024-04-25T10:26:37.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.339+0000 7f28c7e00640 1 -- start start 2024-04-25T10:26:37.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.340+0000 7f28c7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c0073160 0x7f28c015f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28c00746e0 0x7f28c0157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c7e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c00ca410 0x7f28c015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c7e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f28c00b0720 con 0x7f28c00ca410 2024-04-25T10:26:37.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f28c00c3670 con 0x7f28c0073160 2024-04-25T10:26:37.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c7e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f28c00c9380 con 0x7f28c00746e0 2024-04-25T10:26:37.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c0073160 0x7f28c015f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c5e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c00ca410 0x7f28c015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c5e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c00ca410 0x7f28c015b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55154/0 (socket says 172.21.15.19:55154) 2024-04-25T10:26:37.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c5e00640 1 -- 172.21.15.19:0/826766134 learned_addr learned my addr 172.21.15.19:0/826766134 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:37.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c4a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28c00746e0 0x7f28c0157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c0073160 0x7f28c015f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:36212/0 (socket says 172.21.15.19:36212) 2024-04-25T10:26:37.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c5e00640 1 -- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28c00746e0 msgr2=0x7f28c0157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c5e00640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28c00746e0 0x7f28c0157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c5e00640 1 -- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c0073160 msgr2=0x7f28c015f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c5e00640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c0073160 0x7f28c015f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c5e00640 1 -- 172.21.15.19:0/826766134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c00b2940 con 0x7f28c00ca410 2024-04-25T10:26:37.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.341+0000 7f28c5400640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c0073160 0x7f28c015f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:37.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.342+0000 7f28c5e00640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c00ca410 0x7f28c015b740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f28b800ef90 tx=0x7f28b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:37.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.342+0000 7f28bd600640 1 -- 172.21.15.19:0/826766134 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8018020 con 0x7f28c00ca410 2024-04-25T10:26:37.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.342+0000 7f28bd600640 1 -- 172.21.15.19:0/826766134 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b8014480 con 0x7f28c00ca410 2024-04-25T10:26:37.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.342+0000 7f28bd600640 1 -- 172.21.15.19:0/826766134 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8009e60 con 0x7f28c00ca410 2024-04-25T10:26:37.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.342+0000 7f28c7e00640 1 -- 172.21.15.19:0/826766134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c0161040 con 0x7f28c00ca410 2024-04-25T10:26:37.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.342+0000 7f28c7e00640 1 -- 172.21.15.19:0/826766134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c015f1c0 con 0x7f28c00ca410 2024-04-25T10:26:37.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.344+0000 7f28c7e00640 1 -- 172.21.15.19:0/826766134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c0076520 con 0x7f28c00ca410 2024-04-25T10:26:37.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.346+0000 7f28bd600640 1 -- 172.21.15.19:0/826766134 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f28b8005d10 con 0x7f28c00ca410 2024-04-25T10:26:37.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.346+0000 7f28bd600640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f28a00744e0 0x7f28a00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.346+0000 7f28bd600640 1 -- 172.21.15.19:0/826766134 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f28b80960a0 con 0x7f28c00ca410 2024-04-25T10:26:37.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.347+0000 7f28c5400640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f28a00744e0 0x7f28a00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.347+0000 7f28c5400640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f28a00744e0 0x7f28a00769f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28b4007fd0 tx=0x7f28b4007e80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:37.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.351+0000 7f28bd600640 1 -- 172.21.15.19:0/826766134 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f28b8022030 con 0x7f28c00ca410 2024-04-25T10:26:37.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.556+0000 7f28c7e00640 1 -- 172.21.15.19:0/826766134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28c0161360 con 0x7f28c00ca410 2024-04-25T10:26:37.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.560+0000 7f28bd600640 1 -- 172.21.15.19:0/826766134 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f28b8010040 con 0x7f28c00ca410 2024-04-25T10:26:37.563 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:37.563 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:26:18.399567+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:37.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.562+0000 7f28c7e00640 1 -- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f28a00744e0 msgr2=0x7f28a00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.562+0000 7f28c7e00640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f28a00744e0 0x7f28a00769f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28b4007fd0 tx=0x7f28b4007e80 comp rx=0 tx=0).stop 2024-04-25T10:26:37.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.562+0000 7f28c7e00640 1 -- 172.21.15.19:0/826766134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c00ca410 msgr2=0x7f28c015b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.562+0000 7f28c7e00640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c00ca410 0x7f28c015b740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f28b800ef90 tx=0x7f28b800c490 comp rx=0 tx=0).stop 2024-04-25T10:26:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.563+0000 7f28c7e00640 1 -- 172.21.15.19:0/826766134 shutdown_connections 2024-04-25T10:26:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.563+0000 7f28c7e00640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c00ca410 0x7f28c015b740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.563+0000 7f28c7e00640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f28a00744e0 0x7f28a00769f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.563+0000 7f28c7e00640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28c00746e0 0x7f28c0157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.563+0000 7f28c7e00640 1 --2- 172.21.15.19:0/826766134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28c0073160 0x7f28c015f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.563+0000 7f28c7e00640 1 -- 172.21.15.19:0/826766134 >> 172.21.15.19:0/826766134 conn(0x7f28c006f1f0 msgr2=0x7f28c0070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.563+0000 7f28c7e00640 1 -- 172.21.15.19:0/826766134 shutdown_connections 2024-04-25T10:26:37.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.563+0000 7f28c7e00640 1 -- 172.21.15.19:0/826766134 wait complete. 2024-04-25T10:26:37.593 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:25:24.611615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:25:34.760347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:25:35.692430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:25:39.212157+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:26:37.594 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:26:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.878+0000 7fc64fe00640 1 Processor -- start 2024-04-25T10:26:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.878+0000 7fc64fe00640 1 -- start start 2024-04-25T10:26:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.879+0000 7fc64fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc65006fd20 0x7fc6500c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.879+0000 7fc64fe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc65006ef40 0x7fc65006f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.879+0000 7fc64fe00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc65015af60 con 0x7fc6500c77a0 2024-04-25T10:26:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.879+0000 7fc64fe00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc6500c6dd0 con 0x7fc65006ef40 2024-04-25T10:26:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.880+0000 7fc64fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc6500c61c0 con 0x7fc65006fd20 2024-04-25T10:26:37.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.880+0000 7fc64f400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc65006ef40 0x7fc65006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.880+0000 7fc64ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc65006fd20 0x7fc6500c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.880+0000 7fc64f400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc65006ef40 0x7fc65006f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53818/0 (socket says 172.21.15.19:53818) 2024-04-25T10:26:37.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.880+0000 7fc64f400640 1 -- 172.21.15.19:0/2011912172 learned_addr learned my addr 172.21.15.19:0/2011912172 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:37.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.880+0000 7fc64f400640 1 -- 172.21.15.19:0/2011912172 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc65006fd20 msgr2=0x7fc6500c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:37.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.880+0000 7fc64f400640 1 --2- 172.21.15.19:0/2011912172 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc65006fd20 0x7fc6500c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.880+0000 7fc64f400640 1 -- 172.21.15.19:0/2011912172 >> v1:172.21.15.19:6789/0 conn(0x7fc6500c77a0 legacy=0x7fc650153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.880+0000 7fc64f400640 1 -- 172.21.15.19:0/2011912172 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6500c64a0 con 0x7fc65006ef40 2024-04-25T10:26:37.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.880+0000 7fc64ea00640 1 --2- 172.21.15.19:0/2011912172 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc65006fd20 0x7fc6500c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:37.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.881+0000 7fc64f400640 1 --2- 172.21.15.19:0/2011912172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc65006ef40 0x7fc65006f350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc648009e50 tx=0x7fc64802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b629ef911db93af5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:37.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.882+0000 7fc64d600640 1 -- 172.21.15.19:0/2011912172 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648036070 con 0x7fc65006ef40 2024-04-25T10:26:37.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.882+0000 7fc64d600640 1 -- 172.21.15.19:0/2011912172 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc648031600 con 0x7fc65006ef40 2024-04-25T10:26:37.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.882+0000 7fc64d600640 1 -- 172.21.15.19:0/2011912172 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6480319d0 con 0x7fc65006ef40 2024-04-25T10:26:37.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.882+0000 7fc64fe00640 1 -- 172.21.15.19:0/2011912172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc65006ef40 msgr2=0x7fc65006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.882+0000 7fc64fe00640 1 --2- 172.21.15.19:0/2011912172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc65006ef40 0x7fc65006f350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc648009e50 tx=0x7fc64802a7a0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.882+0000 7fc64fe00640 1 -- 172.21.15.19:0/2011912172 shutdown_connections 2024-04-25T10:26:37.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.882+0000 7fc64fe00640 1 --2- 172.21.15.19:0/2011912172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc65006ef40 0x7fc65006f350 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.882+0000 7fc64fe00640 1 --2- 172.21.15.19:0/2011912172 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc65006fd20 0x7fc6500c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.883+0000 7fc64fe00640 1 -- 172.21.15.19:0/2011912172 >> 172.21.15.19:0/2011912172 conn(0x7fc6500ca120 msgr2=0x7fc6500ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:37.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.883+0000 7fc64fe00640 1 -- 172.21.15.19:0/2011912172 shutdown_connections 2024-04-25T10:26:37.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.883+0000 7fc64fe00640 1 -- 172.21.15.19:0/2011912172 wait complete. 2024-04-25T10:26:37.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.885+0000 7fc64fe00640 1 Processor -- start 2024-04-25T10:26:37.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.885+0000 7fc64fe00640 1 -- start start 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.886+0000 7fc64fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc65006ef40 0x7fc6501593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.886+0000 7fc64fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc65006fd20 0x7fc650159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.886+0000 7fc64fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6500c77a0 0x7fc6501e8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.886+0000 7fc64fe00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc650073010 con 0x7fc65006fd20 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.886+0000 7fc64fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc6500c6a60 con 0x7fc65006ef40 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.886+0000 7fc64fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc650073190 con 0x7fc6500c77a0 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64e000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc65006fd20 0x7fc650159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc65006ef40 0x7fc6501593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc65006ef40 0x7fc6501593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:51872/0 (socket says 172.21.15.19:51872) 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6500c77a0 0x7fc6501e8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64ea00640 1 -- 172.21.15.19:0/1471784666 learned_addr learned my addr 172.21.15.19:0/1471784666 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64e000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc65006fd20 0x7fc650159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53824/0 (socket says 172.21.15.19:53824) 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64f400640 1 -- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc65006ef40 msgr2=0x7fc6501593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64f400640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc65006ef40 0x7fc6501593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64f400640 1 -- 172.21.15.19:0/1471784666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc65006fd20 msgr2=0x7fc650159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64f400640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc65006fd20 0x7fc650159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64f400640 1 -- 172.21.15.19:0/1471784666 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc650153010 con 0x7fc6500c77a0 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.887+0000 7fc64e000640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc65006fd20 0x7fc650159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.888+0000 7fc64f400640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6500c77a0 0x7fc6501e8430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc648030000 tx=0x7fc648004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.888+0000 7fc647400640 1 -- 172.21.15.19:0/1471784666 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648041020 con 0x7fc6500c77a0 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.888+0000 7fc647400640 1 -- 172.21.15.19:0/1471784666 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc648008730 con 0x7fc6500c77a0 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.888+0000 7fc64fe00640 1 -- 172.21.15.19:0/1471784666 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6501532f0 con 0x7fc6500c77a0 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.888+0000 7fc647400640 1 -- 172.21.15.19:0/1471784666 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648036040 con 0x7fc6500c77a0 2024-04-25T10:26:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.888+0000 7fc64fe00640 1 -- 172.21.15.19:0/1471784666 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6500c8360 con 0x7fc6500c77a0 2024-04-25T10:26:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.889+0000 7fc64fe00640 1 -- 172.21.15.19:0/1471784666 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6500c3b00 con 0x7fc6500c77a0 2024-04-25T10:26:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.892+0000 7fc647400640 1 -- 172.21.15.19:0/1471784666 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc648044020 con 0x7fc6500c77a0 2024-04-25T10:26:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.893+0000 7fc647400640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6300744b0 0x7fc6300769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.893+0000 7fc647400640 1 -- 172.21.15.19:0/1471784666 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fc6480b5fe0 con 0x7fc6500c77a0 2024-04-25T10:26:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.893+0000 7fc64ea00640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6300744b0 0x7fc6300769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.893+0000 7fc64ea00640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6300744b0 0x7fc6300769c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6400095e0 tx=0x7fc640009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:37.898+0000 7fc647400640 1 -- 172.21.15.19:0/1471784666 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc64804b030 con 0x7fc6500c77a0 2024-04-25T10:26:38.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.095+0000 7fc64fe00640 1 -- 172.21.15.19:0/1471784666 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc6501534c0 con 0x7fc6500c77a0 2024-04-25T10:26:38.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.097+0000 7fc647400640 1 -- 172.21.15.19:0/1471784666 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fc64807fda0 con 0x7fc6500c77a0 2024-04-25T10:26:38.099 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-04-25T10:26:38.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.098+0000 7fc64fe00640 1 -- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6300744b0 msgr2=0x7fc6300769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.098+0000 7fc64fe00640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6300744b0 0x7fc6300769c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6400095e0 tx=0x7fc640009190 comp rx=0 tx=0).stop 2024-04-25T10:26:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.099+0000 7fc64fe00640 1 -- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6500c77a0 msgr2=0x7fc6501e8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.099+0000 7fc64fe00640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6500c77a0 0x7fc6501e8430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc648030000 tx=0x7fc648004a40 comp rx=0 tx=0).stop 2024-04-25T10:26:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.099+0000 7fc64fe00640 1 -- 172.21.15.19:0/1471784666 shutdown_connections 2024-04-25T10:26:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.099+0000 7fc64fe00640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6300744b0 0x7fc6300769c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.099+0000 7fc64fe00640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6500c77a0 0x7fc6501e8430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.099+0000 7fc64fe00640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc65006fd20 0x7fc650159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.099+0000 7fc64fe00640 1 --2- 172.21.15.19:0/1471784666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc65006ef40 0x7fc6501593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.099+0000 7fc64fe00640 1 -- 172.21.15.19:0/1471784666 >> 172.21.15.19:0/1471784666 conn(0x7fc6500ca120 msgr2=0x7fc6500b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.099+0000 7fc64fe00640 1 -- 172.21.15.19:0/1471784666 shutdown_connections 2024-04-25T10:26:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.099+0000 7fc64fe00640 1 -- 172.21.15.19:0/1471784666 wait complete. 2024-04-25T10:26:38.127 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:26:38.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.409+0000 7f2467200640 1 Processor -- start 2024-04-25T10:26:38.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.409+0000 7f2467200640 1 -- start start 2024-04-25T10:26:38.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.412+0000 7f2467200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24600c38e0 0x7f2460161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:38.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.412+0000 7f2467200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f246006f470 0x7f246016b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:38.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.412+0000 7f2467200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f246006f880 con 0x7f246015a8e0 2024-04-25T10:26:38.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.412+0000 7f2467200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f24600c8020 con 0x7f246006f470 2024-04-25T10:26:38.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.412+0000 7f2467200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f24600c27e0 con 0x7f24600c38e0 2024-04-25T10:26:38.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.412+0000 7f2466800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f246006f470 0x7f246016b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:38.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.412+0000 7f2466800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f246006f470 0x7f246016b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53838/0 (socket says 172.21.15.19:53838) 2024-04-25T10:26:38.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.412+0000 7f2466800640 1 -- 172.21.15.19:0/1386989331 learned_addr learned my addr 172.21.15.19:0/1386989331 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:38.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.412+0000 7f2465e00640 1 --2- 172.21.15.19:0/1386989331 >> v2:172.21.15.112:3300/0 conn(0x7f24600c38e0 0x7f2460161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:38.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.414+0000 7f2464a00640 1 -- 172.21.15.19:0/1386989331 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704238733 0 0) 0x7f246006f880 con 0x7f246015a8e0 2024-04-25T10:26:38.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.414+0000 7f2466800640 1 -- 172.21.15.19:0/1386989331 >> v2:172.21.15.112:3300/0 conn(0x7f24600c38e0 msgr2=0x7f2460161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:38.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.414+0000 7f2466800640 1 --2- 172.21.15.19:0/1386989331 >> v2:172.21.15.112:3300/0 conn(0x7f24600c38e0 0x7f2460161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.414+0000 7f2466800640 1 -- 172.21.15.19:0/1386989331 >> v1:172.21.15.112:6789/0 conn(0x7f246015a8e0 legacy=0x7f246006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.414+0000 7f2466800640 1 -- 172.21.15.19:0/1386989331 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24600c8270 con 0x7f246006f470 2024-04-25T10:26:38.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.414+0000 7f2466800640 1 --2- 172.21.15.19:0/1386989331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f246006f470 0x7f246016b070 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2460074cc0 tx=0x7f245c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdd1fd79d3887d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:38.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.414+0000 7f2464a00640 1 -- 172.21.15.19:0/1386989331 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c036070 con 0x7f246006f470 2024-04-25T10:26:38.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.414+0000 7f2464a00640 1 -- 172.21.15.19:0/1386989331 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f245c031600 con 0x7f246006f470 2024-04-25T10:26:38.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.414+0000 7f2464a00640 1 -- 172.21.15.19:0/1386989331 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c0319d0 con 0x7f246006f470 2024-04-25T10:26:38.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.415+0000 7f2467200640 1 -- 172.21.15.19:0/1386989331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f246006f470 msgr2=0x7f246016b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.415+0000 7f2467200640 1 --2- 172.21.15.19:0/1386989331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f246006f470 0x7f246016b070 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2460074cc0 tx=0x7f245c02a730 comp rx=0 tx=0).stop 2024-04-25T10:26:38.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.415+0000 7f2467200640 1 -- 172.21.15.19:0/1386989331 shutdown_connections 2024-04-25T10:26:38.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.415+0000 7f2467200640 1 --2- 172.21.15.19:0/1386989331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f246006f470 0x7f246016b070 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.415+0000 7f2467200640 1 --2- 172.21.15.19:0/1386989331 >> v2:172.21.15.112:3300/0 conn(0x7f24600c38e0 0x7f2460161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.415+0000 7f2467200640 1 -- 172.21.15.19:0/1386989331 >> 172.21.15.19:0/1386989331 conn(0x7f24600ca120 msgr2=0x7f24600ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:38.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.415+0000 7f2467200640 1 -- 172.21.15.19:0/1386989331 shutdown_connections 2024-04-25T10:26:38.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.416+0000 7f2467200640 1 -- 172.21.15.19:0/1386989331 wait complete. 2024-04-25T10:26:38.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.419+0000 7f2467200640 1 Processor -- start 2024-04-25T10:26:38.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.419+0000 7f2467200640 1 -- start start 2024-04-25T10:26:38.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2467200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f246006f470 0x7f24601faf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:38.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2467200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24600c38e0 0x7f24601599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:38.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2467200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f246015a8e0 0x7f246014db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:38.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2467200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f24600c8550 con 0x7f24600c38e0 2024-04-25T10:26:38.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2467200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2460160ae0 con 0x7f246015a8e0 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2467200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2460073010 con 0x7f246006f470 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2465400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24600c38e0 0x7f24601599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2465400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24600c38e0 0x7f24601599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53840/0 (socket says 172.21.15.19:53840) 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2465400640 1 -- 172.21.15.19:0/3908673530 learned_addr learned my addr 172.21.15.19:0/3908673530 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2465e00640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f246006f470 0x7f24601faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2466800640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f246015a8e0 0x7f246014db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2465400640 1 -- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f246006f470 msgr2=0x7f24601faf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2465400640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f246006f470 0x7f24601faf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2465400640 1 -- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f246015a8e0 msgr2=0x7f246014db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.420+0000 7f2465400640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f246015a8e0 0x7f246014db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.421+0000 7f2465400640 1 -- 172.21.15.19:0/3908673530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24601fa490 con 0x7f24600c38e0 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.421+0000 7f2465e00640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f246006f470 0x7f24601faf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:38.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.421+0000 7f2465400640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24600c38e0 0x7f24601599c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f245400c440 tx=0x7f245400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:38.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.421+0000 7f245a000640 1 -- 172.21.15.19:0/3908673530 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454017070 con 0x7f24600c38e0 2024-04-25T10:26:38.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.421+0000 7f245a000640 1 -- 172.21.15.19:0/3908673530 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2454005480 con 0x7f24600c38e0 2024-04-25T10:26:38.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.421+0000 7f2467200640 1 -- 172.21.15.19:0/3908673530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2460150060 con 0x7f24600c38e0 2024-04-25T10:26:38.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.421+0000 7f245a000640 1 -- 172.21.15.19:0/3908673530 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454003830 con 0x7f24600c38e0 2024-04-25T10:26:38.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.421+0000 7f2467200640 1 -- 172.21.15.19:0/3908673530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24601faa10 con 0x7f24600c38e0 2024-04-25T10:26:38.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.422+0000 7f2467200640 1 -- 172.21.15.19:0/3908673530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f246014fdd0 con 0x7f24600c38e0 2024-04-25T10:26:38.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.425+0000 7f245a000640 1 -- 172.21.15.19:0/3908673530 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f245401a070 con 0x7f24600c38e0 2024-04-25T10:26:38.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.426+0000 7f245a000640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2440074500 0x7f2440076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:38.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.426+0000 7f245a000640 1 -- 172.21.15.19:0/3908673530 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f2454094860 con 0x7f24600c38e0 2024-04-25T10:26:38.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.426+0000 7f2465e00640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2440074500 0x7f2440076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:38.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.426+0000 7f2465e00640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2440074500 0x7f2440076a10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f244c009e90 tx=0x7f244c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:38.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.431+0000 7f245a000640 1 -- 172.21.15.19:0/3908673530 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f245405e610 con 0x7f24600c38e0 2024-04-25T10:26:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.633+0000 7f2467200640 1 -- 172.21.15.19:0/3908673530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2460076520 con 0x7f24600c38e0 2024-04-25T10:26:38.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.635+0000 7f245a000640 1 -- 172.21.15.19:0/3908673530 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f2454062910 con 0x7f24600c38e0 2024-04-25T10:26:38.637 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:26:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.637+0000 7f2467200640 1 -- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2440074500 msgr2=0x7f2440076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.637+0000 7f2467200640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2440074500 0x7f2440076a10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f244c009e90 tx=0x7f244c009190 comp rx=0 tx=0).stop 2024-04-25T10:26:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.637+0000 7f2467200640 1 -- 172.21.15.19:0/3908673530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24600c38e0 msgr2=0x7f24601599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.637+0000 7f2467200640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24600c38e0 0x7f24601599c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f245400c440 tx=0x7f245400c900 comp rx=0 tx=0).stop 2024-04-25T10:26:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.637+0000 7f2467200640 1 -- 172.21.15.19:0/3908673530 shutdown_connections 2024-04-25T10:26:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.637+0000 7f2467200640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f246015a8e0 0x7f246014db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.637+0000 7f2467200640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24600c38e0 0x7f24601599c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.637+0000 7f2467200640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2440074500 0x7f2440076a10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.637+0000 7f2467200640 1 --2- 172.21.15.19:0/3908673530 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f246006f470 0x7f24601faf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.637+0000 7f2467200640 1 -- 172.21.15.19:0/3908673530 >> 172.21.15.19:0/3908673530 conn(0x7f24600ca120 msgr2=0x7f24600c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.638+0000 7f2467200640 1 -- 172.21.15.19:0/3908673530 shutdown_connections 2024-04-25T10:26:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.638+0000 7f2467200640 1 -- 172.21.15.19:0/3908673530 wait complete. 2024-04-25T10:26:38.667 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:26:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.945+0000 7f47f3200640 1 Processor -- start 2024-04-25T10:26:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.945+0000 7f47f3200640 1 -- start start 2024-04-25T10:26:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f3200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f47f40709b0 0x7f47f4070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f3200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f415f990 con 0x7f47f40c9520 2024-04-25T10:26:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f3200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f40749d0 con 0x7f47f41603f0 2024-04-25T10:26:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f3200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f47f40c8100 con 0x7f47f40709b0 2024-04-25T10:26:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f1e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f47f40c9520 0x7f47f4073010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39596/0 (socket says 172.21.15.19:39596) 2024-04-25T10:26:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f1e00640 1 -- 172.21.15.19:0/626057763 learned_addr learned my addr 172.21.15.19:0/626057763 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f2800640 1 --2- 172.21.15.19:0/626057763 >> v2:172.21.15.19:3300/0 conn(0x7f47f40709b0 0x7f47f4070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f0a00640 1 -- 172.21.15.19:0/626057763 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3910729177 0 0) 0x7f47f415f990 con 0x7f47f40c9520 2024-04-25T10:26:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f0a00640 1 -- 172.21.15.19:0/626057763 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d8003520 con 0x7f47f40c9520 2024-04-25T10:26:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f0a00640 1 -- 172.21.15.19:0/626057763 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548432153 0 0) 0x7f47f40749d0 con 0x7f47f41603f0 2024-04-25T10:26:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f2800640 1 -- 172.21.15.19:0/626057763 >> v1:172.21.15.112:6789/0 conn(0x7f47f41603f0 legacy=0x7f47f406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f2800640 1 -- 172.21.15.19:0/626057763 >> v1:172.21.15.19:6789/0 conn(0x7f47f40c9520 legacy=0x7f47f4073010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.947+0000 7f47f2800640 1 -- 172.21.15.19:0/626057763 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f40c8350 con 0x7f47f40709b0 2024-04-25T10:26:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.950+0000 7f47f2800640 1 --2- 172.21.15.19:0/626057763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f40709b0 0x7f47f4070dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009d90 tx=0x7f47ec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1b672203b3dfa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.950+0000 7f47f0a00640 1 -- 172.21.15.19:0/626057763 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec007740 con 0x7f47f40709b0 2024-04-25T10:26:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.950+0000 7f47f0a00640 1 -- 172.21.15.19:0/626057763 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ec0078e0 con 0x7f47f40709b0 2024-04-25T10:26:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.950+0000 7f47f0a00640 1 -- 172.21.15.19:0/626057763 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec007cb0 con 0x7f47f40709b0 2024-04-25T10:26:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.951+0000 7f47f3200640 1 -- 172.21.15.19:0/626057763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f40709b0 msgr2=0x7f47f4070dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.951+0000 7f47f3200640 1 --2- 172.21.15.19:0/626057763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f40709b0 0x7f47f4070dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009d90 tx=0x7f47ec02a660 comp rx=0 tx=0).stop 2024-04-25T10:26:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.951+0000 7f47f3200640 1 -- 172.21.15.19:0/626057763 shutdown_connections 2024-04-25T10:26:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.951+0000 7f47f3200640 1 --2- 172.21.15.19:0/626057763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f40709b0 0x7f47f4070dc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.951+0000 7f47f3200640 1 -- 172.21.15.19:0/626057763 >> 172.21.15.19:0/626057763 conn(0x7f47f406d120 msgr2=0x7f47f40cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.951+0000 7f47f3200640 1 -- 172.21.15.19:0/626057763 shutdown_connections 2024-04-25T10:26:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.951+0000 7f47f3200640 1 -- 172.21.15.19:0/626057763 wait complete. 2024-04-25T10:26:38.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.953+0000 7f47f3200640 1 Processor -- start 2024-04-25T10:26:38.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.953+0000 7f47f3200640 1 -- start start 2024-04-25T10:26:38.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f3200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f40709b0 0x7f47f41f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:38.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f3200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f40c9520 0x7f47f4152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:38.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f3200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f47f41603f0 0x7f47f4152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:38.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f3200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f47f406efb0 con 0x7f47f40709b0 2024-04-25T10:26:38.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f3200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f47f406ed60 con 0x7f47f40c9520 2024-04-25T10:26:38.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f3200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f47f406fbe0 con 0x7f47f41603f0 2024-04-25T10:26:38.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f1e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f40709b0 0x7f47f41f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:38.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f1e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f40709b0 0x7f47f41f2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53850/0 (socket says 172.21.15.19:53850) 2024-04-25T10:26:38.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f1e00640 1 -- 172.21.15.19:0/1983993254 learned_addr learned my addr 172.21.15.19:0/1983993254 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:38.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f2800640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f47f41603f0 0x7f47f4152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:38.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f1400640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f40c9520 0x7f47f4152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:38.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f1e00640 1 -- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f47f41603f0 msgr2=0x7f47f4152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f1e00640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f47f41603f0 0x7f47f4152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f1e00640 1 -- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f40c9520 msgr2=0x7f47f4152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:38.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f1e00640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f40c9520 0x7f47f4152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:38.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f1e00640 1 -- 172.21.15.19:0/1983993254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f41f34d0 con 0x7f47f40709b0 2024-04-25T10:26:38.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f1e00640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f40709b0 0x7f47f41f2f90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47e400c400 tx=0x7f47e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:38.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47ea000640 1 -- 172.21.15.19:0/1983993254 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4017070 con 0x7f47f40709b0 2024-04-25T10:26:38.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47ea000640 1 -- 172.21.15.19:0/1983993254 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e4005d00 con 0x7f47f40709b0 2024-04-25T10:26:38.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47ea000640 1 -- 172.21.15.19:0/1983993254 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4007310 con 0x7f47f40709b0 2024-04-25T10:26:38.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f3200640 1 -- 172.21.15.19:0/1983993254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f415ded0 con 0x7f47f40709b0 2024-04-25T10:26:38.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.955+0000 7f47f3200640 1 -- 172.21.15.19:0/1983993254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f41f2a70 con 0x7f47f40709b0 2024-04-25T10:26:38.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.958+0000 7f47f3200640 1 -- 172.21.15.19:0/1983993254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f4153d20 con 0x7f47f40709b0 2024-04-25T10:26:38.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.959+0000 7f47ea000640 1 -- 172.21.15.19:0/1983993254 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f47e401a070 con 0x7f47f40709b0 2024-04-25T10:26:38.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.960+0000 7f47ea000640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f47d40744e0 0x7f47d40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:38.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.960+0000 7f47ea000640 1 -- 172.21.15.19:0/1983993254 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f47e40947b0 con 0x7f47f40709b0 2024-04-25T10:26:38.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.960+0000 7f47f1400640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f47d40744e0 0x7f47d40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:38.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.961+0000 7f47f1400640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f47d40744e0 0x7f47d40769f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f47f4160070 tx=0x7f47e0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:38.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:38.964+0000 7f47ea000640 1 -- 172.21.15.19:0/1983993254 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f47f4153d20 con 0x7f47f40709b0 2024-04-25T10:26:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.166+0000 7f47f3200640 1 -- 172.21.15.19:0/1983993254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f47f41f2860 con 0x7f47f40709b0 2024-04-25T10:26:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.167+0000 7f47ea000640 1 -- 172.21.15.19:0/1983993254 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f47e405e610 con 0x7f47f40709b0 2024-04-25T10:26:39.169 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-04-25T10:26:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.170+0000 7f47f3200640 1 -- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f47d40744e0 msgr2=0x7f47d40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.170+0000 7f47f3200640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f47d40744e0 0x7f47d40769f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f47f4160070 tx=0x7f47e0009040 comp rx=0 tx=0).stop 2024-04-25T10:26:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.170+0000 7f47f3200640 1 -- 172.21.15.19:0/1983993254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f40709b0 msgr2=0x7f47f41f2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.170+0000 7f47f3200640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f40709b0 0x7f47f41f2f90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47e400c400 tx=0x7f47e400c8c0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.170+0000 7f47f3200640 1 -- 172.21.15.19:0/1983993254 shutdown_connections 2024-04-25T10:26:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.170+0000 7f47f3200640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f47d40744e0 0x7f47d40769f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.170+0000 7f47f3200640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f47f41603f0 0x7f47f4152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.170+0000 7f47f3200640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f40c9520 0x7f47f4152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.170+0000 7f47f3200640 1 --2- 172.21.15.19:0/1983993254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f40709b0 0x7f47f41f2f90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.170+0000 7f47f3200640 1 -- 172.21.15.19:0/1983993254 >> 172.21.15.19:0/1983993254 conn(0x7f47f406d120 msgr2=0x7f47f4070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.171+0000 7f47f3200640 1 -- 172.21.15.19:0/1983993254 shutdown_connections 2024-04-25T10:26:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.171+0000 7f47f3200640 1 -- 172.21.15.19:0/1983993254 wait complete. 2024-04-25T10:26:39.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:26:39.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.490+0000 7fdecb400640 1 Processor -- start 2024-04-25T10:26:39.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.490+0000 7fdecb400640 1 -- start start 2024-04-25T10:26:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.492+0000 7fdecb400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdec415b2c0 0x7fdec40c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.492+0000 7fdecb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdec4073160 0x7fdec415e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.492+0000 7fdecb400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec4158010 con 0x7fdec415e760 2024-04-25T10:26:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.492+0000 7fdecb400640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fdec4074970 con 0x7fdec415b2c0 2024-04-25T10:26:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.492+0000 7fdecb400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdec40c8600 con 0x7fdec4073160 2024-04-25T10:26:39.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.493+0000 7fdec8a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdec415b2c0 0x7fdec40c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.493+0000 7fdec8a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdec415b2c0 0x7fdec40c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53852/0 (socket says 172.21.15.19:53852) 2024-04-25T10:26:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.493+0000 7fdec8a00640 1 -- 172.21.15.19:0/2315710064 learned_addr learned my addr 172.21.15.19:0/2315710064 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.493+0000 7fdec9400640 1 --1- 172.21.15.19:0/2315710064 >> v1:172.21.15.19:6789/0 conn(0x7fdec415e760 0x7fdec40cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39608/0 (socket says 172.21.15.19:39608) 2024-04-25T10:26:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.493+0000 7fdec3e00640 1 --2- 172.21.15.19:0/2315710064 >> v2:172.21.15.112:3300/0 conn(0x7fdec4073160 0x7fdec415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.493+0000 7fdec8a00640 1 -- 172.21.15.19:0/2315710064 >> v2:172.21.15.112:3300/0 conn(0x7fdec4073160 msgr2=0x7fdec415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.493+0000 7fdec8a00640 1 --2- 172.21.15.19:0/2315710064 >> v2:172.21.15.112:3300/0 conn(0x7fdec4073160 0x7fdec415e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.493+0000 7fdec8a00640 1 -- 172.21.15.19:0/2315710064 >> v1:172.21.15.19:6789/0 conn(0x7fdec415e760 legacy=0x7fdec40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.493+0000 7fdec8a00640 1 -- 172.21.15.19:0/2315710064 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec40c88e0 con 0x7fdec415b2c0 2024-04-25T10:26:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.493+0000 7fdec3400640 1 -- 172.21.15.19:0/2315710064 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435701541 0 0) 0x7fdec4158010 con 0x7fdec415e760 2024-04-25T10:26:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.494+0000 7fdec8a00640 1 --2- 172.21.15.19:0/2315710064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdec415b2c0 0x7fdec40c9810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdec40c80b0 tx=0x7fdeb802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b184b4663a1933 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.495+0000 7fdec3400640 1 -- 172.21.15.19:0/2315710064 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8037070 con 0x7fdec415b2c0 2024-04-25T10:26:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.495+0000 7fdec3400640 1 -- 172.21.15.19:0/2315710064 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb802ae50 con 0x7fdec415b2c0 2024-04-25T10:26:39.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.495+0000 7fdec3400640 1 -- 172.21.15.19:0/2315710064 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8032860 con 0x7fdec415b2c0 2024-04-25T10:26:39.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.495+0000 7fdecb400640 1 -- 172.21.15.19:0/2315710064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdec415b2c0 msgr2=0x7fdec40c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:39.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.495+0000 7fdecb400640 1 --2- 172.21.15.19:0/2315710064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdec415b2c0 0x7fdec40c9810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdec40c80b0 tx=0x7fdeb802a300 comp rx=0 tx=0).stop 2024-04-25T10:26:39.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.496+0000 7fdecb400640 1 -- 172.21.15.19:0/2315710064 shutdown_connections 2024-04-25T10:26:39.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.496+0000 7fdecb400640 1 --2- 172.21.15.19:0/2315710064 >> v2:172.21.15.112:3300/0 conn(0x7fdec4073160 0x7fdec415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.496+0000 7fdecb400640 1 --2- 172.21.15.19:0/2315710064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdec415b2c0 0x7fdec40c9810 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.496+0000 7fdecb400640 1 -- 172.21.15.19:0/2315710064 >> 172.21.15.19:0/2315710064 conn(0x7fdec406f1f0 msgr2=0x7fdec406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:39.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.496+0000 7fdecb400640 1 -- 172.21.15.19:0/2315710064 shutdown_connections 2024-04-25T10:26:39.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.496+0000 7fdecb400640 1 -- 172.21.15.19:0/2315710064 wait complete. 2024-04-25T10:26:39.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.498+0000 7fdecb400640 1 Processor -- start 2024-04-25T10:26:39.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.498+0000 7fdecb400640 1 -- start start 2024-04-25T10:26:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.500+0000 7fdecb400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdec4073160 0x7fdec415d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.500+0000 7fdecb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec415e760 0x7fdec4152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.500+0000 7fdecb400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec414eb90 0x7fdec414d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.500+0000 7fdecb400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdec406d4c0 con 0x7fdec4073160 2024-04-25T10:26:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.500+0000 7fdecb400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdec415a580 con 0x7fdec415e760 2024-04-25T10:26:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.500+0000 7fdecb400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdec40ce4f0 con 0x7fdec414eb90 2024-04-25T10:26:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.500+0000 7fdec8a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdec4073160 0x7fdec415d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.500+0000 7fdec3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec415e760 0x7fdec4152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.500+0000 7fdec8a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdec4073160 0x7fdec415d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53860/0 (socket says 172.21.15.19:53860) 2024-04-25T10:26:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.500+0000 7fdec8a00640 1 -- 172.21.15.19:0/1042322180 learned_addr learned my addr 172.21.15.19:0/1042322180 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:39.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.500+0000 7fdec9400640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec414eb90 0x7fdec414d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:39.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdec3e00640 1 -- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec414eb90 msgr2=0x7fdec414d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:39.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdec3e00640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec414eb90 0x7fdec414d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdec3e00640 1 -- 172.21.15.19:0/1042322180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdec4073160 msgr2=0x7fdec415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:39.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdec3e00640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdec4073160 0x7fdec415d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdec3e00640 1 -- 172.21.15.19:0/1042322180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec41f3520 con 0x7fdec415e760 2024-04-25T10:26:39.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdec8a00640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdec4073160 0x7fdec415d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:39.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdec3e00640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec415e760 0x7fdec4152ab0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000e870 tx=0x7fdeb000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:39.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdec0c00640 1 -- 172.21.15.19:0/1042322180 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0017070 con 0x7fdec415e760 2024-04-25T10:26:39.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdec0c00640 1 -- 172.21.15.19:0/1042322180 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb000ee60 con 0x7fdec415e760 2024-04-25T10:26:39.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdecb400640 1 -- 172.21.15.19:0/1042322180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec415d940 con 0x7fdec415e760 2024-04-25T10:26:39.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdec0c00640 1 -- 172.21.15.19:0/1042322180 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000cb60 con 0x7fdec415e760 2024-04-25T10:26:39.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.501+0000 7fdecb400640 1 -- 172.21.15.19:0/1042322180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec415bfc0 con 0x7fdec415e760 2024-04-25T10:26:39.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.503+0000 7fdecb400640 1 -- 172.21.15.19:0/1042322180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec4076520 con 0x7fdec415e760 2024-04-25T10:26:39.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.504+0000 7fdec0c00640 1 -- 172.21.15.19:0/1042322180 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdeb001a070 con 0x7fdec415e760 2024-04-25T10:26:39.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.505+0000 7fdec0c00640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fdea40744b0 0x7fdea40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:39.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.505+0000 7fdec0c00640 1 -- 172.21.15.19:0/1042322180 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fdeb0095730 con 0x7fdec415e760 2024-04-25T10:26:39.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.505+0000 7fdec8a00640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fdea40744b0 0x7fdea40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:39.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.506+0000 7fdec8a00640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fdea40744b0 0x7fdea40769c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80090b0 tx=0x7fdeb802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:39.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.510+0000 7fdec0c00640 1 -- 172.21.15.19:0/1042322180 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdeb005f500 con 0x7fdec415e760 2024-04-25T10:26:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.716+0000 7fdecb400640 1 -- 172.21.15.19:0/1042322180 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdec415d020 con 0x7fdec415e760 2024-04-25T10:26:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.717+0000 7fdec0c00640 1 -- 172.21.15.19:0/1042322180 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fdeb0063800 con 0x7fdec415e760 2024-04-25T10:26:39.719 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:26:39.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.720+0000 7fdecb400640 1 -- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fdea40744b0 msgr2=0x7fdea40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:39.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.720+0000 7fdecb400640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fdea40744b0 0x7fdea40769c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80090b0 tx=0x7fdeb802e000 comp rx=0 tx=0).stop 2024-04-25T10:26:39.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.720+0000 7fdecb400640 1 -- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec415e760 msgr2=0x7fdec4152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:39.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.720+0000 7fdecb400640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec415e760 0x7fdec4152ab0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000e870 tx=0x7fdeb000ed30 comp rx=0 tx=0).stop 2024-04-25T10:26:39.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.720+0000 7fdecb400640 1 -- 172.21.15.19:0/1042322180 shutdown_connections 2024-04-25T10:26:39.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.720+0000 7fdecb400640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fdea40744b0 0x7fdea40769c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.720+0000 7fdecb400640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdec414eb90 0x7fdec414d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.720+0000 7fdecb400640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec415e760 0x7fdec4152ab0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.720+0000 7fdecb400640 1 --2- 172.21.15.19:0/1042322180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdec4073160 0x7fdec415d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:39.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.720+0000 7fdecb400640 1 -- 172.21.15.19:0/1042322180 >> 172.21.15.19:0/1042322180 conn(0x7fdec406f1f0 msgr2=0x7fdec40c8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:39.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.721+0000 7fdecb400640 1 -- 172.21.15.19:0/1042322180 shutdown_connections 2024-04-25T10:26:39.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:39.721+0000 7fdecb400640 1 -- 172.21.15.19:0/1042322180 wait complete. 2024-04-25T10:26:39.749 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-04-25T10:26:39.749 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:26:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.034+0000 7f6272000640 1 Processor -- start 2024-04-25T10:26:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.034+0000 7f6272000640 1 -- start start 2024-04-25T10:26:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.036+0000 7f6272000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 0x7f626c164960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.036+0000 7f6272000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626c0c8340 con 0x7f626c1532c0 2024-04-25T10:26:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.036+0000 7f6272000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626c15c680 con 0x7f626c0c2640 2024-04-25T10:26:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.036+0000 7f6272000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f626c0c9dc0 con 0x7f626c0c2a50 2024-04-25T10:26:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.036+0000 7f6270c00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f626c1532c0 0x7f626c072ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39624/0 (socket says 172.21.15.19:39624) 2024-04-25T10:26:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.036+0000 7f6270c00640 1 -- 172.21.15.19:0/4134019891 learned_addr learned my addr 172.21.15.19:0/4134019891 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.036+0000 7f6271600640 1 --2- 172.21.15.19:0/4134019891 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 0x7f626c164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.037+0000 7f626b400640 1 -- 172.21.15.19:0/4134019891 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2663768744 0 0) 0x7f626c15c680 con 0x7f626c0c2640 2024-04-25T10:26:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.037+0000 7f626b400640 1 -- 172.21.15.19:0/4134019891 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6250005730 con 0x7f626c0c2640 2024-04-25T10:26:40.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.037+0000 7f6271600640 1 -- 172.21.15.19:0/4134019891 >> v1:172.21.15.112:6789/0 conn(0x7f626c0c2640 legacy=0x7f626c0c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.037+0000 7f6271600640 1 -- 172.21.15.19:0/4134019891 >> v1:172.21.15.19:6789/0 conn(0x7f626c1532c0 legacy=0x7f626c072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.037+0000 7f626b400640 1 -- 172.21.15.19:0/4134019891 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755587089 0 0) 0x7f626c0c8340 con 0x7f626c1532c0 2024-04-25T10:26:40.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.037+0000 7f6271600640 1 -- 172.21.15.19:0/4134019891 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626c15c960 con 0x7f626c0c2a50 2024-04-25T10:26:40.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.038+0000 7f6271600640 1 --2- 172.21.15.19:0/4134019891 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 0x7f626c164960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62640097d0 tx=0x7f626402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8841264a396f46b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:40.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.038+0000 7f626b400640 1 -- 172.21.15.19:0/4134019891 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6264037070 con 0x7f626c0c2a50 2024-04-25T10:26:40.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.038+0000 7f626b400640 1 -- 172.21.15.19:0/4134019891 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6264032440 con 0x7f626c0c2a50 2024-04-25T10:26:40.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.038+0000 7f626b400640 1 -- 172.21.15.19:0/4134019891 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62640327f0 con 0x7f626c0c2a50 2024-04-25T10:26:40.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.039+0000 7f6272000640 1 -- 172.21.15.19:0/4134019891 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 msgr2=0x7f626c164960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.039+0000 7f6272000640 1 --2- 172.21.15.19:0/4134019891 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 0x7f626c164960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62640097d0 tx=0x7f626402a200 comp rx=0 tx=0).stop 2024-04-25T10:26:40.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.039+0000 7f6272000640 1 -- 172.21.15.19:0/4134019891 shutdown_connections 2024-04-25T10:26:40.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.039+0000 7f6272000640 1 --2- 172.21.15.19:0/4134019891 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 0x7f626c164960 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.039+0000 7f6272000640 1 -- 172.21.15.19:0/4134019891 >> 172.21.15.19:0/4134019891 conn(0x7f626c0cdbc0 msgr2=0x7f626c0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:40.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.039+0000 7f6272000640 1 -- 172.21.15.19:0/4134019891 shutdown_connections 2024-04-25T10:26:40.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.039+0000 7f6272000640 1 -- 172.21.15.19:0/4134019891 wait complete. 2024-04-25T10:26:40.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.042+0000 7f6272000640 1 Processor -- start 2024-04-25T10:26:40.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.042+0000 7f6272000640 1 -- start start 2024-04-25T10:26:40.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.043+0000 7f6272000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f626c0c2640 0x7f626c0c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:40.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.043+0000 7f6272000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 0x7f626c15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:40.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.043+0000 7f6272000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f626c1532c0 0x7f626c1e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:40.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.043+0000 7f6272000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f626c15d440 con 0x7f626c0c2640 2024-04-25T10:26:40.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.043+0000 7f6272000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f626c15cf20 con 0x7f626c1532c0 2024-04-25T10:26:40.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.043+0000 7f6272000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f626c0c8620 con 0x7f626c0c2a50 2024-04-25T10:26:40.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f6270c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f626c0c2640 0x7f626c0c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:40.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f6270c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f626c0c2640 0x7f626c0c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53864/0 (socket says 172.21.15.19:53864) 2024-04-25T10:26:40.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f6270c00640 1 -- 172.21.15.19:0/3553846135 learned_addr learned my addr 172.21.15.19:0/3553846135 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:40.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f626be00640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 0x7f626c15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:40.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f6271600640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f626c1532c0 0x7f626c1e2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:40.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f6270c00640 1 -- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 msgr2=0x7f626c15bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f6270c00640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 0x7f626c15bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f6270c00640 1 -- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f626c1532c0 msgr2=0x7f626c1e2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f6270c00640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f626c1532c0 0x7f626c1e2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f6270c00640 1 -- 172.21.15.19:0/3553846135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626c0cc580 con 0x7f626c0c2640 2024-04-25T10:26:40.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f626be00640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 0x7f626c15bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:40.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.044+0000 7f6271600640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f626c1532c0 0x7f626c1e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:40.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.045+0000 7f6270c00640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f626c0c2640 0x7f626c0c5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c7c0 tx=0x7f625c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:40.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.045+0000 7f6268c00640 1 -- 172.21.15.19:0/3553846135 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c018070 con 0x7f626c0c2640 2024-04-25T10:26:40.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.045+0000 7f6268c00640 1 -- 172.21.15.19:0/3553846135 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625c00a640 con 0x7f626c0c2640 2024-04-25T10:26:40.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.045+0000 7f6272000640 1 -- 172.21.15.19:0/3553846135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f626c1e4450 con 0x7f626c0c2640 2024-04-25T10:26:40.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.045+0000 7f6268c00640 1 -- 172.21.15.19:0/3553846135 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c00aa30 con 0x7f626c0c2640 2024-04-25T10:26:40.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.045+0000 7f6272000640 1 -- 172.21.15.19:0/3553846135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f626c0ccb00 con 0x7f626c0c2640 2024-04-25T10:26:40.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.046+0000 7f6272000640 1 -- 172.21.15.19:0/3553846135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f626c050740 con 0x7f626c0c2640 2024-04-25T10:26:40.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.048+0000 7f6268c00640 1 -- 172.21.15.19:0/3553846135 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f625c01b070 con 0x7f626c0c2640 2024-04-25T10:26:40.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.049+0000 7f6268c00640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f624c0744b0 0x7f624c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:40.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.049+0000 7f6268c00640 1 -- 172.21.15.19:0/3553846135 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f625c094bd0 con 0x7f626c0c2640 2024-04-25T10:26:40.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.050+0000 7f626be00640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f624c0744b0 0x7f624c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:40.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.050+0000 7f626be00640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f624c0744b0 0x7f624c0769c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6258007fd0 tx=0x7f6258009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:40.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.059+0000 7f6268c00640 1 -- 172.21.15.19:0/3553846135 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f625c05e990 con 0x7f626c0c2640 2024-04-25T10:26:40.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.312+0000 7f6272000640 1 -- 172.21.15.19:0/3553846135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f626c0c8f80 con 0x7f626c0c2640 2024-04-25T10:26:40.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.313+0000 7f6268c00640 1 -- 172.21.15.19:0/3553846135 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f625c063e20 con 0x7f626c0c2640 2024-04-25T10:26:40.315 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:40.315 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:26:40.316 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:26:40.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.316+0000 7f6272000640 1 -- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f624c0744b0 msgr2=0x7f624c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.316+0000 7f6272000640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f624c0744b0 0x7f624c0769c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6258007fd0 tx=0x7f6258009040 comp rx=0 tx=0).stop 2024-04-25T10:26:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.316+0000 7f6272000640 1 -- 172.21.15.19:0/3553846135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f626c0c2640 msgr2=0x7f626c0c5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.316+0000 7f6272000640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f626c0c2640 0x7f626c0c5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c7c0 tx=0x7f625c00cc80 comp rx=0 tx=0).stop 2024-04-25T10:26:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.317+0000 7f6272000640 1 -- 172.21.15.19:0/3553846135 shutdown_connections 2024-04-25T10:26:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.317+0000 7f6272000640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f626c1532c0 0x7f626c1e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.317+0000 7f6272000640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f624c0744b0 0x7f624c0769c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.317+0000 7f6272000640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f626c0c2a50 0x7f626c15bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.317+0000 7f6272000640 1 --2- 172.21.15.19:0/3553846135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f626c0c2640 0x7f626c0c5150 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.317+0000 7f6272000640 1 -- 172.21.15.19:0/3553846135 >> 172.21.15.19:0/3553846135 conn(0x7f626c0cdbc0 msgr2=0x7f626c151c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.317+0000 7f6272000640 1 -- 172.21.15.19:0/3553846135 shutdown_connections 2024-04-25T10:26:40.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.317+0000 7f6272000640 1 -- 172.21.15.19:0/3553846135 wait complete. 2024-04-25T10:26:40.349 INFO:tasks.mds_thrash:Ready to start thrashing 2024-04-25T10:26:40.349 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-04-25T10:26:40.350 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:26:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.622+0000 7f2fea200640 1 Processor -- start 2024-04-25T10:26:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.622+0000 7f2fea200640 1 -- start start 2024-04-25T10:26:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.624+0000 7f2fea200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4161520 0x7f2fe415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.624+0000 7f2fea200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2fe40c2640 0x7f2fe40c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.624+0000 7f2fea200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe40c7f90 con 0x7f2fe4074880 2024-04-25T10:26:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.624+0000 7f2fea200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe4160780 con 0x7f2fe40c2640 2024-04-25T10:26:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.624+0000 7f2fea200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe40c8230 con 0x7f2fe4161520 2024-04-25T10:26:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.625+0000 7f2fe9800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2fe40c2640 0x7f2fe40c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.625+0000 7f2fe8e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4161520 0x7f2fe415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.625+0000 7f2fe9800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2fe40c2640 0x7f2fe40c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53872/0 (socket says 172.21.15.19:53872) 2024-04-25T10:26:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.625+0000 7f2fe9800640 1 -- 172.21.15.19:0/3048474706 learned_addr learned my addr 172.21.15.19:0/3048474706 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.625+0000 7f2fe3e00640 1 --1- 172.21.15.19:0/3048474706 >> v1:172.21.15.112:6789/0 conn(0x7f2fe4074880 0x7f2fe4072ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:54974/0 (socket says 172.21.15.19:54974) 2024-04-25T10:26:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.625+0000 7f2fe3400640 1 -- 172.21.15.19:0/3048474706 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729540975 0 0) 0x7f2fe40c7f90 con 0x7f2fe4074880 2024-04-25T10:26:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.625+0000 7f2fe9800640 1 -- 172.21.15.19:0/3048474706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4161520 msgr2=0x7f2fe415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.625+0000 7f2fe9800640 1 --2- 172.21.15.19:0/3048474706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4161520 0x7f2fe415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.625+0000 7f2fe9800640 1 -- 172.21.15.19:0/3048474706 >> v1:172.21.15.112:6789/0 conn(0x7f2fe4074880 legacy=0x7f2fe4072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.625+0000 7f2fe9800640 1 -- 172.21.15.19:0/3048474706 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe4160a40 con 0x7f2fe40c2640 2024-04-25T10:26:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.625+0000 7f2fe8e00640 1 --2- 172.21.15.19:0/3048474706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4161520 0x7f2fe415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.626+0000 7f2fe9800640 1 --2- 172.21.15.19:0/3048474706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fe40c2640 0x7f2fe40c3e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009870 tx=0x7f2fdc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894363fba9a6f18a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.627+0000 7f2fe3400640 1 -- 172.21.15.19:0/3048474706 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc037070 con 0x7f2fe40c2640 2024-04-25T10:26:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.627+0000 7f2fe3400640 1 -- 172.21.15.19:0/3048474706 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fdc032440 con 0x7f2fe40c2640 2024-04-25T10:26:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.627+0000 7f2fe3400640 1 -- 172.21.15.19:0/3048474706 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc032810 con 0x7f2fe40c2640 2024-04-25T10:26:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.627+0000 7f2fea200640 1 -- 172.21.15.19:0/3048474706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fe40c2640 msgr2=0x7f2fe40c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.627+0000 7f2fea200640 1 --2- 172.21.15.19:0/3048474706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fe40c2640 0x7f2fe40c3e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009870 tx=0x7f2fdc02a1c0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.628+0000 7f2fea200640 1 -- 172.21.15.19:0/3048474706 shutdown_connections 2024-04-25T10:26:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.628+0000 7f2fea200640 1 --2- 172.21.15.19:0/3048474706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fe40c2640 0x7f2fe40c3e20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.628+0000 7f2fea200640 1 --2- 172.21.15.19:0/3048474706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4161520 0x7f2fe415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.628+0000 7f2fea200640 1 -- 172.21.15.19:0/3048474706 >> 172.21.15.19:0/3048474706 conn(0x7f2fe40cdbc0 msgr2=0x7f2fe40ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.628+0000 7f2fea200640 1 -- 172.21.15.19:0/3048474706 shutdown_connections 2024-04-25T10:26:40.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.628+0000 7f2fea200640 1 -- 172.21.15.19:0/3048474706 wait complete. 2024-04-25T10:26:40.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.630+0000 7f2fea200640 1 Processor -- start 2024-04-25T10:26:40.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.630+0000 7f2fea200640 1 -- start start 2024-04-25T10:26:40.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.632+0000 7f2fea200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fe4074880 0x7f2fe41f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:40.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.632+0000 7f2fea200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fe40c2640 0x7f2fe40cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:40.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.632+0000 7f2fea200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4153320 0x7f2fe4149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:40.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.632+0000 7f2fea200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40cae30 con 0x7f2fe40c2640 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.632+0000 7f2fea200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4161000 con 0x7f2fe4074880 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.632+0000 7f2fea200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe40cafb0 con 0x7f2fe4153320 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.632+0000 7f2fe3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fe40c2640 0x7f2fe40cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.632+0000 7f2fe3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fe40c2640 0x7f2fe40cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53876/0 (socket says 172.21.15.19:53876) 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.632+0000 7f2fe3e00640 1 -- 172.21.15.19:0/828277186 learned_addr learned my addr 172.21.15.19:0/828277186 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.632+0000 7f2fe9800640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4153320 0x7f2fe4149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.632+0000 7f2fe8e00640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fe4074880 0x7f2fe41f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fe3e00640 1 -- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4153320 msgr2=0x7f2fe4149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fe3e00640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4153320 0x7f2fe4149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fe3e00640 1 -- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fe4074880 msgr2=0x7f2fe41f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fe3e00640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fe4074880 0x7f2fe41f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fe3e00640 1 -- 172.21.15.19:0/828277186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe415e700 con 0x7f2fe40c2640 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fe9800640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4153320 0x7f2fe4149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:40.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fe3e00640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fe40c2640 0x7f2fe40cc680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00c410 tx=0x7f2fcc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:40.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fe0c00640 1 -- 172.21.15.19:0/828277186 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0074e0 con 0x7f2fe40c2640 2024-04-25T10:26:40.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fe0c00640 1 -- 172.21.15.19:0/828277186 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fcc007680 con 0x7f2fe40c2640 2024-04-25T10:26:40.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fe0c00640 1 -- 172.21.15.19:0/828277186 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc004a00 con 0x7f2fe40c2640 2024-04-25T10:26:40.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fea200640 1 -- 172.21.15.19:0/828277186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe40c3f30 con 0x7f2fe40c2640 2024-04-25T10:26:40.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.633+0000 7f2fea200640 1 -- 172.21.15.19:0/828277186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe40c44f0 con 0x7f2fe40c2640 2024-04-25T10:26:40.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.635+0000 7f2fea200640 1 -- 172.21.15.19:0/828277186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe4050740 con 0x7f2fe40c2640 2024-04-25T10:26:40.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.636+0000 7f2fe0c00640 1 -- 172.21.15.19:0/828277186 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2fcc01a020 con 0x7f2fe40c2640 2024-04-25T10:26:40.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.637+0000 7f2fe0c00640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2fc0074500 0x7f2fc0076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:40.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.637+0000 7f2fe0c00640 1 -- 172.21.15.19:0/828277186 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f2fcc094ce0 con 0x7f2fe40c2640 2024-04-25T10:26:40.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.638+0000 7f2fe8e00640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2fc0074500 0x7f2fc0076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:40.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.638+0000 7f2fe8e00640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2fc0074500 0x7f2fc0076a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009bd0 tx=0x7f2fd400b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:40.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.642+0000 7f2fe0c00640 1 -- 172.21.15.19:0/828277186 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2fcc05ea90 con 0x7f2fe40c2640 2024-04-25T10:26:40.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.843+0000 7f2fea200640 1 -- 172.21.15.19:0/828277186 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fe40cd260 con 0x7f2fc0074500 2024-04-25T10:26:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.853+0000 7f2fe0c00640 1 -- 172.21.15.19:0/828277186 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332581 (secure 0 0 0) 0x7f2fd4017440 con 0x7f2fc0074500 2024-04-25T10:26:40.857 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:26:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 -- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2fc0074500 msgr2=0x7f2fc0076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2fc0074500 0x7f2fc0076a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009bd0 tx=0x7f2fd400b040 comp rx=0 tx=0).stop 2024-04-25T10:26:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 -- 172.21.15.19:0/828277186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fe40c2640 msgr2=0x7f2fe40cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fe40c2640 0x7f2fe40cc680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00c410 tx=0x7f2fcc00c8d0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 -- 172.21.15.19:0/828277186 shutdown_connections 2024-04-25T10:26:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2fc0074500 0x7f2fc0076a10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2fe4153320 0x7f2fe4149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fe40c2640 0x7f2fe40cc680 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 --2- 172.21.15.19:0/828277186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fe4074880 0x7f2fe41f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 -- 172.21.15.19:0/828277186 >> 172.21.15.19:0/828277186 conn(0x7f2fe40cdbc0 msgr2=0x7f2fe4158ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 -- 172.21.15.19:0/828277186 shutdown_connections 2024-04-25T10:26:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:40.861+0000 7f2fea200640 1 -- 172.21.15.19:0/828277186 wait complete. 2024-04-25T10:26:40.893 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-04-25T10:26:40.594993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":232,"num_write_kb":1673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219632,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755088,"statfs":{"total":773094113280,"available":772869210112,"internally_reserved":0,"allocated":3579904,"data_stored":2107500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":258,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003316"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.379764+0000","last_change":"2024-04-25T10:25:36.182605+0000","last_active":"2024-04-25T10:26:19.379764+0000","last_peered":"2024-04-25T10:26:19.379764+0000","last_clean":"2024-04-25T10:26:19.379764+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:26:19.379764+0000","last_undegraded":"2024-04-25T10:26:19.379764+0000","last_fullsized":"2024-04-25T10:26:19.379764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696210+0000","last_change":"2024-04-25T10:25:37.199467+0000","last_active":"2024-04-25T10:26:18.696210+0000","last_peered":"2024-04-25T10:26:18.696210+0000","last_clean":"2024-04-25T10:26:18.696210+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:26:18.696210+0000","last_undegraded":"2024-04-25T10:26:18.696210+0000","last_fullsized":"2024-04-25T10:26:18.696210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695264+0000","last_change":"2024-04-25T10:25:41.234657+0000","last_active":"2024-04-25T10:26:18.695264+0000","last_peered":"2024-04-25T10:26:18.695264+0000","last_clean":"2024-04-25T10:26:18.695264+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:26:18.695264+0000","last_undegraded":"2024-04-25T10:26:18.695264+0000","last_fullsized":"2024-04-25T10:26:18.695264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:56.869031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696414+0000","last_change":"2024-04-25T10:25:36.166548+0000","last_active":"2024-04-25T10:26:18.696414+0000","last_peered":"2024-04-25T10:26:18.696414+0000","last_clean":"2024-04-25T10:26:18.696414+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:26:18.696414+0000","last_undegraded":"2024-04-25T10:26:18.696414+0000","last_fullsized":"2024-04-25T10:26:18.696414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696349+0000","last_change":"2024-04-25T10:25:37.179746+0000","last_active":"2024-04-25T10:26:18.696349+0000","last_peered":"2024-04-25T10:26:18.696349+0000","last_clean":"2024-04-25T10:26:18.696349+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:26:18.696349+0000","last_undegraded":"2024-04-25T10:26:18.696349+0000","last_fullsized":"2024-04-25T10:26:18.696349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.422898+0000","last_change":"2024-04-25T10:25:41.232828+0000","last_active":"2024-04-25T10:26:18.422898+0000","last_peered":"2024-04-25T10:26:18.422898+0000","last_clean":"2024-04-25T10:26:18.422898+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:26:18.422898+0000","last_undegraded":"2024-04-25T10:26:18.422898+0000","last_fullsized":"2024-04-25T10:26:18.422898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:01.782881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.383000+0000","last_change":"2024-04-25T10:25:36.190035+0000","last_active":"2024-04-25T10:26:19.383000+0000","last_peered":"2024-04-25T10:26:19.383000+0000","last_clean":"2024-04-25T10:26:19.383000+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:26:19.383000+0000","last_undegraded":"2024-04-25T10:26:19.383000+0000","last_fullsized":"2024-04-25T10:26:19.383000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.483844+0000","last_change":"2024-04-25T10:25:37.191742+0000","last_active":"2024-04-25T10:26:18.483844+0000","last_peered":"2024-04-25T10:26:18.483844+0000","last_clean":"2024-04-25T10:26:18.483844+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:26:18.483844+0000","last_undegraded":"2024-04-25T10:26:18.483844+0000","last_fullsized":"2024-04-25T10:26:18.483844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424882+0000","last_change":"2024-04-25T10:25:41.242444+0000","last_active":"2024-04-25T10:26:18.424882+0000","last_peered":"2024-04-25T10:26:18.424882+0000","last_clean":"2024-04-25T10:26:18.424882+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:26:18.424882+0000","last_undegraded":"2024-04-25T10:26:18.424882+0000","last_fullsized":"2024-04-25T10:26:18.424882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.712056+0000","last_change":"2024-04-25T10:25:36.190527+0000","last_active":"2024-04-25T10:26:18.712056+0000","last_peered":"2024-04-25T10:26:18.712056+0000","last_clean":"2024-04-25T10:26:18.712056+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:26:18.712056+0000","last_undegraded":"2024-04-25T10:26:18.712056+0000","last_fullsized":"2024-04-25T10:26:18.712056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416286+0000","last_change":"2024-04-25T10:25:37.204468+0000","last_active":"2024-04-25T10:26:18.416286+0000","last_peered":"2024-04-25T10:26:18.416286+0000","last_clean":"2024-04-25T10:26:18.416286+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:26:18.416286+0000","last_undegraded":"2024-04-25T10:26:18.416286+0000","last_fullsized":"2024-04-25T10:26:18.416286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423623+0000","last_change":"2024-04-25T10:25:41.236518+0000","last_active":"2024-04-25T10:26:18.423623+0000","last_peered":"2024-04-25T10:26:18.423623+0000","last_clean":"2024-04-25T10:26:18.423623+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:26:18.423623+0000","last_undegraded":"2024-04-25T10:26:18.423623+0000","last_fullsized":"2024-04-25T10:26:18.423623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.413629+0000","last_change":"2024-04-25T10:25:37.194114+0000","last_active":"2024-04-25T10:26:18.413629+0000","last_peered":"2024-04-25T10:26:18.413629+0000","last_clean":"2024-04-25T10:26:18.413629+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:26:18.413629+0000","last_undegraded":"2024-04-25T10:26:18.413629+0000","last_fullsized":"2024-04-25T10:26:18.413629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:40.192156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415768+0000","last_change":"2024-04-25T10:25:36.188266+0000","last_active":"2024-04-25T10:26:18.415768+0000","last_peered":"2024-04-25T10:26:18.415768+0000","last_clean":"2024-04-25T10:26:18.415768+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:26:18.415768+0000","last_undegraded":"2024-04-25T10:26:18.415768+0000","last_fullsized":"2024-04-25T10:26:18.415768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.845953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415983+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:26:18.415983+0000","last_peered":"2024-04-25T10:26:18.415983+0000","last_clean":"2024-04-25T10:26:18.415983+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:26:18.415983+0000","last_undegraded":"2024-04-25T10:26:18.415983+0000","last_fullsized":"2024-04-25T10:26:18.415983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:13.684019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697433+0000","last_change":"2024-04-25T10:25:37.166002+0000","last_active":"2024-04-25T10:26:18.697433+0000","last_peered":"2024-04-25T10:26:18.697433+0000","last_clean":"2024-04-25T10:26:18.697433+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:26:18.697433+0000","last_undegraded":"2024-04-25T10:26:18.697433+0000","last_fullsized":"2024-04-25T10:26:18.697433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406603+0000","last_change":"2024-04-25T10:25:36.168204+0000","last_active":"2024-04-25T10:26:18.406603+0000","last_peered":"2024-04-25T10:26:18.406603+0000","last_clean":"2024-04-25T10:26:18.406603+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:26:18.406603+0000","last_undegraded":"2024-04-25T10:26:18.406603+0000","last_fullsized":"2024-04-25T10:26:18.406603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.907635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.703010+0000","last_change":"2024-04-25T10:25:41.257264+0000","last_active":"2024-04-25T10:26:18.703010+0000","last_peered":"2024-04-25T10:26:18.703010+0000","last_clean":"2024-04-25T10:26:18.703010+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:26:18.703010+0000","last_undegraded":"2024-04-25T10:26:18.703010+0000","last_fullsized":"2024-04-25T10:26:18.703010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695190+0000","last_change":"2024-04-25T10:25:37.158884+0000","last_active":"2024-04-25T10:26:18.695190+0000","last_peered":"2024-04-25T10:26:18.695190+0000","last_clean":"2024-04-25T10:26:18.695190+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:26:18.695190+0000","last_undegraded":"2024-04-25T10:26:18.695190+0000","last_fullsized":"2024-04-25T10:26:18.695190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696653+0000","last_change":"2024-04-25T10:25:36.173499+0000","last_active":"2024-04-25T10:26:18.696653+0000","last_peered":"2024-04-25T10:26:18.696653+0000","last_clean":"2024-04-25T10:26:18.696653+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:26:18.696653+0000","last_undegraded":"2024-04-25T10:26:18.696653+0000","last_fullsized":"2024-04-25T10:26:18.696653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697166+0000","last_change":"2024-04-25T10:25:41.239990+0000","last_active":"2024-04-25T10:26:18.697166+0000","last_peered":"2024-04-25T10:26:18.697166+0000","last_clean":"2024-04-25T10:26:18.697166+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:26:18.697166+0000","last_undegraded":"2024-04-25T10:26:18.697166+0000","last_fullsized":"2024-04-25T10:26:18.697166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:15.055786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.412739+0000","last_change":"2024-04-25T10:25:37.193560+0000","last_active":"2024-04-25T10:26:18.412739+0000","last_peered":"2024-04-25T10:26:18.412739+0000","last_clean":"2024-04-25T10:26:18.412739+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:26:18.412739+0000","last_undegraded":"2024-04-25T10:26:18.412739+0000","last_fullsized":"2024-04-25T10:26:18.412739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.702410+0000","last_change":"2024-04-25T10:25:36.174077+0000","last_active":"2024-04-25T10:26:18.702410+0000","last_peered":"2024-04-25T10:26:18.702410+0000","last_clean":"2024-04-25T10:26:18.702410+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:26:18.702410+0000","last_undegraded":"2024-04-25T10:26:18.702410+0000","last_fullsized":"2024-04-25T10:26:18.702410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423418+0000","last_change":"2024-04-25T10:25:41.262158+0000","last_active":"2024-04-25T10:26:18.423418+0000","last_peered":"2024-04-25T10:26:18.423418+0000","last_clean":"2024-04-25T10:26:18.423418+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:26:18.423418+0000","last_undegraded":"2024-04-25T10:26:18.423418+0000","last_fullsized":"2024-04-25T10:26:18.423418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696683+0000","last_change":"2024-04-25T10:25:37.159876+0000","last_active":"2024-04-25T10:26:18.696683+0000","last_peered":"2024-04-25T10:26:18.696683+0000","last_clean":"2024-04-25T10:26:18.696683+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:26:18.696683+0000","last_undegraded":"2024-04-25T10:26:18.696683+0000","last_fullsized":"2024-04-25T10:26:18.696683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.417634+0000","last_change":"2024-04-25T10:25:36.194275+0000","last_active":"2024-04-25T10:26:18.417634+0000","last_peered":"2024-04-25T10:26:18.417634+0000","last_clean":"2024-04-25T10:26:18.417634+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:26:18.417634+0000","last_undegraded":"2024-04-25T10:26:18.417634+0000","last_fullsized":"2024-04-25T10:26:18.417634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423327+0000","last_change":"2024-04-25T10:25:41.261185+0000","last_active":"2024-04-25T10:26:18.423327+0000","last_peered":"2024-04-25T10:26:18.423327+0000","last_clean":"2024-04-25T10:26:18.423327+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:26:18.423327+0000","last_undegraded":"2024-04-25T10:26:18.423327+0000","last_fullsized":"2024-04-25T10:26:18.423327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696908+0000","last_change":"2024-04-25T10:25:37.165436+0000","last_active":"2024-04-25T10:26:18.696908+0000","last_peered":"2024-04-25T10:26:18.696908+0000","last_clean":"2024-04-25T10:26:18.696908+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:26:18.696908+0000","last_undegraded":"2024-04-25T10:26:18.696908+0000","last_fullsized":"2024-04-25T10:26:18.696908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.377939+0000","last_change":"2024-04-25T10:25:36.181966+0000","last_active":"2024-04-25T10:26:19.377939+0000","last_peered":"2024-04-25T10:26:19.377939+0000","last_clean":"2024-04-25T10:26:19.377939+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:26:19.377939+0000","last_undegraded":"2024-04-25T10:26:19.377939+0000","last_fullsized":"2024-04-25T10:26:19.377939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.694989+0000","last_change":"2024-04-25T10:25:41.246715+0000","last_active":"2024-04-25T10:26:18.694989+0000","last_peered":"2024-04-25T10:26:18.694989+0000","last_clean":"2024-04-25T10:26:18.694989+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:26:18.694989+0000","last_undegraded":"2024-04-25T10:26:18.694989+0000","last_fullsized":"2024-04-25T10:26:18.694989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:03.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406988+0000","last_change":"2024-04-25T10:25:37.170738+0000","last_active":"2024-04-25T10:26:18.406988+0000","last_peered":"2024-04-25T10:26:18.406988+0000","last_clean":"2024-04-25T10:26:18.406988+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:26:18.406988+0000","last_undegraded":"2024-04-25T10:26:18.406988+0000","last_fullsized":"2024-04-25T10:26:18.406988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:43.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416523+0000","last_change":"2024-04-25T10:25:36.186052+0000","last_active":"2024-04-25T10:26:18.416523+0000","last_peered":"2024-04-25T10:26:18.416523+0000","last_clean":"2024-04-25T10:26:18.416523+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:26:18.416523+0000","last_undegraded":"2024-04-25T10:26:18.416523+0000","last_fullsized":"2024-04-25T10:26:18.416523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:42.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406382+0000","last_change":"2024-04-25T10:25:41.244909+0000","last_active":"2024-04-25T10:26:18.406382+0000","last_peered":"2024-04-25T10:26:18.406382+0000","last_clean":"2024-04-25T10:26:18.406382+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:26:18.406382+0000","last_undegraded":"2024-04-25T10:26:18.406382+0000","last_fullsized":"2024-04-25T10:26:18.406382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424110+0000","last_change":"2024-04-25T10:25:37.181614+0000","last_active":"2024-04-25T10:26:18.424110+0000","last_peered":"2024-04-25T10:26:18.424110+0000","last_clean":"2024-04-25T10:26:18.424110+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:26:18.424110+0000","last_undegraded":"2024-04-25T10:26:18.424110+0000","last_fullsized":"2024-04-25T10:26:18.424110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695773+0000","last_change":"2024-04-25T10:25:36.166395+0000","last_active":"2024-04-25T10:26:18.695773+0000","last_peered":"2024-04-25T10:26:18.695773+0000","last_clean":"2024-04-25T10:26:18.695773+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:26:18.695773+0000","last_undegraded":"2024-04-25T10:26:18.695773+0000","last_fullsized":"2024-04-25T10:26:18.695773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406299+0000","last_change":"2024-04-25T10:25:41.237175+0000","last_active":"2024-04-25T10:26:18.406299+0000","last_peered":"2024-04-25T10:26:18.406299+0000","last_clean":"2024-04-25T10:26:18.406299+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:26:18.406299+0000","last_undegraded":"2024-04-25T10:26:18.406299+0000","last_fullsized":"2024-04-25T10:26:18.406299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.703996+0000","last_change":"2024-04-25T10:25:37.192638+0000","last_active":"2024-04-25T10:26:18.703996+0000","last_peered":"2024-04-25T10:26:18.703996+0000","last_clean":"2024-04-25T10:26:18.703996+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:26:18.703996+0000","last_undegraded":"2024-04-25T10:26:18.703996+0000","last_fullsized":"2024-04-25T10:26:18.703996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.414105+0000","last_change":"2024-04-25T10:25:36.182126+0000","last_active":"2024-04-25T10:26:18.414105+0000","last_peered":"2024-04-25T10:26:18.414105+0000","last_clean":"2024-04-25T10:26:18.414105+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:26:18.414105+0000","last_undegraded":"2024-04-25T10:26:18.414105+0000","last_fullsized":"2024-04-25T10:26:18.414105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:50.385012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406660+0000","last_change":"2024-04-25T10:25:41.247504+0000","last_active":"2024-04-25T10:26:18.406660+0000","last_peered":"2024-04-25T10:26:18.406660+0000","last_clean":"2024-04-25T10:26:18.406660+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:26:18.406660+0000","last_undegraded":"2024-04-25T10:26:18.406660+0000","last_fullsized":"2024-04-25T10:26:18.406660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697789+0000","last_change":"2024-04-25T10:25:37.171962+0000","last_active":"2024-04-25T10:26:18.697789+0000","last_peered":"2024-04-25T10:26:18.697789+0000","last_clean":"2024-04-25T10:26:18.697789+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:26:18.697789+0000","last_undegraded":"2024-04-25T10:26:18.697789+0000","last_fullsized":"2024-04-25T10:26:18.697789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.376707+0000","last_change":"2024-04-25T10:25:36.167914+0000","last_active":"2024-04-25T10:26:19.376707+0000","last_peered":"2024-04-25T10:26:19.376707+0000","last_clean":"2024-04-25T10:26:19.376707+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:26:19.376707+0000","last_undegraded":"2024-04-25T10:26:19.376707+0000","last_fullsized":"2024-04-25T10:26:19.376707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406781+0000","last_change":"2024-04-25T10:25:41.250414+0000","last_active":"2024-04-25T10:26:18.406781+0000","last_peered":"2024-04-25T10:26:18.406781+0000","last_clean":"2024-04-25T10:26:18.406781+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:26:18.406781+0000","last_undegraded":"2024-04-25T10:26:18.406781+0000","last_fullsized":"2024-04-25T10:26:18.406781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406299+0000","last_change":"2024-04-25T10:25:37.179610+0000","last_active":"2024-04-25T10:26:18.406299+0000","last_peered":"2024-04-25T10:26:18.406299+0000","last_clean":"2024-04-25T10:26:18.406299+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:26:18.406299+0000","last_undegraded":"2024-04-25T10:26:18.406299+0000","last_fullsized":"2024-04-25T10:26:18.406299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:22.862181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.377997+0000","last_change":"2024-04-25T10:25:36.187683+0000","last_active":"2024-04-25T10:26:19.377997+0000","last_peered":"2024-04-25T10:26:19.377997+0000","last_clean":"2024-04-25T10:26:19.377997+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:26:19.377997+0000","last_undegraded":"2024-04-25T10:26:19.377997+0000","last_fullsized":"2024-04-25T10:26:19.377997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696093+0000","last_change":"2024-04-25T10:25:41.239687+0000","last_active":"2024-04-25T10:26:18.696093+0000","last_peered":"2024-04-25T10:26:18.696093+0000","last_clean":"2024-04-25T10:26:18.696093+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:26:18.696093+0000","last_undegraded":"2024-04-25T10:26:18.696093+0000","last_fullsized":"2024-04-25T10:26:18.696093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.061875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696051+0000","last_change":"2024-04-25T10:25:37.172981+0000","last_active":"2024-04-25T10:26:18.696051+0000","last_peered":"2024-04-25T10:26:18.696051+0000","last_clean":"2024-04-25T10:26:18.696051+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:26:18.696051+0000","last_undegraded":"2024-04-25T10:26:18.696051+0000","last_fullsized":"2024-04-25T10:26:18.696051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415945+0000","last_change":"2024-04-25T10:25:36.186586+0000","last_active":"2024-04-25T10:26:18.415945+0000","last_peered":"2024-04-25T10:26:18.415945+0000","last_clean":"2024-04-25T10:26:18.415945+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:26:18.415945+0000","last_undegraded":"2024-04-25T10:26:18.415945+0000","last_fullsized":"2024-04-25T10:26:18.415945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:00.696356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":122,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484332+0000","last_change":"2024-04-25T10:25:25.811918+0000","last_active":"2024-04-25T10:26:18.484332+0000","last_peered":"2024-04-25T10:26:18.484332+0000","last_clean":"2024-04-25T10:26:18.484332+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:26:18.484332+0000","last_undegraded":"2024-04-25T10:26:18.484332+0000","last_fullsized":"2024-04-25T10:26:18.484332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_clean_scrub_stamp":"2024-04-25T10:25:24.774439+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:46.603072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416400+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:26:18.416400+0000","last_peered":"2024-04-25T10:26:18.416400+0000","last_clean":"2024-04-25T10:26:18.416400+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:26:18.416400+0000","last_undegraded":"2024-04-25T10:26:18.416400+0000","last_fullsized":"2024-04-25T10:26:18.416400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:56.121358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416362+0000","last_change":"2024-04-25T10:25:37.187670+0000","last_active":"2024-04-25T10:26:18.416362+0000","last_peered":"2024-04-25T10:26:18.416362+0000","last_clean":"2024-04-25T10:26:18.416362+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:26:18.416362+0000","last_undegraded":"2024-04-25T10:26:18.416362+0000","last_fullsized":"2024-04-25T10:26:18.416362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:09.567527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.378267+0000","last_change":"2024-04-25T10:25:36.190434+0000","last_active":"2024-04-25T10:26:19.378267+0000","last_peered":"2024-04-25T10:26:19.378267+0000","last_clean":"2024-04-25T10:26:19.378267+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:26:19.378267+0000","last_undegraded":"2024-04-25T10:26:19.378267+0000","last_fullsized":"2024-04-25T10:26:19.378267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424597+0000","last_change":"2024-04-25T10:25:41.249210+0000","last_active":"2024-04-25T10:26:18.424597+0000","last_peered":"2024-04-25T10:26:18.424597+0000","last_clean":"2024-04-25T10:26:18.424597+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:26:18.424597+0000","last_undegraded":"2024-04-25T10:26:18.424597+0000","last_fullsized":"2024-04-25T10:26:18.424597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.711880+0000","last_change":"2024-04-25T10:25:37.176608+0000","last_active":"2024-04-25T10:26:18.711880+0000","last_peered":"2024-04-25T10:26:18.711880+0000","last_clean":"2024-04-25T10:26:18.711880+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:26:18.711880+0000","last_undegraded":"2024-04-25T10:26:18.711880+0000","last_fullsized":"2024-04-25T10:26:18.711880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696156+0000","last_change":"2024-04-25T10:25:36.175833+0000","last_active":"2024-04-25T10:26:18.696156+0000","last_peered":"2024-04-25T10:26:18.696156+0000","last_clean":"2024-04-25T10:26:18.696156+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:26:18.696156+0000","last_undegraded":"2024-04-25T10:26:18.696156+0000","last_fullsized":"2024-04-25T10:26:18.696156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695573+0000","last_change":"2024-04-25T10:25:41.256600+0000","last_active":"2024-04-25T10:26:18.695573+0000","last_peered":"2024-04-25T10:26:18.695573+0000","last_clean":"2024-04-25T10:26:18.695573+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:26:18.695573+0000","last_undegraded":"2024-04-25T10:26:18.695573+0000","last_fullsized":"2024-04-25T10:26:18.695573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.707289+0000","last_change":"2024-04-25T10:25:37.185203+0000","last_active":"2024-04-25T10:26:18.707289+0000","last_peered":"2024-04-25T10:26:18.707289+0000","last_clean":"2024-04-25T10:26:18.707289+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:26:18.707289+0000","last_undegraded":"2024-04-25T10:26:18.707289+0000","last_fullsized":"2024-04-25T10:26:18.707289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696810+0000","last_change":"2024-04-25T10:25:36.168542+0000","last_active":"2024-04-25T10:26:18.696810+0000","last_peered":"2024-04-25T10:26:18.696810+0000","last_clean":"2024-04-25T10:26:18.696810+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:26:18.696810+0000","last_undegraded":"2024-04-25T10:26:18.696810+0000","last_fullsized":"2024-04-25T10:26:18.696810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.411567+0000","last_change":"2024-04-25T10:25:41.242053+0000","last_active":"2024-04-25T10:26:18.411567+0000","last_peered":"2024-04-25T10:26:18.411567+0000","last_clean":"2024-04-25T10:26:18.411567+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:26:18.411567+0000","last_undegraded":"2024-04-25T10:26:18.411567+0000","last_fullsized":"2024-04-25T10:26:18.411567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:05.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424358+0000","last_change":"2024-04-25T10:25:37.198952+0000","last_active":"2024-04-25T10:26:18.424358+0000","last_peered":"2024-04-25T10:26:18.424358+0000","last_clean":"2024-04-25T10:26:18.424358+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:26:18.424358+0000","last_undegraded":"2024-04-25T10:26:18.424358+0000","last_fullsized":"2024-04-25T10:26:18.424358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.707431+0000","last_change":"2024-04-25T10:25:36.179694+0000","last_active":"2024-04-25T10:26:18.707431+0000","last_peered":"2024-04-25T10:26:18.707431+0000","last_clean":"2024-04-25T10:26:18.707431+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:26:18.707431+0000","last_undegraded":"2024-04-25T10:26:18.707431+0000","last_fullsized":"2024-04-25T10:26:18.707431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484604+0000","last_change":"2024-04-25T10:25:41.251379+0000","last_active":"2024-04-25T10:26:18.484604+0000","last_peered":"2024-04-25T10:26:18.484604+0000","last_clean":"2024-04-25T10:26:18.484604+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:26:18.484604+0000","last_undegraded":"2024-04-25T10:26:18.484604+0000","last_fullsized":"2024-04-25T10:26:18.484604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:47.690188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.412626+0000","last_change":"2024-04-25T10:25:37.202390+0000","last_active":"2024-04-25T10:26:18.412626+0000","last_peered":"2024-04-25T10:26:18.412626+0000","last_clean":"2024-04-25T10:26:18.412626+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:26:18.412626+0000","last_undegraded":"2024-04-25T10:26:18.412626+0000","last_fullsized":"2024-04-25T10:26:18.412626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.378489+0000","last_change":"2024-04-25T10:25:36.154879+0000","last_active":"2024-04-25T10:26:19.378489+0000","last_peered":"2024-04-25T10:26:19.378489+0000","last_clean":"2024-04-25T10:26:19.378489+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:26:19.378489+0000","last_undegraded":"2024-04-25T10:26:19.378489+0000","last_fullsized":"2024-04-25T10:26:19.378489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696206+0000","last_change":"2024-04-25T10:25:41.239631+0000","last_active":"2024-04-25T10:26:18.696206+0000","last_peered":"2024-04-25T10:26:18.696206+0000","last_clean":"2024-04-25T10:26:18.696206+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:26:18.696206+0000","last_undegraded":"2024-04-25T10:26:18.696206+0000","last_fullsized":"2024-04-25T10:26:18.696206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.684623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484230+0000","last_change":"2024-04-25T10:25:37.181525+0000","last_active":"2024-04-25T10:26:18.484230+0000","last_peered":"2024-04-25T10:26:18.484230+0000","last_clean":"2024-04-25T10:26:18.484230+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:26:18.484230+0000","last_undegraded":"2024-04-25T10:26:18.484230+0000","last_fullsized":"2024-04-25T10:26:18.484230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.380319+0000","last_change":"2024-04-25T10:25:36.192797+0000","last_active":"2024-04-25T10:26:19.380319+0000","last_peered":"2024-04-25T10:26:19.380319+0000","last_clean":"2024-04-25T10:26:19.380319+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:26:19.380319+0000","last_undegraded":"2024-04-25T10:26:19.380319+0000","last_fullsized":"2024-04-25T10:26:19.380319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696218+0000","last_change":"2024-04-25T10:25:41.244618+0000","last_active":"2024-04-25T10:26:18.696218+0000","last_peered":"2024-04-25T10:26:18.696218+0000","last_clean":"2024-04-25T10:26:18.696218+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:26:18.696218+0000","last_undegraded":"2024-04-25T10:26:18.696218+0000","last_fullsized":"2024-04-25T10:26:18.696218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:13.625947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415549+0000","last_change":"2024-04-25T10:25:37.208984+0000","last_active":"2024-04-25T10:26:18.415549+0000","last_peered":"2024-04-25T10:26:18.415549+0000","last_clean":"2024-04-25T10:26:18.415549+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:26:18.415549+0000","last_undegraded":"2024-04-25T10:26:18.415549+0000","last_fullsized":"2024-04-25T10:26:18.415549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.413938+0000","last_change":"2024-04-25T10:25:36.185689+0000","last_active":"2024-04-25T10:26:18.413938+0000","last_peered":"2024-04-25T10:26:18.413938+0000","last_clean":"2024-04-25T10:26:18.413938+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:26:18.413938+0000","last_undegraded":"2024-04-25T10:26:18.413938+0000","last_fullsized":"2024-04-25T10:26:18.413938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:35.671970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406736+0000","last_change":"2024-04-25T10:25:41.247314+0000","last_active":"2024-04-25T10:26:18.406736+0000","last_peered":"2024-04-25T10:26:18.406736+0000","last_clean":"2024-04-25T10:26:18.406736+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:26:18.406736+0000","last_undegraded":"2024-04-25T10:26:18.406736+0000","last_fullsized":"2024-04-25T10:26:18.406736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406474+0000","last_change":"2024-04-25T10:25:37.193696+0000","last_active":"2024-04-25T10:26:18.406474+0000","last_peered":"2024-04-25T10:26:18.406474+0000","last_clean":"2024-04-25T10:26:18.406474+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:26:18.406474+0000","last_undegraded":"2024-04-25T10:26:18.406474+0000","last_fullsized":"2024-04-25T10:26:18.406474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.381011+0000","last_change":"2024-04-25T10:25:36.181843+0000","last_active":"2024-04-25T10:26:19.381011+0000","last_peered":"2024-04-25T10:26:19.381011+0000","last_clean":"2024-04-25T10:26:19.381011+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:26:19.381011+0000","last_undegraded":"2024-04-25T10:26:19.381011+0000","last_fullsized":"2024-04-25T10:26:19.381011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416172+0000","last_change":"2024-04-25T10:25:41.247061+0000","last_active":"2024-04-25T10:26:18.416172+0000","last_peered":"2024-04-25T10:26:18.416172+0000","last_clean":"2024-04-25T10:26:18.416172+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:26:18.416172+0000","last_undegraded":"2024-04-25T10:26:18.416172+0000","last_fullsized":"2024-04-25T10:26:18.416172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.491573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.704685+0000","last_change":"2024-04-25T10:25:37.185402+0000","last_active":"2024-04-25T10:26:18.704685+0000","last_peered":"2024-04-25T10:26:18.704685+0000","last_clean":"2024-04-25T10:26:18.704685+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:26:18.704685+0000","last_undegraded":"2024-04-25T10:26:18.704685+0000","last_fullsized":"2024-04-25T10:26:18.704685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'14","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:33.545534+0000","last_change":"2024-04-25T10:25:36.166998+0000","last_active":"2024-04-25T10:26:33.545534+0000","last_peered":"2024-04-25T10:26:33.545534+0000","last_clean":"2024-04-25T10:26:33.545534+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:26:33.545534+0000","last_undegraded":"2024-04-25T10:26:33.545534+0000","last_fullsized":"2024-04-25T10:26:33.545534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:25.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695909+0000","last_change":"2024-04-25T10:25:41.248522+0000","last_active":"2024-04-25T10:26:18.695909+0000","last_peered":"2024-04-25T10:26:18.695909+0000","last_clean":"2024-04-25T10:26:18.695909+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:26:18.695909+0000","last_undegraded":"2024-04-25T10:26:18.695909+0000","last_fullsized":"2024-04-25T10:26:18.695909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:51.139406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415590+0000","last_change":"2024-04-25T10:25:37.196588+0000","last_active":"2024-04-25T10:26:18.415590+0000","last_peered":"2024-04-25T10:26:18.415590+0000","last_clean":"2024-04-25T10:26:18.415590+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:26:18.415590+0000","last_undegraded":"2024-04-25T10:26:18.415590+0000","last_fullsized":"2024-04-25T10:26:18.415590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:00.003456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697119+0000","last_change":"2024-04-25T10:25:36.156630+0000","last_active":"2024-04-25T10:26:18.697119+0000","last_peered":"2024-04-25T10:26:18.697119+0000","last_clean":"2024-04-25T10:26:18.697119+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:26:18.697119+0000","last_undegraded":"2024-04-25T10:26:18.697119+0000","last_fullsized":"2024-04-25T10:26:18.697119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.708803+0000","last_change":"2024-04-25T10:26:18.708803+0000","last_active":"2024-04-25T10:26:18.708803+0000","last_peered":"2024-04-25T10:26:18.708803+0000","last_clean":"2024-04-25T10:26:18.708803+0000","last_became_active":"2024-04-25T10:26:18.708320+0000","last_became_peered":"2024-04-25T10:26:18.708320+0000","last_unstale":"2024-04-25T10:26:18.708803+0000","last_undegraded":"2024-04-25T10:26:18.708803+0000","last_fullsized":"2024-04-25T10:26:18.708803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:09.714453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,7],"acting":[2,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696354+0000","last_change":"2024-04-25T10:25:37.187575+0000","last_active":"2024-04-25T10:26:18.696354+0000","last_peered":"2024-04-25T10:26:18.696354+0000","last_clean":"2024-04-25T10:26:18.696354+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:26:18.696354+0000","last_undegraded":"2024-04-25T10:26:18.696354+0000","last_fullsized":"2024-04-25T10:26:18.696354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.706876+0000","last_change":"2024-04-25T10:25:36.183582+0000","last_active":"2024-04-25T10:26:18.706876+0000","last_peered":"2024-04-25T10:26:18.706876+0000","last_clean":"2024-04-25T10:26:18.706876+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:26:18.706876+0000","last_undegraded":"2024-04-25T10:26:18.706876+0000","last_fullsized":"2024-04-25T10:26:18.706876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.694984+0000","last_change":"2024-04-25T10:25:41.238488+0000","last_active":"2024-04-25T10:26:18.694984+0000","last_peered":"2024-04-25T10:26:18.694984+0000","last_clean":"2024-04-25T10:26:18.694984+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:26:18.694984+0000","last_undegraded":"2024-04-25T10:26:18.694984+0000","last_fullsized":"2024-04-25T10:26:18.694984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:05.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424244+0000","last_change":"2024-04-25T10:25:37.192707+0000","last_active":"2024-04-25T10:26:18.424244+0000","last_peered":"2024-04-25T10:26:18.424244+0000","last_clean":"2024-04-25T10:26:18.424244+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:26:18.424244+0000","last_undegraded":"2024-04-25T10:26:18.424244+0000","last_fullsized":"2024-04-25T10:26:18.424244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.488211+0000","last_change":"2024-04-25T10:25:36.173755+0000","last_active":"2024-04-25T10:26:18.488211+0000","last_peered":"2024-04-25T10:26:18.488211+0000","last_clean":"2024-04-25T10:26:18.488211+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:26:18.488211+0000","last_undegraded":"2024-04-25T10:26:18.488211+0000","last_fullsized":"2024-04-25T10:26:18.488211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696449+0000","last_change":"2024-04-25T10:25:41.248983+0000","last_active":"2024-04-25T10:26:18.696449+0000","last_peered":"2024-04-25T10:26:18.696449+0000","last_clean":"2024-04-25T10:26:18.696449+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:26:18.696449+0000","last_undegraded":"2024-04-25T10:26:18.696449+0000","last_fullsized":"2024-04-25T10:26:18.696449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.880608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696825+0000","last_change":"2024-04-25T10:25:41.246692+0000","last_active":"2024-04-25T10:26:18.696825+0000","last_peered":"2024-04-25T10:26:18.696825+0000","last_clean":"2024-04-25T10:26:18.696825+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:26:18.696825+0000","last_undegraded":"2024-04-25T10:26:18.696825+0000","last_fullsized":"2024-04-25T10:26:18.696825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:44.250576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696507+0000","last_change":"2024-04-25T10:25:37.178691+0000","last_active":"2024-04-25T10:26:18.696507+0000","last_peered":"2024-04-25T10:26:18.696507+0000","last_clean":"2024-04-25T10:26:18.696507+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:26:18.696507+0000","last_undegraded":"2024-04-25T10:26:18.696507+0000","last_fullsized":"2024-04-25T10:26:18.696507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.412013+0000","last_change":"2024-04-25T10:25:36.191338+0000","last_active":"2024-04-25T10:26:18.412013+0000","last_peered":"2024-04-25T10:26:18.412013+0000","last_clean":"2024-04-25T10:26:18.412013+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:26:18.412013+0000","last_undegraded":"2024-04-25T10:26:18.412013+0000","last_fullsized":"2024-04-25T10:26:18.412013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.417101+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:26:18.417101+0000","last_peered":"2024-04-25T10:26:18.417101+0000","last_clean":"2024-04-25T10:26:18.417101+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:26:18.417101+0000","last_undegraded":"2024-04-25T10:26:18.417101+0000","last_fullsized":"2024-04-25T10:26:18.417101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:21.254459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697789+0000","last_change":"2024-04-25T10:25:37.170931+0000","last_active":"2024-04-25T10:26:18.697789+0000","last_peered":"2024-04-25T10:26:18.697789+0000","last_clean":"2024-04-25T10:26:18.697789+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:26:18.697789+0000","last_undegraded":"2024-04-25T10:26:18.697789+0000","last_fullsized":"2024-04-25T10:26:18.697789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.377822+0000","last_change":"2024-04-25T10:25:36.173721+0000","last_active":"2024-04-25T10:26:19.377822+0000","last_peered":"2024-04-25T10:26:19.377822+0000","last_clean":"2024-04-25T10:26:19.377822+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:26:19.377822+0000","last_undegraded":"2024-04-25T10:26:19.377822+0000","last_fullsized":"2024-04-25T10:26:19.377822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:42.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.378676+0000","last_change":"2024-04-25T10:25:36.195499+0000","last_active":"2024-04-25T10:26:19.378676+0000","last_peered":"2024-04-25T10:26:19.378676+0000","last_clean":"2024-04-25T10:26:19.378676+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:26:19.378676+0000","last_undegraded":"2024-04-25T10:26:19.378676+0000","last_fullsized":"2024-04-25T10:26:19.378676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:05.600702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696309+0000","last_change":"2024-04-25T10:25:37.180896+0000","last_active":"2024-04-25T10:26:18.696309+0000","last_peered":"2024-04-25T10:26:18.696309+0000","last_clean":"2024-04-25T10:26:18.696309+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:26:18.696309+0000","last_undegraded":"2024-04-25T10:26:18.696309+0000","last_fullsized":"2024-04-25T10:26:18.696309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696525+0000","last_change":"2024-04-25T10:25:41.231793+0000","last_active":"2024-04-25T10:26:18.696525+0000","last_peered":"2024-04-25T10:26:18.696525+0000","last_clean":"2024-04-25T10:26:18.696525+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:26:18.696525+0000","last_undegraded":"2024-04-25T10:26:18.696525+0000","last_fullsized":"2024-04-25T10:26:18.696525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:33.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695714+0000","last_change":"2024-04-25T10:25:36.166742+0000","last_active":"2024-04-25T10:26:18.695714+0000","last_peered":"2024-04-25T10:26:18.695714+0000","last_clean":"2024-04-25T10:26:18.695714+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:26:18.695714+0000","last_undegraded":"2024-04-25T10:26:18.695714+0000","last_fullsized":"2024-04-25T10:26:18.695714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.485032+0000","last_change":"2024-04-25T10:25:37.185699+0000","last_active":"2024-04-25T10:26:18.485032+0000","last_peered":"2024-04-25T10:26:18.485032+0000","last_clean":"2024-04-25T10:26:18.485032+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:26:18.485032+0000","last_undegraded":"2024-04-25T10:26:18.485032+0000","last_fullsized":"2024-04-25T10:26:18.485032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696812+0000","last_change":"2024-04-25T10:25:41.258191+0000","last_active":"2024-04-25T10:26:18.696812+0000","last_peered":"2024-04-25T10:26:18.696812+0000","last_clean":"2024-04-25T10:26:18.696812+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:26:18.696812+0000","last_undegraded":"2024-04-25T10:26:18.696812+0000","last_fullsized":"2024-04-25T10:26:18.696812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.479785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423035+0000","last_change":"2024-04-25T10:25:37.183192+0000","last_active":"2024-04-25T10:26:18.423035+0000","last_peered":"2024-04-25T10:26:18.423035+0000","last_clean":"2024-04-25T10:26:18.423035+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:26:18.423035+0000","last_undegraded":"2024-04-25T10:26:18.423035+0000","last_fullsized":"2024-04-25T10:26:18.423035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695394+0000","last_change":"2024-04-25T10:25:37.180242+0000","last_active":"2024-04-25T10:26:18.695394+0000","last_peered":"2024-04-25T10:26:18.695394+0000","last_clean":"2024-04-25T10:26:18.695394+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:26:18.695394+0000","last_undegraded":"2024-04-25T10:26:18.695394+0000","last_fullsized":"2024-04-25T10:26:18.695394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.413509+0000","last_change":"2024-04-25T10:25:37.187312+0000","last_active":"2024-04-25T10:26:18.413509+0000","last_peered":"2024-04-25T10:26:18.413509+0000","last_clean":"2024-04-25T10:26:18.413509+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:26:18.413509+0000","last_undegraded":"2024-04-25T10:26:18.413509+0000","last_fullsized":"2024-04-25T10:26:18.413509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:22.595222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695638+0000","last_change":"2024-04-25T10:25:37.166351+0000","last_active":"2024-04-25T10:26:18.695638+0000","last_peered":"2024-04-25T10:26:18.695638+0000","last_clean":"2024-04-25T10:26:18.695638+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:26:18.695638+0000","last_undegraded":"2024-04-25T10:26:18.695638+0000","last_fullsized":"2024-04-25T10:26:18.695638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.699084+0000","last_change":"2024-04-25T10:26:18.699084+0000","last_active":"2024-04-25T10:26:18.699084+0000","last_peered":"2024-04-25T10:26:18.699084+0000","last_clean":"2024-04-25T10:26:18.699084+0000","last_became_active":"2024-04-25T10:26:18.698625+0000","last_became_peered":"2024-04-25T10:26:18.698625+0000","last_unstale":"2024-04-25T10:26:18.699084+0000","last_undegraded":"2024-04-25T10:26:18.699084+0000","last_fullsized":"2024-04-25T10:26:18.699084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:44.112645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406765+0000","last_change":"2024-04-25T10:25:37.170647+0000","last_active":"2024-04-25T10:26:18.406765+0000","last_peered":"2024-04-25T10:26:18.406765+0000","last_clean":"2024-04-25T10:26:18.406765+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:26:18.406765+0000","last_undegraded":"2024-04-25T10:26:18.406765+0000","last_fullsized":"2024-04-25T10:26:18.406765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423553+0000","last_change":"2024-04-25T10:25:37.196676+0000","last_active":"2024-04-25T10:26:18.423553+0000","last_peered":"2024-04-25T10:26:18.423553+0000","last_clean":"2024-04-25T10:26:18.423553+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:26:18.423553+0000","last_undegraded":"2024-04-25T10:26:18.423553+0000","last_fullsized":"2024-04-25T10:26:18.423553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696213+0000","last_change":"2024-04-25T10:25:37.186567+0000","last_active":"2024-04-25T10:26:18.696213+0000","last_peered":"2024-04-25T10:26:18.696213+0000","last_clean":"2024-04-25T10:26:18.696213+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:26:18.696213+0000","last_undegraded":"2024-04-25T10:26:18.696213+0000","last_fullsized":"2024-04-25T10:26:18.696213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.411895+0000","last_change":"2024-04-25T10:25:37.184887+0000","last_active":"2024-04-25T10:26:18.411895+0000","last_peered":"2024-04-25T10:26:18.411895+0000","last_clean":"2024-04-25T10:26:18.411895+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:26:18.411895+0000","last_undegraded":"2024-04-25T10:26:18.411895+0000","last_fullsized":"2024-04-25T10:26:18.411895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695758+0000","last_change":"2024-04-25T10:25:37.196649+0000","last_active":"2024-04-25T10:26:18.695758+0000","last_peered":"2024-04-25T10:26:18.695758+0000","last_clean":"2024-04-25T10:26:18.695758+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:26:18.695758+0000","last_undegraded":"2024-04-25T10:26:18.695758+0000","last_fullsized":"2024-04-25T10:26:18.695758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484928+0000","last_change":"2024-04-25T10:25:37.192093+0000","last_active":"2024-04-25T10:26:18.484928+0000","last_peered":"2024-04-25T10:26:18.484928+0000","last_clean":"2024-04-25T10:26:18.484928+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:26:18.484928+0000","last_undegraded":"2024-04-25T10:26:18.484928+0000","last_fullsized":"2024-04-25T10:26:18.484928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696179+0000","last_change":"2024-04-25T10:25:37.184014+0000","last_active":"2024-04-25T10:26:18.696179+0000","last_peered":"2024-04-25T10:26:18.696179+0000","last_clean":"2024-04-25T10:26:18.696179+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:26:18.696179+0000","last_undegraded":"2024-04-25T10:26:18.696179+0000","last_fullsized":"2024-04-25T10:26:18.696179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:52.810612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.711777+0000","last_change":"2024-04-25T10:25:37.187384+0000","last_active":"2024-04-25T10:26:18.711777+0000","last_peered":"2024-04-25T10:26:18.711777+0000","last_clean":"2024-04-25T10:26:18.711777+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:26:18.711777+0000","last_undegraded":"2024-04-25T10:26:18.711777+0000","last_fullsized":"2024-04-25T10:26:18.711777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416473+0000","last_change":"2024-04-25T10:25:37.195712+0000","last_active":"2024-04-25T10:26:18.416473+0000","last_peered":"2024-04-25T10:26:18.416473+0000","last_clean":"2024-04-25T10:26:18.416473+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:26:18.416473+0000","last_undegraded":"2024-04-25T10:26:18.416473+0000","last_fullsized":"2024-04-25T10:26:18.416473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:13.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697258+0000","last_change":"2024-04-25T10:25:37.198664+0000","last_active":"2024-04-25T10:26:18.697258+0000","last_peered":"2024-04-25T10:26:18.697258+0000","last_clean":"2024-04-25T10:26:18.697258+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:26:18.697258+0000","last_undegraded":"2024-04-25T10:26:18.697258+0000","last_fullsized":"2024-04-25T10:26:18.697258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.417210+0000","last_change":"2024-04-25T10:25:37.203174+0000","last_active":"2024-04-25T10:26:18.417210+0000","last_peered":"2024-04-25T10:26:18.417210+0000","last_clean":"2024-04-25T10:26:18.417210+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:26:18.417210+0000","last_undegraded":"2024-04-25T10:26:18.417210+0000","last_fullsized":"2024-04-25T10:26:18.417210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:05.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.411779+0000","last_change":"2024-04-25T10:25:37.199911+0000","last_active":"2024-04-25T10:26:18.411779+0000","last_peered":"2024-04-25T10:26:18.411779+0000","last_clean":"2024-04-25T10:26:18.411779+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:26:18.411779+0000","last_undegraded":"2024-04-25T10:26:18.411779+0000","last_fullsized":"2024-04-25T10:26:18.411779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:29.272654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695806+0000","last_change":"2024-04-25T10:25:37.177405+0000","last_active":"2024-04-25T10:26:18.695806+0000","last_peered":"2024-04-25T10:26:18.695806+0000","last_clean":"2024-04-25T10:26:18.695806+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:26:18.695806+0000","last_undegraded":"2024-04-25T10:26:18.695806+0000","last_fullsized":"2024-04-25T10:26:18.695806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406403+0000","last_change":"2024-04-25T10:25:37.167752+0000","last_active":"2024-04-25T10:26:18.406403+0000","last_peered":"2024-04-25T10:26:18.406403+0000","last_clean":"2024-04-25T10:26:18.406403+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:26:18.406403+0000","last_undegraded":"2024-04-25T10:26:18.406403+0000","last_fullsized":"2024-04-25T10:26:18.406403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406601+0000","last_change":"2024-04-25T10:25:37.180781+0000","last_active":"2024-04-25T10:26:18.406601+0000","last_peered":"2024-04-25T10:26:18.406601+0000","last_clean":"2024-04-25T10:26:18.406601+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:26:18.406601+0000","last_undegraded":"2024-04-25T10:26:18.406601+0000","last_fullsized":"2024-04-25T10:26:18.406601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.711666+0000","last_change":"2024-04-25T10:25:37.192759+0000","last_active":"2024-04-25T10:26:18.711666+0000","last_peered":"2024-04-25T10:26:18.711666+0000","last_clean":"2024-04-25T10:26:18.711666+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:26:18.711666+0000","last_undegraded":"2024-04-25T10:26:18.711666+0000","last_fullsized":"2024-04-25T10:26:18.711666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.704592+0000","last_change":"2024-04-25T10:25:37.195532+0000","last_active":"2024-04-25T10:26:18.704592+0000","last_peered":"2024-04-25T10:26:18.704592+0000","last_clean":"2024-04-25T10:26:18.704592+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:26:18.704592+0000","last_undegraded":"2024-04-25T10:26:18.704592+0000","last_fullsized":"2024-04-25T10:26:18.704592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.706704+0000","last_change":"2024-04-25T10:25:37.200331+0000","last_active":"2024-04-25T10:26:18.706704+0000","last_peered":"2024-04-25T10:26:18.706704+0000","last_clean":"2024-04-25T10:26:18.706704+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:26:18.706704+0000","last_undegraded":"2024-04-25T10:26:18.706704+0000","last_fullsized":"2024-04-25T10:26:18.706704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.488103+0000","last_change":"2024-04-25T10:25:37.194514+0000","last_active":"2024-04-25T10:26:18.488103+0000","last_peered":"2024-04-25T10:26:18.488103+0000","last_clean":"2024-04-25T10:26:18.488103+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:26:18.488103+0000","last_undegraded":"2024-04-25T10:26:18.488103+0000","last_fullsized":"2024-04-25T10:26:18.488103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697663+0000","last_change":"2024-04-25T10:25:37.177730+0000","last_active":"2024-04-25T10:26:18.697663+0000","last_peered":"2024-04-25T10:26:18.697663+0000","last_clean":"2024-04-25T10:26:18.697663+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:26:18.697663+0000","last_undegraded":"2024-04-25T10:26:18.697663+0000","last_fullsized":"2024-04-25T10:26:18.697663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.703366+0000","last_change":"2024-04-25T10:25:37.173419+0000","last_active":"2024-04-25T10:26:18.703366+0000","last_peered":"2024-04-25T10:26:18.703366+0000","last_clean":"2024-04-25T10:26:18.703366+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:26:18.703366+0000","last_undegraded":"2024-04-25T10:26:18.703366+0000","last_fullsized":"2024-04-25T10:26:18.703366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424758+0000","last_change":"2024-04-25T10:25:37.182871+0000","last_active":"2024-04-25T10:26:18.424758+0000","last_peered":"2024-04-25T10:26:18.424758+0000","last_clean":"2024-04-25T10:26:18.424758+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:26:18.424758+0000","last_undegraded":"2024-04-25T10:26:18.424758+0000","last_fullsized":"2024-04-25T10:26:18.424758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.704091+0000","last_change":"2024-04-25T10:25:37.173983+0000","last_active":"2024-04-25T10:26:18.704091+0000","last_peered":"2024-04-25T10:26:18.704091+0000","last_clean":"2024-04-25T10:26:18.704091+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:26:18.704091+0000","last_undegraded":"2024-04-25T10:26:18.704091+0000","last_fullsized":"2024-04-25T10:26:18.704091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423770+0000","last_change":"2024-04-25T10:25:37.182178+0000","last_active":"2024-04-25T10:26:18.423770+0000","last_peered":"2024-04-25T10:26:18.423770+0000","last_clean":"2024-04-25T10:26:18.423770+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:26:18.423770+0000","last_undegraded":"2024-04-25T10:26:18.423770+0000","last_fullsized":"2024-04-25T10:26:18.423770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696072+0000","last_change":"2024-04-25T10:25:37.170383+0000","last_active":"2024-04-25T10:26:18.696072+0000","last_peered":"2024-04-25T10:26:18.696072+0000","last_clean":"2024-04-25T10:26:18.696072+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:26:18.696072+0000","last_undegraded":"2024-04-25T10:26:18.696072+0000","last_fullsized":"2024-04-25T10:26:18.696072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696055+0000","last_change":"2024-04-25T10:25:37.167687+0000","last_active":"2024-04-25T10:26:18.696055+0000","last_peered":"2024-04-25T10:26:18.696055+0000","last_clean":"2024-04-25T10:26:18.696055+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:26:18.696055+0000","last_undegraded":"2024-04-25T10:26:18.696055+0000","last_fullsized":"2024-04-25T10:26:18.696055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.707196+0000","last_change":"2024-04-25T10:25:37.196591+0000","last_active":"2024-04-25T10:26:18.707196+0000","last_peered":"2024-04-25T10:26:18.707196+0000","last_clean":"2024-04-25T10:26:18.707196+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:26:18.707196+0000","last_undegraded":"2024-04-25T10:26:18.707196+0000","last_fullsized":"2024-04-25T10:26:18.707196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":115122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":705090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":119586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":704446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":115234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:26:40.899 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:26:41.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.234+0000 7f9712400640 1 Processor -- start 2024-04-25T10:26:41.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.234+0000 7f9712400640 1 -- start start 2024-04-25T10:26:41.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.237+0000 7f9712400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f970c15a370 0x7f970c070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.237+0000 7f9712400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f970c0c7f90 0x7f970c073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.237+0000 7f9712400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f970c15a8b0 con 0x7f970c0cac80 2024-04-25T10:26:41.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.237+0000 7f9712400640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f970c072ea0 con 0x7f970c15a370 2024-04-25T10:26:41.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.237+0000 7f9712400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f970c073180 con 0x7f970c0c7f90 2024-04-25T10:26:41.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.237+0000 7f9711000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f970c15a370 0x7f970c070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.237+0000 7f9711a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f970c0cac80 0x7f970c154060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39630/0 (socket says 172.21.15.19:39630) 2024-04-25T10:26:41.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.237+0000 7f9711000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f970c15a370 0x7f970c070860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53886/0 (socket says 172.21.15.19:53886) 2024-04-25T10:26:41.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.237+0000 7f9711a00640 1 -- 172.21.15.19:0/413227539 learned_addr learned my addr 172.21.15.19:0/413227539 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:41.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.237+0000 7f970be00640 1 --2- 172.21.15.19:0/413227539 >> v2:172.21.15.112:3300/0 conn(0x7f970c0c7f90 0x7f970c073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.238+0000 7f9711000640 1 -- 172.21.15.19:0/413227539 >> v2:172.21.15.112:3300/0 conn(0x7f970c0c7f90 msgr2=0x7f970c073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:41.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.238+0000 7f9711000640 1 --2- 172.21.15.19:0/413227539 >> v2:172.21.15.112:3300/0 conn(0x7f970c0c7f90 0x7f970c073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.238+0000 7f9711000640 1 -- 172.21.15.19:0/413227539 >> v1:172.21.15.19:6789/0 conn(0x7f970c0cac80 legacy=0x7f970c154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:41.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.238+0000 7f9711000640 1 -- 172.21.15.19:0/413227539 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c15ab70 con 0x7f970c15a370 2024-04-25T10:26:41.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.238+0000 7f970b400640 1 -- 172.21.15.19:0/413227539 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995103971 0 0) 0x7f970c15a8b0 con 0x7f970c0cac80 2024-04-25T10:26:41.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.239+0000 7f9711000640 1 --2- 172.21.15.19:0/413227539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f970c15a370 0x7f970c070860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f970c0ce650 tx=0x7f970002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986c4e7efb7c159a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:41.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.239+0000 7f970b400640 1 -- 172.21.15.19:0/413227539 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700037070 con 0x7f970c15a370 2024-04-25T10:26:41.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.239+0000 7f970b400640 1 -- 172.21.15.19:0/413227539 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9700032440 con 0x7f970c15a370 2024-04-25T10:26:41.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.239+0000 7f970b400640 1 -- 172.21.15.19:0/413227539 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970002ae60 con 0x7f970c15a370 2024-04-25T10:26:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.240+0000 7f9712400640 1 -- 172.21.15.19:0/413227539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f970c15a370 msgr2=0x7f970c070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.240+0000 7f9712400640 1 --2- 172.21.15.19:0/413227539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f970c15a370 0x7f970c070860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f970c0ce650 tx=0x7f970002a110 comp rx=0 tx=0).stop 2024-04-25T10:26:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.240+0000 7f9712400640 1 -- 172.21.15.19:0/413227539 shutdown_connections 2024-04-25T10:26:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.240+0000 7f9712400640 1 --2- 172.21.15.19:0/413227539 >> v2:172.21.15.112:3300/0 conn(0x7f970c0c7f90 0x7f970c073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.240+0000 7f9712400640 1 --2- 172.21.15.19:0/413227539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f970c15a370 0x7f970c070860 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.240+0000 7f9712400640 1 -- 172.21.15.19:0/413227539 >> 172.21.15.19:0/413227539 conn(0x7f970c0cdbc0 msgr2=0x7f970c0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.240+0000 7f9712400640 1 -- 172.21.15.19:0/413227539 shutdown_connections 2024-04-25T10:26:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.240+0000 7f9712400640 1 -- 172.21.15.19:0/413227539 wait complete. 2024-04-25T10:26:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.242+0000 7f9712400640 1 Processor -- start 2024-04-25T10:26:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.243+0000 7f9712400640 1 -- start start 2024-04-25T10:26:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.244+0000 7f9712400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f970c0c7f90 0x7f970c1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.244+0000 7f9712400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c0cac80 0x7f970c1e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.244+0000 7f9712400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f970c15a370 0x7f970c1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.244+0000 7f9712400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f970c0c4b20 con 0x7f970c0c7f90 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.244+0000 7f9712400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f970c15b130 con 0x7f970c0cac80 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.244+0000 7f9712400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f970c070da0 con 0x7f970c15a370 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.244+0000 7f9711000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f970c0c7f90 0x7f970c1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.244+0000 7f970be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c0cac80 0x7f970c1e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.244+0000 7f9711a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f970c15a370 0x7f970c1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.244+0000 7f970be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c0cac80 0x7f970c1e5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:51918/0 (socket says 172.21.15.19:51918) 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.244+0000 7f970be00640 1 -- 172.21.15.19:0/4129796750 learned_addr learned my addr 172.21.15.19:0/4129796750 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.245+0000 7f970be00640 1 -- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f970c15a370 msgr2=0x7f970c1527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.245+0000 7f970be00640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f970c15a370 0x7f970c1527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.245+0000 7f970be00640 1 -- 172.21.15.19:0/4129796750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f970c0c7f90 msgr2=0x7f970c1f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.245+0000 7f970be00640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f970c0c7f90 0x7f970c1f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.245+0000 7f970be00640 1 -- 172.21.15.19:0/4129796750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c1f5f60 con 0x7f970c0cac80 2024-04-25T10:26:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.245+0000 7f970be00640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c0cac80 0x7f970c1e5c30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f96f800e870 tx=0x7f96f800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.245+0000 7f9708c00640 1 -- 172.21.15.19:0/4129796750 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f8017070 con 0x7f970c0cac80 2024-04-25T10:26:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.245+0000 7f9708c00640 1 -- 172.21.15.19:0/4129796750 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f800c940 con 0x7f970c0cac80 2024-04-25T10:26:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.245+0000 7f9712400640 1 -- 172.21.15.19:0/4129796750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970c0b2c20 con 0x7f970c0cac80 2024-04-25T10:26:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.246+0000 7f9708c00640 1 -- 172.21.15.19:0/4129796750 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f800cd30 con 0x7f970c0cac80 2024-04-25T10:26:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.246+0000 7f9712400640 1 -- 172.21.15.19:0/4129796750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970c156790 con 0x7f970c0cac80 2024-04-25T10:26:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.247+0000 7f9712400640 1 -- 172.21.15.19:0/4129796750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f970c050740 con 0x7f970c0cac80 2024-04-25T10:26:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.248+0000 7f9708c00640 1 -- 172.21.15.19:0/4129796750 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f96f801a070 con 0x7f970c0cac80 2024-04-25T10:26:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.249+0000 7f9708c00640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f96ec0744b0 0x7f96ec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.249+0000 7f9708c00640 1 -- 172.21.15.19:0/4129796750 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f96f80957c0 con 0x7f970c0cac80 2024-04-25T10:26:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.249+0000 7f9711000640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f96ec0744b0 0x7f96ec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.250+0000 7f9711000640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f96ec0744b0 0x7f96ec0769c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9700034000 tx=0x7f970002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.254+0000 7f9708c00640 1 -- 172.21.15.19:0/4129796750 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f96f805f580 con 0x7f970c0cac80 2024-04-25T10:26:41.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.456+0000 7f9712400640 1 -- 172.21.15.19:0/4129796750 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f970c0af690 con 0x7f96ec0744b0 2024-04-25T10:26:41.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.465+0000 7f9708c00640 1 -- 172.21.15.19:0/4129796750 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332581 (secure 0 0 0) 0x7f9700032790 con 0x7f96ec0744b0 2024-04-25T10:26:41.469 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:41.475 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 -- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f96ec0744b0 msgr2=0x7f96ec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f96ec0744b0 0x7f96ec0769c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9700034000 tx=0x7f970002e000 comp rx=0 tx=0).stop 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 -- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c0cac80 msgr2=0x7f970c1e5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c0cac80 0x7f970c1e5c30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f96f800e870 tx=0x7f96f800ed30 comp rx=0 tx=0).stop 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 -- 172.21.15.19:0/4129796750 shutdown_connections 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f96ec0744b0 0x7f96ec0769c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f970c15a370 0x7f970c1527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f970c0cac80 0x7f970c1e5c30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 --2- 172.21.15.19:0/4129796750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f970c0c7f90 0x7f970c1f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 -- 172.21.15.19:0/4129796750 >> 172.21.15.19:0/4129796750 conn(0x7f970c0cdbc0 msgr2=0x7f970c158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 -- 172.21.15.19:0/4129796750 shutdown_connections 2024-04-25T10:26:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.475+0000 7f9712400640 1 -- 172.21.15.19:0/4129796750 wait complete. 2024-04-25T10:26:41.505 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-04-25T10:26:40.594993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":232,"num_write_kb":1673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219632,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755088,"statfs":{"total":773094113280,"available":772869210112,"internally_reserved":0,"allocated":3579904,"data_stored":2107500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":258,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003316"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.379764+0000","last_change":"2024-04-25T10:25:36.182605+0000","last_active":"2024-04-25T10:26:19.379764+0000","last_peered":"2024-04-25T10:26:19.379764+0000","last_clean":"2024-04-25T10:26:19.379764+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:26:19.379764+0000","last_undegraded":"2024-04-25T10:26:19.379764+0000","last_fullsized":"2024-04-25T10:26:19.379764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696210+0000","last_change":"2024-04-25T10:25:37.199467+0000","last_active":"2024-04-25T10:26:18.696210+0000","last_peered":"2024-04-25T10:26:18.696210+0000","last_clean":"2024-04-25T10:26:18.696210+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:26:18.696210+0000","last_undegraded":"2024-04-25T10:26:18.696210+0000","last_fullsized":"2024-04-25T10:26:18.696210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695264+0000","last_change":"2024-04-25T10:25:41.234657+0000","last_active":"2024-04-25T10:26:18.695264+0000","last_peered":"2024-04-25T10:26:18.695264+0000","last_clean":"2024-04-25T10:26:18.695264+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:26:18.695264+0000","last_undegraded":"2024-04-25T10:26:18.695264+0000","last_fullsized":"2024-04-25T10:26:18.695264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:56.869031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696414+0000","last_change":"2024-04-25T10:25:36.166548+0000","last_active":"2024-04-25T10:26:18.696414+0000","last_peered":"2024-04-25T10:26:18.696414+0000","last_clean":"2024-04-25T10:26:18.696414+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:26:18.696414+0000","last_undegraded":"2024-04-25T10:26:18.696414+0000","last_fullsized":"2024-04-25T10:26:18.696414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696349+0000","last_change":"2024-04-25T10:25:37.179746+0000","last_active":"2024-04-25T10:26:18.696349+0000","last_peered":"2024-04-25T10:26:18.696349+0000","last_clean":"2024-04-25T10:26:18.696349+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:26:18.696349+0000","last_undegraded":"2024-04-25T10:26:18.696349+0000","last_fullsized":"2024-04-25T10:26:18.696349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.422898+0000","last_change":"2024-04-25T10:25:41.232828+0000","last_active":"2024-04-25T10:26:18.422898+0000","last_peered":"2024-04-25T10:26:18.422898+0000","last_clean":"2024-04-25T10:26:18.422898+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:26:18.422898+0000","last_undegraded":"2024-04-25T10:26:18.422898+0000","last_fullsized":"2024-04-25T10:26:18.422898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:01.782881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.383000+0000","last_change":"2024-04-25T10:25:36.190035+0000","last_active":"2024-04-25T10:26:19.383000+0000","last_peered":"2024-04-25T10:26:19.383000+0000","last_clean":"2024-04-25T10:26:19.383000+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:26:19.383000+0000","last_undegraded":"2024-04-25T10:26:19.383000+0000","last_fullsized":"2024-04-25T10:26:19.383000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.483844+0000","last_change":"2024-04-25T10:25:37.191742+0000","last_active":"2024-04-25T10:26:18.483844+0000","last_peered":"2024-04-25T10:26:18.483844+0000","last_clean":"2024-04-25T10:26:18.483844+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:26:18.483844+0000","last_undegraded":"2024-04-25T10:26:18.483844+0000","last_fullsized":"2024-04-25T10:26:18.483844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424882+0000","last_change":"2024-04-25T10:25:41.242444+0000","last_active":"2024-04-25T10:26:18.424882+0000","last_peered":"2024-04-25T10:26:18.424882+0000","last_clean":"2024-04-25T10:26:18.424882+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:26:18.424882+0000","last_undegraded":"2024-04-25T10:26:18.424882+0000","last_fullsized":"2024-04-25T10:26:18.424882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.712056+0000","last_change":"2024-04-25T10:25:36.190527+0000","last_active":"2024-04-25T10:26:18.712056+0000","last_peered":"2024-04-25T10:26:18.712056+0000","last_clean":"2024-04-25T10:26:18.712056+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:26:18.712056+0000","last_undegraded":"2024-04-25T10:26:18.712056+0000","last_fullsized":"2024-04-25T10:26:18.712056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416286+0000","last_change":"2024-04-25T10:25:37.204468+0000","last_active":"2024-04-25T10:26:18.416286+0000","last_peered":"2024-04-25T10:26:18.416286+0000","last_clean":"2024-04-25T10:26:18.416286+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:26:18.416286+0000","last_undegraded":"2024-04-25T10:26:18.416286+0000","last_fullsized":"2024-04-25T10:26:18.416286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423623+0000","last_change":"2024-04-25T10:25:41.236518+0000","last_active":"2024-04-25T10:26:18.423623+0000","last_peered":"2024-04-25T10:26:18.423623+0000","last_clean":"2024-04-25T10:26:18.423623+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:26:18.423623+0000","last_undegraded":"2024-04-25T10:26:18.423623+0000","last_fullsized":"2024-04-25T10:26:18.423623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.413629+0000","last_change":"2024-04-25T10:25:37.194114+0000","last_active":"2024-04-25T10:26:18.413629+0000","last_peered":"2024-04-25T10:26:18.413629+0000","last_clean":"2024-04-25T10:26:18.413629+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:26:18.413629+0000","last_undegraded":"2024-04-25T10:26:18.413629+0000","last_fullsized":"2024-04-25T10:26:18.413629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:40.192156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415768+0000","last_change":"2024-04-25T10:25:36.188266+0000","last_active":"2024-04-25T10:26:18.415768+0000","last_peered":"2024-04-25T10:26:18.415768+0000","last_clean":"2024-04-25T10:26:18.415768+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:26:18.415768+0000","last_undegraded":"2024-04-25T10:26:18.415768+0000","last_fullsized":"2024-04-25T10:26:18.415768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.845953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415983+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:26:18.415983+0000","last_peered":"2024-04-25T10:26:18.415983+0000","last_clean":"2024-04-25T10:26:18.415983+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:26:18.415983+0000","last_undegraded":"2024-04-25T10:26:18.415983+0000","last_fullsized":"2024-04-25T10:26:18.415983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:13.684019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697433+0000","last_change":"2024-04-25T10:25:37.166002+0000","last_active":"2024-04-25T10:26:18.697433+0000","last_peered":"2024-04-25T10:26:18.697433+0000","last_clean":"2024-04-25T10:26:18.697433+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:26:18.697433+0000","last_undegraded":"2024-04-25T10:26:18.697433+0000","last_fullsized":"2024-04-25T10:26:18.697433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406603+0000","last_change":"2024-04-25T10:25:36.168204+0000","last_active":"2024-04-25T10:26:18.406603+0000","last_peered":"2024-04-25T10:26:18.406603+0000","last_clean":"2024-04-25T10:26:18.406603+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:26:18.406603+0000","last_undegraded":"2024-04-25T10:26:18.406603+0000","last_fullsized":"2024-04-25T10:26:18.406603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.907635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.703010+0000","last_change":"2024-04-25T10:25:41.257264+0000","last_active":"2024-04-25T10:26:18.703010+0000","last_peered":"2024-04-25T10:26:18.703010+0000","last_clean":"2024-04-25T10:26:18.703010+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:26:18.703010+0000","last_undegraded":"2024-04-25T10:26:18.703010+0000","last_fullsized":"2024-04-25T10:26:18.703010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695190+0000","last_change":"2024-04-25T10:25:37.158884+0000","last_active":"2024-04-25T10:26:18.695190+0000","last_peered":"2024-04-25T10:26:18.695190+0000","last_clean":"2024-04-25T10:26:18.695190+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:26:18.695190+0000","last_undegraded":"2024-04-25T10:26:18.695190+0000","last_fullsized":"2024-04-25T10:26:18.695190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696653+0000","last_change":"2024-04-25T10:25:36.173499+0000","last_active":"2024-04-25T10:26:18.696653+0000","last_peered":"2024-04-25T10:26:18.696653+0000","last_clean":"2024-04-25T10:26:18.696653+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:26:18.696653+0000","last_undegraded":"2024-04-25T10:26:18.696653+0000","last_fullsized":"2024-04-25T10:26:18.696653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697166+0000","last_change":"2024-04-25T10:25:41.239990+0000","last_active":"2024-04-25T10:26:18.697166+0000","last_peered":"2024-04-25T10:26:18.697166+0000","last_clean":"2024-04-25T10:26:18.697166+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:26:18.697166+0000","last_undegraded":"2024-04-25T10:26:18.697166+0000","last_fullsized":"2024-04-25T10:26:18.697166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:15.055786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.412739+0000","last_change":"2024-04-25T10:25:37.193560+0000","last_active":"2024-04-25T10:26:18.412739+0000","last_peered":"2024-04-25T10:26:18.412739+0000","last_clean":"2024-04-25T10:26:18.412739+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:26:18.412739+0000","last_undegraded":"2024-04-25T10:26:18.412739+0000","last_fullsized":"2024-04-25T10:26:18.412739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.702410+0000","last_change":"2024-04-25T10:25:36.174077+0000","last_active":"2024-04-25T10:26:18.702410+0000","last_peered":"2024-04-25T10:26:18.702410+0000","last_clean":"2024-04-25T10:26:18.702410+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:26:18.702410+0000","last_undegraded":"2024-04-25T10:26:18.702410+0000","last_fullsized":"2024-04-25T10:26:18.702410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423418+0000","last_change":"2024-04-25T10:25:41.262158+0000","last_active":"2024-04-25T10:26:18.423418+0000","last_peered":"2024-04-25T10:26:18.423418+0000","last_clean":"2024-04-25T10:26:18.423418+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:26:18.423418+0000","last_undegraded":"2024-04-25T10:26:18.423418+0000","last_fullsized":"2024-04-25T10:26:18.423418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696683+0000","last_change":"2024-04-25T10:25:37.159876+0000","last_active":"2024-04-25T10:26:18.696683+0000","last_peered":"2024-04-25T10:26:18.696683+0000","last_clean":"2024-04-25T10:26:18.696683+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:26:18.696683+0000","last_undegraded":"2024-04-25T10:26:18.696683+0000","last_fullsized":"2024-04-25T10:26:18.696683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.417634+0000","last_change":"2024-04-25T10:25:36.194275+0000","last_active":"2024-04-25T10:26:18.417634+0000","last_peered":"2024-04-25T10:26:18.417634+0000","last_clean":"2024-04-25T10:26:18.417634+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:26:18.417634+0000","last_undegraded":"2024-04-25T10:26:18.417634+0000","last_fullsized":"2024-04-25T10:26:18.417634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423327+0000","last_change":"2024-04-25T10:25:41.261185+0000","last_active":"2024-04-25T10:26:18.423327+0000","last_peered":"2024-04-25T10:26:18.423327+0000","last_clean":"2024-04-25T10:26:18.423327+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:26:18.423327+0000","last_undegraded":"2024-04-25T10:26:18.423327+0000","last_fullsized":"2024-04-25T10:26:18.423327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696908+0000","last_change":"2024-04-25T10:25:37.165436+0000","last_active":"2024-04-25T10:26:18.696908+0000","last_peered":"2024-04-25T10:26:18.696908+0000","last_clean":"2024-04-25T10:26:18.696908+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:26:18.696908+0000","last_undegraded":"2024-04-25T10:26:18.696908+0000","last_fullsized":"2024-04-25T10:26:18.696908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.377939+0000","last_change":"2024-04-25T10:25:36.181966+0000","last_active":"2024-04-25T10:26:19.377939+0000","last_peered":"2024-04-25T10:26:19.377939+0000","last_clean":"2024-04-25T10:26:19.377939+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:26:19.377939+0000","last_undegraded":"2024-04-25T10:26:19.377939+0000","last_fullsized":"2024-04-25T10:26:19.377939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.694989+0000","last_change":"2024-04-25T10:25:41.246715+0000","last_active":"2024-04-25T10:26:18.694989+0000","last_peered":"2024-04-25T10:26:18.694989+0000","last_clean":"2024-04-25T10:26:18.694989+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:26:18.694989+0000","last_undegraded":"2024-04-25T10:26:18.694989+0000","last_fullsized":"2024-04-25T10:26:18.694989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:03.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406988+0000","last_change":"2024-04-25T10:25:37.170738+0000","last_active":"2024-04-25T10:26:18.406988+0000","last_peered":"2024-04-25T10:26:18.406988+0000","last_clean":"2024-04-25T10:26:18.406988+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:26:18.406988+0000","last_undegraded":"2024-04-25T10:26:18.406988+0000","last_fullsized":"2024-04-25T10:26:18.406988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:43.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416523+0000","last_change":"2024-04-25T10:25:36.186052+0000","last_active":"2024-04-25T10:26:18.416523+0000","last_peered":"2024-04-25T10:26:18.416523+0000","last_clean":"2024-04-25T10:26:18.416523+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:26:18.416523+0000","last_undegraded":"2024-04-25T10:26:18.416523+0000","last_fullsized":"2024-04-25T10:26:18.416523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:42.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406382+0000","last_change":"2024-04-25T10:25:41.244909+0000","last_active":"2024-04-25T10:26:18.406382+0000","last_peered":"2024-04-25T10:26:18.406382+0000","last_clean":"2024-04-25T10:26:18.406382+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:26:18.406382+0000","last_undegraded":"2024-04-25T10:26:18.406382+0000","last_fullsized":"2024-04-25T10:26:18.406382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424110+0000","last_change":"2024-04-25T10:25:37.181614+0000","last_active":"2024-04-25T10:26:18.424110+0000","last_peered":"2024-04-25T10:26:18.424110+0000","last_clean":"2024-04-25T10:26:18.424110+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:26:18.424110+0000","last_undegraded":"2024-04-25T10:26:18.424110+0000","last_fullsized":"2024-04-25T10:26:18.424110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695773+0000","last_change":"2024-04-25T10:25:36.166395+0000","last_active":"2024-04-25T10:26:18.695773+0000","last_peered":"2024-04-25T10:26:18.695773+0000","last_clean":"2024-04-25T10:26:18.695773+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:26:18.695773+0000","last_undegraded":"2024-04-25T10:26:18.695773+0000","last_fullsized":"2024-04-25T10:26:18.695773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406299+0000","last_change":"2024-04-25T10:25:41.237175+0000","last_active":"2024-04-25T10:26:18.406299+0000","last_peered":"2024-04-25T10:26:18.406299+0000","last_clean":"2024-04-25T10:26:18.406299+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:26:18.406299+0000","last_undegraded":"2024-04-25T10:26:18.406299+0000","last_fullsized":"2024-04-25T10:26:18.406299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.703996+0000","last_change":"2024-04-25T10:25:37.192638+0000","last_active":"2024-04-25T10:26:18.703996+0000","last_peered":"2024-04-25T10:26:18.703996+0000","last_clean":"2024-04-25T10:26:18.703996+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:26:18.703996+0000","last_undegraded":"2024-04-25T10:26:18.703996+0000","last_fullsized":"2024-04-25T10:26:18.703996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.414105+0000","last_change":"2024-04-25T10:25:36.182126+0000","last_active":"2024-04-25T10:26:18.414105+0000","last_peered":"2024-04-25T10:26:18.414105+0000","last_clean":"2024-04-25T10:26:18.414105+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:26:18.414105+0000","last_undegraded":"2024-04-25T10:26:18.414105+0000","last_fullsized":"2024-04-25T10:26:18.414105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:50.385012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406660+0000","last_change":"2024-04-25T10:25:41.247504+0000","last_active":"2024-04-25T10:26:18.406660+0000","last_peered":"2024-04-25T10:26:18.406660+0000","last_clean":"2024-04-25T10:26:18.406660+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:26:18.406660+0000","last_undegraded":"2024-04-25T10:26:18.406660+0000","last_fullsized":"2024-04-25T10:26:18.406660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697789+0000","last_change":"2024-04-25T10:25:37.171962+0000","last_active":"2024-04-25T10:26:18.697789+0000","last_peered":"2024-04-25T10:26:18.697789+0000","last_clean":"2024-04-25T10:26:18.697789+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:26:18.697789+0000","last_undegraded":"2024-04-25T10:26:18.697789+0000","last_fullsized":"2024-04-25T10:26:18.697789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.376707+0000","last_change":"2024-04-25T10:25:36.167914+0000","last_active":"2024-04-25T10:26:19.376707+0000","last_peered":"2024-04-25T10:26:19.376707+0000","last_clean":"2024-04-25T10:26:19.376707+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:26:19.376707+0000","last_undegraded":"2024-04-25T10:26:19.376707+0000","last_fullsized":"2024-04-25T10:26:19.376707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406781+0000","last_change":"2024-04-25T10:25:41.250414+0000","last_active":"2024-04-25T10:26:18.406781+0000","last_peered":"2024-04-25T10:26:18.406781+0000","last_clean":"2024-04-25T10:26:18.406781+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:26:18.406781+0000","last_undegraded":"2024-04-25T10:26:18.406781+0000","last_fullsized":"2024-04-25T10:26:18.406781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406299+0000","last_change":"2024-04-25T10:25:37.179610+0000","last_active":"2024-04-25T10:26:18.406299+0000","last_peered":"2024-04-25T10:26:18.406299+0000","last_clean":"2024-04-25T10:26:18.406299+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:26:18.406299+0000","last_undegraded":"2024-04-25T10:26:18.406299+0000","last_fullsized":"2024-04-25T10:26:18.406299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:22.862181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.377997+0000","last_change":"2024-04-25T10:25:36.187683+0000","last_active":"2024-04-25T10:26:19.377997+0000","last_peered":"2024-04-25T10:26:19.377997+0000","last_clean":"2024-04-25T10:26:19.377997+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:26:19.377997+0000","last_undegraded":"2024-04-25T10:26:19.377997+0000","last_fullsized":"2024-04-25T10:26:19.377997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696093+0000","last_change":"2024-04-25T10:25:41.239687+0000","last_active":"2024-04-25T10:26:18.696093+0000","last_peered":"2024-04-25T10:26:18.696093+0000","last_clean":"2024-04-25T10:26:18.696093+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:26:18.696093+0000","last_undegraded":"2024-04-25T10:26:18.696093+0000","last_fullsized":"2024-04-25T10:26:18.696093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.061875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696051+0000","last_change":"2024-04-25T10:25:37.172981+0000","last_active":"2024-04-25T10:26:18.696051+0000","last_peered":"2024-04-25T10:26:18.696051+0000","last_clean":"2024-04-25T10:26:18.696051+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:26:18.696051+0000","last_undegraded":"2024-04-25T10:26:18.696051+0000","last_fullsized":"2024-04-25T10:26:18.696051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415945+0000","last_change":"2024-04-25T10:25:36.186586+0000","last_active":"2024-04-25T10:26:18.415945+0000","last_peered":"2024-04-25T10:26:18.415945+0000","last_clean":"2024-04-25T10:26:18.415945+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:26:18.415945+0000","last_undegraded":"2024-04-25T10:26:18.415945+0000","last_fullsized":"2024-04-25T10:26:18.415945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:00.696356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":122,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484332+0000","last_change":"2024-04-25T10:25:25.811918+0000","last_active":"2024-04-25T10:26:18.484332+0000","last_peered":"2024-04-25T10:26:18.484332+0000","last_clean":"2024-04-25T10:26:18.484332+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:26:18.484332+0000","last_undegraded":"2024-04-25T10:26:18.484332+0000","last_fullsized":"2024-04-25T10:26:18.484332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_clean_scrub_stamp":"2024-04-25T10:25:24.774439+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:46.603072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416400+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:26:18.416400+0000","last_peered":"2024-04-25T10:26:18.416400+0000","last_clean":"2024-04-25T10:26:18.416400+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:26:18.416400+0000","last_undegraded":"2024-04-25T10:26:18.416400+0000","last_fullsized":"2024-04-25T10:26:18.416400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:56.121358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416362+0000","last_change":"2024-04-25T10:25:37.187670+0000","last_active":"2024-04-25T10:26:18.416362+0000","last_peered":"2024-04-25T10:26:18.416362+0000","last_clean":"2024-04-25T10:26:18.416362+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:26:18.416362+0000","last_undegraded":"2024-04-25T10:26:18.416362+0000","last_fullsized":"2024-04-25T10:26:18.416362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:09.567527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.378267+0000","last_change":"2024-04-25T10:25:36.190434+0000","last_active":"2024-04-25T10:26:19.378267+0000","last_peered":"2024-04-25T10:26:19.378267+0000","last_clean":"2024-04-25T10:26:19.378267+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:26:19.378267+0000","last_undegraded":"2024-04-25T10:26:19.378267+0000","last_fullsized":"2024-04-25T10:26:19.378267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424597+0000","last_change":"2024-04-25T10:25:41.249210+0000","last_active":"2024-04-25T10:26:18.424597+0000","last_peered":"2024-04-25T10:26:18.424597+0000","last_clean":"2024-04-25T10:26:18.424597+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:26:18.424597+0000","last_undegraded":"2024-04-25T10:26:18.424597+0000","last_fullsized":"2024-04-25T10:26:18.424597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.711880+0000","last_change":"2024-04-25T10:25:37.176608+0000","last_active":"2024-04-25T10:26:18.711880+0000","last_peered":"2024-04-25T10:26:18.711880+0000","last_clean":"2024-04-25T10:26:18.711880+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:26:18.711880+0000","last_undegraded":"2024-04-25T10:26:18.711880+0000","last_fullsized":"2024-04-25T10:26:18.711880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696156+0000","last_change":"2024-04-25T10:25:36.175833+0000","last_active":"2024-04-25T10:26:18.696156+0000","last_peered":"2024-04-25T10:26:18.696156+0000","last_clean":"2024-04-25T10:26:18.696156+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:26:18.696156+0000","last_undegraded":"2024-04-25T10:26:18.696156+0000","last_fullsized":"2024-04-25T10:26:18.696156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695573+0000","last_change":"2024-04-25T10:25:41.256600+0000","last_active":"2024-04-25T10:26:18.695573+0000","last_peered":"2024-04-25T10:26:18.695573+0000","last_clean":"2024-04-25T10:26:18.695573+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:26:18.695573+0000","last_undegraded":"2024-04-25T10:26:18.695573+0000","last_fullsized":"2024-04-25T10:26:18.695573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.707289+0000","last_change":"2024-04-25T10:25:37.185203+0000","last_active":"2024-04-25T10:26:18.707289+0000","last_peered":"2024-04-25T10:26:18.707289+0000","last_clean":"2024-04-25T10:26:18.707289+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:26:18.707289+0000","last_undegraded":"2024-04-25T10:26:18.707289+0000","last_fullsized":"2024-04-25T10:26:18.707289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696810+0000","last_change":"2024-04-25T10:25:36.168542+0000","last_active":"2024-04-25T10:26:18.696810+0000","last_peered":"2024-04-25T10:26:18.696810+0000","last_clean":"2024-04-25T10:26:18.696810+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:26:18.696810+0000","last_undegraded":"2024-04-25T10:26:18.696810+0000","last_fullsized":"2024-04-25T10:26:18.696810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.411567+0000","last_change":"2024-04-25T10:25:41.242053+0000","last_active":"2024-04-25T10:26:18.411567+0000","last_peered":"2024-04-25T10:26:18.411567+0000","last_clean":"2024-04-25T10:26:18.411567+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:26:18.411567+0000","last_undegraded":"2024-04-25T10:26:18.411567+0000","last_fullsized":"2024-04-25T10:26:18.411567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:05.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424358+0000","last_change":"2024-04-25T10:25:37.198952+0000","last_active":"2024-04-25T10:26:18.424358+0000","last_peered":"2024-04-25T10:26:18.424358+0000","last_clean":"2024-04-25T10:26:18.424358+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:26:18.424358+0000","last_undegraded":"2024-04-25T10:26:18.424358+0000","last_fullsized":"2024-04-25T10:26:18.424358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.707431+0000","last_change":"2024-04-25T10:25:36.179694+0000","last_active":"2024-04-25T10:26:18.707431+0000","last_peered":"2024-04-25T10:26:18.707431+0000","last_clean":"2024-04-25T10:26:18.707431+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:26:18.707431+0000","last_undegraded":"2024-04-25T10:26:18.707431+0000","last_fullsized":"2024-04-25T10:26:18.707431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484604+0000","last_change":"2024-04-25T10:25:41.251379+0000","last_active":"2024-04-25T10:26:18.484604+0000","last_peered":"2024-04-25T10:26:18.484604+0000","last_clean":"2024-04-25T10:26:18.484604+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:26:18.484604+0000","last_undegraded":"2024-04-25T10:26:18.484604+0000","last_fullsized":"2024-04-25T10:26:18.484604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:47.690188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.412626+0000","last_change":"2024-04-25T10:25:37.202390+0000","last_active":"2024-04-25T10:26:18.412626+0000","last_peered":"2024-04-25T10:26:18.412626+0000","last_clean":"2024-04-25T10:26:18.412626+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:26:18.412626+0000","last_undegraded":"2024-04-25T10:26:18.412626+0000","last_fullsized":"2024-04-25T10:26:18.412626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.378489+0000","last_change":"2024-04-25T10:25:36.154879+0000","last_active":"2024-04-25T10:26:19.378489+0000","last_peered":"2024-04-25T10:26:19.378489+0000","last_clean":"2024-04-25T10:26:19.378489+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:26:19.378489+0000","last_undegraded":"2024-04-25T10:26:19.378489+0000","last_fullsized":"2024-04-25T10:26:19.378489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696206+0000","last_change":"2024-04-25T10:25:41.239631+0000","last_active":"2024-04-25T10:26:18.696206+0000","last_peered":"2024-04-25T10:26:18.696206+0000","last_clean":"2024-04-25T10:26:18.696206+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:26:18.696206+0000","last_undegraded":"2024-04-25T10:26:18.696206+0000","last_fullsized":"2024-04-25T10:26:18.696206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.684623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484230+0000","last_change":"2024-04-25T10:25:37.181525+0000","last_active":"2024-04-25T10:26:18.484230+0000","last_peered":"2024-04-25T10:26:18.484230+0000","last_clean":"2024-04-25T10:26:18.484230+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:26:18.484230+0000","last_undegraded":"2024-04-25T10:26:18.484230+0000","last_fullsized":"2024-04-25T10:26:18.484230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.380319+0000","last_change":"2024-04-25T10:25:36.192797+0000","last_active":"2024-04-25T10:26:19.380319+0000","last_peered":"2024-04-25T10:26:19.380319+0000","last_clean":"2024-04-25T10:26:19.380319+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:26:19.380319+0000","last_undegraded":"2024-04-25T10:26:19.380319+0000","last_fullsized":"2024-04-25T10:26:19.380319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696218+0000","last_change":"2024-04-25T10:25:41.244618+0000","last_active":"2024-04-25T10:26:18.696218+0000","last_peered":"2024-04-25T10:26:18.696218+0000","last_clean":"2024-04-25T10:26:18.696218+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:26:18.696218+0000","last_undegraded":"2024-04-25T10:26:18.696218+0000","last_fullsized":"2024-04-25T10:26:18.696218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:13.625947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415549+0000","last_change":"2024-04-25T10:25:37.208984+0000","last_active":"2024-04-25T10:26:18.415549+0000","last_peered":"2024-04-25T10:26:18.415549+0000","last_clean":"2024-04-25T10:26:18.415549+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:26:18.415549+0000","last_undegraded":"2024-04-25T10:26:18.415549+0000","last_fullsized":"2024-04-25T10:26:18.415549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.413938+0000","last_change":"2024-04-25T10:25:36.185689+0000","last_active":"2024-04-25T10:26:18.413938+0000","last_peered":"2024-04-25T10:26:18.413938+0000","last_clean":"2024-04-25T10:26:18.413938+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:26:18.413938+0000","last_undegraded":"2024-04-25T10:26:18.413938+0000","last_fullsized":"2024-04-25T10:26:18.413938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:35.671970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406736+0000","last_change":"2024-04-25T10:25:41.247314+0000","last_active":"2024-04-25T10:26:18.406736+0000","last_peered":"2024-04-25T10:26:18.406736+0000","last_clean":"2024-04-25T10:26:18.406736+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:26:18.406736+0000","last_undegraded":"2024-04-25T10:26:18.406736+0000","last_fullsized":"2024-04-25T10:26:18.406736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406474+0000","last_change":"2024-04-25T10:25:37.193696+0000","last_active":"2024-04-25T10:26:18.406474+0000","last_peered":"2024-04-25T10:26:18.406474+0000","last_clean":"2024-04-25T10:26:18.406474+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:26:18.406474+0000","last_undegraded":"2024-04-25T10:26:18.406474+0000","last_fullsized":"2024-04-25T10:26:18.406474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.381011+0000","last_change":"2024-04-25T10:25:36.181843+0000","last_active":"2024-04-25T10:26:19.381011+0000","last_peered":"2024-04-25T10:26:19.381011+0000","last_clean":"2024-04-25T10:26:19.381011+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:26:19.381011+0000","last_undegraded":"2024-04-25T10:26:19.381011+0000","last_fullsized":"2024-04-25T10:26:19.381011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416172+0000","last_change":"2024-04-25T10:25:41.247061+0000","last_active":"2024-04-25T10:26:18.416172+0000","last_peered":"2024-04-25T10:26:18.416172+0000","last_clean":"2024-04-25T10:26:18.416172+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:26:18.416172+0000","last_undegraded":"2024-04-25T10:26:18.416172+0000","last_fullsized":"2024-04-25T10:26:18.416172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.491573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.704685+0000","last_change":"2024-04-25T10:25:37.185402+0000","last_active":"2024-04-25T10:26:18.704685+0000","last_peered":"2024-04-25T10:26:18.704685+0000","last_clean":"2024-04-25T10:26:18.704685+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:26:18.704685+0000","last_undegraded":"2024-04-25T10:26:18.704685+0000","last_fullsized":"2024-04-25T10:26:18.704685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'14","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:33.545534+0000","last_change":"2024-04-25T10:25:36.166998+0000","last_active":"2024-04-25T10:26:33.545534+0000","last_peered":"2024-04-25T10:26:33.545534+0000","last_clean":"2024-04-25T10:26:33.545534+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:26:33.545534+0000","last_undegraded":"2024-04-25T10:26:33.545534+0000","last_fullsized":"2024-04-25T10:26:33.545534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:25.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695909+0000","last_change":"2024-04-25T10:25:41.248522+0000","last_active":"2024-04-25T10:26:18.695909+0000","last_peered":"2024-04-25T10:26:18.695909+0000","last_clean":"2024-04-25T10:26:18.695909+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:26:18.695909+0000","last_undegraded":"2024-04-25T10:26:18.695909+0000","last_fullsized":"2024-04-25T10:26:18.695909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:51.139406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415590+0000","last_change":"2024-04-25T10:25:37.196588+0000","last_active":"2024-04-25T10:26:18.415590+0000","last_peered":"2024-04-25T10:26:18.415590+0000","last_clean":"2024-04-25T10:26:18.415590+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:26:18.415590+0000","last_undegraded":"2024-04-25T10:26:18.415590+0000","last_fullsized":"2024-04-25T10:26:18.415590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:00.003456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697119+0000","last_change":"2024-04-25T10:25:36.156630+0000","last_active":"2024-04-25T10:26:18.697119+0000","last_peered":"2024-04-25T10:26:18.697119+0000","last_clean":"2024-04-25T10:26:18.697119+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:26:18.697119+0000","last_undegraded":"2024-04-25T10:26:18.697119+0000","last_fullsized":"2024-04-25T10:26:18.697119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.708803+0000","last_change":"2024-04-25T10:26:18.708803+0000","last_active":"2024-04-25T10:26:18.708803+0000","last_peered":"2024-04-25T10:26:18.708803+0000","last_clean":"2024-04-25T10:26:18.708803+0000","last_became_active":"2024-04-25T10:26:18.708320+0000","last_became_peered":"2024-04-25T10:26:18.708320+0000","last_unstale":"2024-04-25T10:26:18.708803+0000","last_undegraded":"2024-04-25T10:26:18.708803+0000","last_fullsized":"2024-04-25T10:26:18.708803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:09.714453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,7],"acting":[2,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696354+0000","last_change":"2024-04-25T10:25:37.187575+0000","last_active":"2024-04-25T10:26:18.696354+0000","last_peered":"2024-04-25T10:26:18.696354+0000","last_clean":"2024-04-25T10:26:18.696354+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:26:18.696354+0000","last_undegraded":"2024-04-25T10:26:18.696354+0000","last_fullsized":"2024-04-25T10:26:18.696354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.706876+0000","last_change":"2024-04-25T10:25:36.183582+0000","last_active":"2024-04-25T10:26:18.706876+0000","last_peered":"2024-04-25T10:26:18.706876+0000","last_clean":"2024-04-25T10:26:18.706876+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:26:18.706876+0000","last_undegraded":"2024-04-25T10:26:18.706876+0000","last_fullsized":"2024-04-25T10:26:18.706876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.694984+0000","last_change":"2024-04-25T10:25:41.238488+0000","last_active":"2024-04-25T10:26:18.694984+0000","last_peered":"2024-04-25T10:26:18.694984+0000","last_clean":"2024-04-25T10:26:18.694984+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:26:18.694984+0000","last_undegraded":"2024-04-25T10:26:18.694984+0000","last_fullsized":"2024-04-25T10:26:18.694984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:05.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424244+0000","last_change":"2024-04-25T10:25:37.192707+0000","last_active":"2024-04-25T10:26:18.424244+0000","last_peered":"2024-04-25T10:26:18.424244+0000","last_clean":"2024-04-25T10:26:18.424244+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:26:18.424244+0000","last_undegraded":"2024-04-25T10:26:18.424244+0000","last_fullsized":"2024-04-25T10:26:18.424244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.488211+0000","last_change":"2024-04-25T10:25:36.173755+0000","last_active":"2024-04-25T10:26:18.488211+0000","last_peered":"2024-04-25T10:26:18.488211+0000","last_clean":"2024-04-25T10:26:18.488211+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:26:18.488211+0000","last_undegraded":"2024-04-25T10:26:18.488211+0000","last_fullsized":"2024-04-25T10:26:18.488211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696449+0000","last_change":"2024-04-25T10:25:41.248983+0000","last_active":"2024-04-25T10:26:18.696449+0000","last_peered":"2024-04-25T10:26:18.696449+0000","last_clean":"2024-04-25T10:26:18.696449+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:26:18.696449+0000","last_undegraded":"2024-04-25T10:26:18.696449+0000","last_fullsized":"2024-04-25T10:26:18.696449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.880608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696825+0000","last_change":"2024-04-25T10:25:41.246692+0000","last_active":"2024-04-25T10:26:18.696825+0000","last_peered":"2024-04-25T10:26:18.696825+0000","last_clean":"2024-04-25T10:26:18.696825+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:26:18.696825+0000","last_undegraded":"2024-04-25T10:26:18.696825+0000","last_fullsized":"2024-04-25T10:26:18.696825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:44.250576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696507+0000","last_change":"2024-04-25T10:25:37.178691+0000","last_active":"2024-04-25T10:26:18.696507+0000","last_peered":"2024-04-25T10:26:18.696507+0000","last_clean":"2024-04-25T10:26:18.696507+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:26:18.696507+0000","last_undegraded":"2024-04-25T10:26:18.696507+0000","last_fullsized":"2024-04-25T10:26:18.696507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.412013+0000","last_change":"2024-04-25T10:25:36.191338+0000","last_active":"2024-04-25T10:26:18.412013+0000","last_peered":"2024-04-25T10:26:18.412013+0000","last_clean":"2024-04-25T10:26:18.412013+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:26:18.412013+0000","last_undegraded":"2024-04-25T10:26:18.412013+0000","last_fullsized":"2024-04-25T10:26:18.412013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.417101+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:26:18.417101+0000","last_peered":"2024-04-25T10:26:18.417101+0000","last_clean":"2024-04-25T10:26:18.417101+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:26:18.417101+0000","last_undegraded":"2024-04-25T10:26:18.417101+0000","last_fullsized":"2024-04-25T10:26:18.417101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:21.254459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697789+0000","last_change":"2024-04-25T10:25:37.170931+0000","last_active":"2024-04-25T10:26:18.697789+0000","last_peered":"2024-04-25T10:26:18.697789+0000","last_clean":"2024-04-25T10:26:18.697789+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:26:18.697789+0000","last_undegraded":"2024-04-25T10:26:18.697789+0000","last_fullsized":"2024-04-25T10:26:18.697789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.377822+0000","last_change":"2024-04-25T10:25:36.173721+0000","last_active":"2024-04-25T10:26:19.377822+0000","last_peered":"2024-04-25T10:26:19.377822+0000","last_clean":"2024-04-25T10:26:19.377822+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:26:19.377822+0000","last_undegraded":"2024-04-25T10:26:19.377822+0000","last_fullsized":"2024-04-25T10:26:19.377822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:42.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.378676+0000","last_change":"2024-04-25T10:25:36.195499+0000","last_active":"2024-04-25T10:26:19.378676+0000","last_peered":"2024-04-25T10:26:19.378676+0000","last_clean":"2024-04-25T10:26:19.378676+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:26:19.378676+0000","last_undegraded":"2024-04-25T10:26:19.378676+0000","last_fullsized":"2024-04-25T10:26:19.378676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:05.600702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696309+0000","last_change":"2024-04-25T10:25:37.180896+0000","last_active":"2024-04-25T10:26:18.696309+0000","last_peered":"2024-04-25T10:26:18.696309+0000","last_clean":"2024-04-25T10:26:18.696309+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:26:18.696309+0000","last_undegraded":"2024-04-25T10:26:18.696309+0000","last_fullsized":"2024-04-25T10:26:18.696309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696525+0000","last_change":"2024-04-25T10:25:41.231793+0000","last_active":"2024-04-25T10:26:18.696525+0000","last_peered":"2024-04-25T10:26:18.696525+0000","last_clean":"2024-04-25T10:26:18.696525+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:26:18.696525+0000","last_undegraded":"2024-04-25T10:26:18.696525+0000","last_fullsized":"2024-04-25T10:26:18.696525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:33.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695714+0000","last_change":"2024-04-25T10:25:36.166742+0000","last_active":"2024-04-25T10:26:18.695714+0000","last_peered":"2024-04-25T10:26:18.695714+0000","last_clean":"2024-04-25T10:26:18.695714+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:26:18.695714+0000","last_undegraded":"2024-04-25T10:26:18.695714+0000","last_fullsized":"2024-04-25T10:26:18.695714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.485032+0000","last_change":"2024-04-25T10:25:37.185699+0000","last_active":"2024-04-25T10:26:18.485032+0000","last_peered":"2024-04-25T10:26:18.485032+0000","last_clean":"2024-04-25T10:26:18.485032+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:26:18.485032+0000","last_undegraded":"2024-04-25T10:26:18.485032+0000","last_fullsized":"2024-04-25T10:26:18.485032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696812+0000","last_change":"2024-04-25T10:25:41.258191+0000","last_active":"2024-04-25T10:26:18.696812+0000","last_peered":"2024-04-25T10:26:18.696812+0000","last_clean":"2024-04-25T10:26:18.696812+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:26:18.696812+0000","last_undegraded":"2024-04-25T10:26:18.696812+0000","last_fullsized":"2024-04-25T10:26:18.696812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.479785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423035+0000","last_change":"2024-04-25T10:25:37.183192+0000","last_active":"2024-04-25T10:26:18.423035+0000","last_peered":"2024-04-25T10:26:18.423035+0000","last_clean":"2024-04-25T10:26:18.423035+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:26:18.423035+0000","last_undegraded":"2024-04-25T10:26:18.423035+0000","last_fullsized":"2024-04-25T10:26:18.423035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695394+0000","last_change":"2024-04-25T10:25:37.180242+0000","last_active":"2024-04-25T10:26:18.695394+0000","last_peered":"2024-04-25T10:26:18.695394+0000","last_clean":"2024-04-25T10:26:18.695394+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:26:18.695394+0000","last_undegraded":"2024-04-25T10:26:18.695394+0000","last_fullsized":"2024-04-25T10:26:18.695394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.413509+0000","last_change":"2024-04-25T10:25:37.187312+0000","last_active":"2024-04-25T10:26:18.413509+0000","last_peered":"2024-04-25T10:26:18.413509+0000","last_clean":"2024-04-25T10:26:18.413509+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:26:18.413509+0000","last_undegraded":"2024-04-25T10:26:18.413509+0000","last_fullsized":"2024-04-25T10:26:18.413509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:22.595222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695638+0000","last_change":"2024-04-25T10:25:37.166351+0000","last_active":"2024-04-25T10:26:18.695638+0000","last_peered":"2024-04-25T10:26:18.695638+0000","last_clean":"2024-04-25T10:26:18.695638+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:26:18.695638+0000","last_undegraded":"2024-04-25T10:26:18.695638+0000","last_fullsized":"2024-04-25T10:26:18.695638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.699084+0000","last_change":"2024-04-25T10:26:18.699084+0000","last_active":"2024-04-25T10:26:18.699084+0000","last_peered":"2024-04-25T10:26:18.699084+0000","last_clean":"2024-04-25T10:26:18.699084+0000","last_became_active":"2024-04-25T10:26:18.698625+0000","last_became_peered":"2024-04-25T10:26:18.698625+0000","last_unstale":"2024-04-25T10:26:18.699084+0000","last_undegraded":"2024-04-25T10:26:18.699084+0000","last_fullsized":"2024-04-25T10:26:18.699084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:44.112645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406765+0000","last_change":"2024-04-25T10:25:37.170647+0000","last_active":"2024-04-25T10:26:18.406765+0000","last_peered":"2024-04-25T10:26:18.406765+0000","last_clean":"2024-04-25T10:26:18.406765+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:26:18.406765+0000","last_undegraded":"2024-04-25T10:26:18.406765+0000","last_fullsized":"2024-04-25T10:26:18.406765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423553+0000","last_change":"2024-04-25T10:25:37.196676+0000","last_active":"2024-04-25T10:26:18.423553+0000","last_peered":"2024-04-25T10:26:18.423553+0000","last_clean":"2024-04-25T10:26:18.423553+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:26:18.423553+0000","last_undegraded":"2024-04-25T10:26:18.423553+0000","last_fullsized":"2024-04-25T10:26:18.423553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696213+0000","last_change":"2024-04-25T10:25:37.186567+0000","last_active":"2024-04-25T10:26:18.696213+0000","last_peered":"2024-04-25T10:26:18.696213+0000","last_clean":"2024-04-25T10:26:18.696213+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:26:18.696213+0000","last_undegraded":"2024-04-25T10:26:18.696213+0000","last_fullsized":"2024-04-25T10:26:18.696213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.411895+0000","last_change":"2024-04-25T10:25:37.184887+0000","last_active":"2024-04-25T10:26:18.411895+0000","last_peered":"2024-04-25T10:26:18.411895+0000","last_clean":"2024-04-25T10:26:18.411895+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:26:18.411895+0000","last_undegraded":"2024-04-25T10:26:18.411895+0000","last_fullsized":"2024-04-25T10:26:18.411895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695758+0000","last_change":"2024-04-25T10:25:37.196649+0000","last_active":"2024-04-25T10:26:18.695758+0000","last_peered":"2024-04-25T10:26:18.695758+0000","last_clean":"2024-04-25T10:26:18.695758+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:26:18.695758+0000","last_undegraded":"2024-04-25T10:26:18.695758+0000","last_fullsized":"2024-04-25T10:26:18.695758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484928+0000","last_change":"2024-04-25T10:25:37.192093+0000","last_active":"2024-04-25T10:26:18.484928+0000","last_peered":"2024-04-25T10:26:18.484928+0000","last_clean":"2024-04-25T10:26:18.484928+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:26:18.484928+0000","last_undegraded":"2024-04-25T10:26:18.484928+0000","last_fullsized":"2024-04-25T10:26:18.484928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696179+0000","last_change":"2024-04-25T10:25:37.184014+0000","last_active":"2024-04-25T10:26:18.696179+0000","last_peered":"2024-04-25T10:26:18.696179+0000","last_clean":"2024-04-25T10:26:18.696179+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:26:18.696179+0000","last_undegraded":"2024-04-25T10:26:18.696179+0000","last_fullsized":"2024-04-25T10:26:18.696179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:52.810612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.711777+0000","last_change":"2024-04-25T10:25:37.187384+0000","last_active":"2024-04-25T10:26:18.711777+0000","last_peered":"2024-04-25T10:26:18.711777+0000","last_clean":"2024-04-25T10:26:18.711777+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:26:18.711777+0000","last_undegraded":"2024-04-25T10:26:18.711777+0000","last_fullsized":"2024-04-25T10:26:18.711777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416473+0000","last_change":"2024-04-25T10:25:37.195712+0000","last_active":"2024-04-25T10:26:18.416473+0000","last_peered":"2024-04-25T10:26:18.416473+0000","last_clean":"2024-04-25T10:26:18.416473+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:26:18.416473+0000","last_undegraded":"2024-04-25T10:26:18.416473+0000","last_fullsized":"2024-04-25T10:26:18.416473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:13.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697258+0000","last_change":"2024-04-25T10:25:37.198664+0000","last_active":"2024-04-25T10:26:18.697258+0000","last_peered":"2024-04-25T10:26:18.697258+0000","last_clean":"2024-04-25T10:26:18.697258+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:26:18.697258+0000","last_undegraded":"2024-04-25T10:26:18.697258+0000","last_fullsized":"2024-04-25T10:26:18.697258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.417210+0000","last_change":"2024-04-25T10:25:37.203174+0000","last_active":"2024-04-25T10:26:18.417210+0000","last_peered":"2024-04-25T10:26:18.417210+0000","last_clean":"2024-04-25T10:26:18.417210+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:26:18.417210+0000","last_undegraded":"2024-04-25T10:26:18.417210+0000","last_fullsized":"2024-04-25T10:26:18.417210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:05.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.411779+0000","last_change":"2024-04-25T10:25:37.199911+0000","last_active":"2024-04-25T10:26:18.411779+0000","last_peered":"2024-04-25T10:26:18.411779+0000","last_clean":"2024-04-25T10:26:18.411779+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:26:18.411779+0000","last_undegraded":"2024-04-25T10:26:18.411779+0000","last_fullsized":"2024-04-25T10:26:18.411779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:29.272654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695806+0000","last_change":"2024-04-25T10:25:37.177405+0000","last_active":"2024-04-25T10:26:18.695806+0000","last_peered":"2024-04-25T10:26:18.695806+0000","last_clean":"2024-04-25T10:26:18.695806+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:26:18.695806+0000","last_undegraded":"2024-04-25T10:26:18.695806+0000","last_fullsized":"2024-04-25T10:26:18.695806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406403+0000","last_change":"2024-04-25T10:25:37.167752+0000","last_active":"2024-04-25T10:26:18.406403+0000","last_peered":"2024-04-25T10:26:18.406403+0000","last_clean":"2024-04-25T10:26:18.406403+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:26:18.406403+0000","last_undegraded":"2024-04-25T10:26:18.406403+0000","last_fullsized":"2024-04-25T10:26:18.406403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406601+0000","last_change":"2024-04-25T10:25:37.180781+0000","last_active":"2024-04-25T10:26:18.406601+0000","last_peered":"2024-04-25T10:26:18.406601+0000","last_clean":"2024-04-25T10:26:18.406601+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:26:18.406601+0000","last_undegraded":"2024-04-25T10:26:18.406601+0000","last_fullsized":"2024-04-25T10:26:18.406601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.711666+0000","last_change":"2024-04-25T10:25:37.192759+0000","last_active":"2024-04-25T10:26:18.711666+0000","last_peered":"2024-04-25T10:26:18.711666+0000","last_clean":"2024-04-25T10:26:18.711666+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:26:18.711666+0000","last_undegraded":"2024-04-25T10:26:18.711666+0000","last_fullsized":"2024-04-25T10:26:18.711666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.704592+0000","last_change":"2024-04-25T10:25:37.195532+0000","last_active":"2024-04-25T10:26:18.704592+0000","last_peered":"2024-04-25T10:26:18.704592+0000","last_clean":"2024-04-25T10:26:18.704592+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:26:18.704592+0000","last_undegraded":"2024-04-25T10:26:18.704592+0000","last_fullsized":"2024-04-25T10:26:18.704592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.706704+0000","last_change":"2024-04-25T10:25:37.200331+0000","last_active":"2024-04-25T10:26:18.706704+0000","last_peered":"2024-04-25T10:26:18.706704+0000","last_clean":"2024-04-25T10:26:18.706704+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:26:18.706704+0000","last_undegraded":"2024-04-25T10:26:18.706704+0000","last_fullsized":"2024-04-25T10:26:18.706704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.488103+0000","last_change":"2024-04-25T10:25:37.194514+0000","last_active":"2024-04-25T10:26:18.488103+0000","last_peered":"2024-04-25T10:26:18.488103+0000","last_clean":"2024-04-25T10:26:18.488103+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:26:18.488103+0000","last_undegraded":"2024-04-25T10:26:18.488103+0000","last_fullsized":"2024-04-25T10:26:18.488103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697663+0000","last_change":"2024-04-25T10:25:37.177730+0000","last_active":"2024-04-25T10:26:18.697663+0000","last_peered":"2024-04-25T10:26:18.697663+0000","last_clean":"2024-04-25T10:26:18.697663+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:26:18.697663+0000","last_undegraded":"2024-04-25T10:26:18.697663+0000","last_fullsized":"2024-04-25T10:26:18.697663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.703366+0000","last_change":"2024-04-25T10:25:37.173419+0000","last_active":"2024-04-25T10:26:18.703366+0000","last_peered":"2024-04-25T10:26:18.703366+0000","last_clean":"2024-04-25T10:26:18.703366+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:26:18.703366+0000","last_undegraded":"2024-04-25T10:26:18.703366+0000","last_fullsized":"2024-04-25T10:26:18.703366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424758+0000","last_change":"2024-04-25T10:25:37.182871+0000","last_active":"2024-04-25T10:26:18.424758+0000","last_peered":"2024-04-25T10:26:18.424758+0000","last_clean":"2024-04-25T10:26:18.424758+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:26:18.424758+0000","last_undegraded":"2024-04-25T10:26:18.424758+0000","last_fullsized":"2024-04-25T10:26:18.424758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.704091+0000","last_change":"2024-04-25T10:25:37.173983+0000","last_active":"2024-04-25T10:26:18.704091+0000","last_peered":"2024-04-25T10:26:18.704091+0000","last_clean":"2024-04-25T10:26:18.704091+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:26:18.704091+0000","last_undegraded":"2024-04-25T10:26:18.704091+0000","last_fullsized":"2024-04-25T10:26:18.704091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423770+0000","last_change":"2024-04-25T10:25:37.182178+0000","last_active":"2024-04-25T10:26:18.423770+0000","last_peered":"2024-04-25T10:26:18.423770+0000","last_clean":"2024-04-25T10:26:18.423770+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:26:18.423770+0000","last_undegraded":"2024-04-25T10:26:18.423770+0000","last_fullsized":"2024-04-25T10:26:18.423770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696072+0000","last_change":"2024-04-25T10:25:37.170383+0000","last_active":"2024-04-25T10:26:18.696072+0000","last_peered":"2024-04-25T10:26:18.696072+0000","last_clean":"2024-04-25T10:26:18.696072+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:26:18.696072+0000","last_undegraded":"2024-04-25T10:26:18.696072+0000","last_fullsized":"2024-04-25T10:26:18.696072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696055+0000","last_change":"2024-04-25T10:25:37.167687+0000","last_active":"2024-04-25T10:26:18.696055+0000","last_peered":"2024-04-25T10:26:18.696055+0000","last_clean":"2024-04-25T10:26:18.696055+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:26:18.696055+0000","last_undegraded":"2024-04-25T10:26:18.696055+0000","last_fullsized":"2024-04-25T10:26:18.696055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.707196+0000","last_change":"2024-04-25T10:25:37.196591+0000","last_active":"2024-04-25T10:26:18.707196+0000","last_peered":"2024-04-25T10:26:18.707196+0000","last_clean":"2024-04-25T10:26:18.707196+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:26:18.707196+0000","last_undegraded":"2024-04-25T10:26:18.707196+0000","last_fullsized":"2024-04-25T10:26:18.707196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":115122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":705090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":119586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":704446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":115234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:26:41.512 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-04-25T10:26:41.512 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:26:41.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.829+0000 7f5f88600640 1 Processor -- start 2024-04-25T10:26:41.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.829+0000 7f5f88600640 1 -- start start 2024-04-25T10:26:41.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.831+0000 7f5f88600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5f80073160 0x7f5f800c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.831+0000 7f5f88600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f800cdde0 0x7f5f800ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.831+0000 7f5f88600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f80158010 con 0x7f5f8015b2c0 2024-04-25T10:26:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.831+0000 7f5f88600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5f80074970 con 0x7f5f80073160 2024-04-25T10:26:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.831+0000 7f5f88600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5f800c8600 con 0x7f5f800cdde0 2024-04-25T10:26:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.831+0000 7f5f85200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5f80073160 0x7f5f800c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.831+0000 7f5f85200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5f80073160 0x7f5f800c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53914/0 (socket says 172.21.15.19:53914) 2024-04-25T10:26:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.831+0000 7f5f85200640 1 -- 172.21.15.19:0/3289043385 learned_addr learned my addr 172.21.15.19:0/3289043385 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.831+0000 7f5f85c00640 1 --1- 172.21.15.19:0/3289043385 >> v1:172.21.15.19:6789/0 conn(0x7f5f8015b2c0 0x7f5f8015e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39636/0 (socket says 172.21.15.19:39636) 2024-04-25T10:26:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.831+0000 7f5f86600640 1 --2- 172.21.15.19:0/3289043385 >> v2:172.21.15.112:3300/0 conn(0x7f5f800cdde0 0x7f5f800ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.832+0000 7f5f85200640 1 -- 172.21.15.19:0/3289043385 >> v2:172.21.15.112:3300/0 conn(0x7f5f800cdde0 msgr2=0x7f5f800ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.832+0000 7f5f85200640 1 --2- 172.21.15.19:0/3289043385 >> v2:172.21.15.112:3300/0 conn(0x7f5f800cdde0 0x7f5f800ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.832+0000 7f5f85200640 1 -- 172.21.15.19:0/3289043385 >> v1:172.21.15.19:6789/0 conn(0x7f5f8015b2c0 legacy=0x7f5f8015e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:41.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.832+0000 7f5f85200640 1 -- 172.21.15.19:0/3289043385 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f800c88e0 con 0x7f5f80073160 2024-04-25T10:26:41.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.832+0000 7f5f7fe00640 1 -- 172.21.15.19:0/3289043385 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744671214 0 0) 0x7f5f80158010 con 0x7f5f8015b2c0 2024-04-25T10:26:41.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.832+0000 7f5f86600640 1 --2- 172.21.15.19:0/3289043385 >> v2:172.21.15.112:3300/0 conn(0x7f5f800cdde0 0x7f5f800ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:26:41.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.833+0000 7f5f85200640 1 --2- 172.21.15.19:0/3289043385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f80073160 0x7f5f800c9810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f80070ca0 tx=0x7f5f6c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227e1c2300dab1cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:41.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.833+0000 7f5f7fe00640 1 -- 172.21.15.19:0/3289043385 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c037070 con 0x7f5f80073160 2024-04-25T10:26:41.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.833+0000 7f5f7fe00640 1 -- 172.21.15.19:0/3289043385 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f6c02ae50 con 0x7f5f80073160 2024-04-25T10:26:41.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.833+0000 7f5f7fe00640 1 -- 172.21.15.19:0/3289043385 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c032860 con 0x7f5f80073160 2024-04-25T10:26:41.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.834+0000 7f5f88600640 1 -- 172.21.15.19:0/3289043385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f80073160 msgr2=0x7f5f800c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:41.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.834+0000 7f5f88600640 1 --2- 172.21.15.19:0/3289043385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f80073160 0x7f5f800c9810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f80070ca0 tx=0x7f5f6c02a300 comp rx=0 tx=0).stop 2024-04-25T10:26:41.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.834+0000 7f5f88600640 1 -- 172.21.15.19:0/3289043385 shutdown_connections 2024-04-25T10:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.834+0000 7f5f88600640 1 --2- 172.21.15.19:0/3289043385 >> v2:172.21.15.112:3300/0 conn(0x7f5f800cdde0 0x7f5f800ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.834+0000 7f5f88600640 1 --2- 172.21.15.19:0/3289043385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f80073160 0x7f5f800c9810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.834+0000 7f5f88600640 1 -- 172.21.15.19:0/3289043385 >> 172.21.15.19:0/3289043385 conn(0x7f5f8006f1f0 msgr2=0x7f5f8006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.834+0000 7f5f88600640 1 -- 172.21.15.19:0/3289043385 shutdown_connections 2024-04-25T10:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.834+0000 7f5f88600640 1 -- 172.21.15.19:0/3289043385 wait complete. 2024-04-25T10:26:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.837+0000 7f5f88600640 1 Processor -- start 2024-04-25T10:26:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.837+0000 7f5f88600640 1 -- start start 2024-04-25T10:26:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.838+0000 7f5f88600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f80073160 0x7f5f800af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.838+0000 7f5f88600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f800cdde0 0x7f5f8014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.838+0000 7f5f88600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f80152e20 0x7f5f8015ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.838+0000 7f5f88600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8006d4c0 con 0x7f5f800cdde0 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.838+0000 7f5f88600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8015a580 con 0x7f5f80152e20 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.838+0000 7f5f88600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5f8015e930 con 0x7f5f80073160 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.838+0000 7f5f85200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f800cdde0 0x7f5f8014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.838+0000 7f5f85200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f800cdde0 0x7f5f8014f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53916/0 (socket says 172.21.15.19:53916) 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.838+0000 7f5f85200640 1 -- 172.21.15.19:0/697307651 learned_addr learned my addr 172.21.15.19:0/697307651 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.838+0000 7f5f86600640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f80152e20 0x7f5f8015ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.838+0000 7f5f85c00640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f80073160 0x7f5f800af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.839+0000 7f5f86600640 1 -- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f80073160 msgr2=0x7f5f800af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.839+0000 7f5f86600640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f80073160 0x7f5f800af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.839+0000 7f5f86600640 1 -- 172.21.15.19:0/697307651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f800cdde0 msgr2=0x7f5f8014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.839+0000 7f5f86600640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f800cdde0 0x7f5f8014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.839+0000 7f5f86600640 1 -- 172.21.15.19:0/697307651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f800afa10 con 0x7f5f80152e20 2024-04-25T10:26:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.839+0000 7f5f85200640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f800cdde0 0x7f5f8014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.839+0000 7f5f86600640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f80152e20 0x7f5f8015ce80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5f78007d10 tx=0x7f5f7800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.839+0000 7f5f7d600640 1 -- 172.21.15.19:0/697307651 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7801a070 con 0x7f5f80152e20 2024-04-25T10:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.839+0000 7f5f7d600640 1 -- 172.21.15.19:0/697307651 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f78015400 con 0x7f5f80152e20 2024-04-25T10:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.840+0000 7f5f7d600640 1 -- 172.21.15.19:0/697307651 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f780157f0 con 0x7f5f80152e20 2024-04-25T10:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.840+0000 7f5f88600640 1 -- 172.21.15.19:0/697307651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f801f5bc0 con 0x7f5f80152e20 2024-04-25T10:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.840+0000 7f5f88600640 1 -- 172.21.15.19:0/697307651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f801f6180 con 0x7f5f80152e20 2024-04-25T10:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.841+0000 7f5f88600640 1 -- 172.21.15.19:0/697307651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f8015e6d0 con 0x7f5f80152e20 2024-04-25T10:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.842+0000 7f5f7d600640 1 -- 172.21.15.19:0/697307651 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5f7801d070 con 0x7f5f80152e20 2024-04-25T10:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.843+0000 7f5f7d600640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5f600744b0 0x7f5f600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.843+0000 7f5f7d600640 1 -- 172.21.15.19:0/697307651 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f5f78095780 con 0x7f5f80152e20 2024-04-25T10:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.843+0000 7f5f85c00640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5f600744b0 0x7f5f600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.844+0000 7f5f85c00640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5f600744b0 0x7f5f600769c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5f74007fd0 tx=0x7f5f74007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:41.847+0000 7f5f7d600640 1 -- 172.21.15.19:0/697307651 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5f8015e6d0 con 0x7f5f80152e20 2024-04-25T10:26:42.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.041+0000 7f5f88600640 1 -- 172.21.15.19:0/697307651 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f80076520 con 0x7f5f600744b0 2024-04-25T10:26:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.050+0000 7f5f7d600640 1 -- 172.21.15.19:0/697307651 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332581 (secure 0 0 0) 0x7f5f80076520 con 0x7f5f600744b0 2024-04-25T10:26:42.058 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:42.060 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:26:42.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.056+0000 7f5f88600640 1 -- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5f600744b0 msgr2=0x7f5f600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.056+0000 7f5f88600640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5f600744b0 0x7f5f600769c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5f74007fd0 tx=0x7f5f74007de0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.056+0000 7f5f88600640 1 -- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f80152e20 msgr2=0x7f5f8015ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.056+0000 7f5f88600640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f80152e20 0x7f5f8015ce80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5f78007d10 tx=0x7f5f7800d4a0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.056+0000 7f5f88600640 1 -- 172.21.15.19:0/697307651 shutdown_connections 2024-04-25T10:26:42.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.056+0000 7f5f88600640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f80152e20 0x7f5f8015ce80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.056+0000 7f5f88600640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f800cdde0 0x7f5f8014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.056+0000 7f5f88600640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5f600744b0 0x7f5f600769c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.056+0000 7f5f88600640 1 --2- 172.21.15.19:0/697307651 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f80073160 0x7f5f800af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.056+0000 7f5f88600640 1 -- 172.21.15.19:0/697307651 >> 172.21.15.19:0/697307651 conn(0x7f5f8006f1f0 msgr2=0x7f5f80158470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:42.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.057+0000 7f5f88600640 1 -- 172.21.15.19:0/697307651 shutdown_connections 2024-04-25T10:26:42.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.057+0000 7f5f88600640 1 -- 172.21.15.19:0/697307651 wait complete. 2024-04-25T10:26:42.082 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-04-25T10:26:40.594993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":232,"num_write_kb":1673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219632,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755088,"statfs":{"total":773094113280,"available":772869210112,"internally_reserved":0,"allocated":3579904,"data_stored":2107500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":258,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003316"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.379764+0000","last_change":"2024-04-25T10:25:36.182605+0000","last_active":"2024-04-25T10:26:19.379764+0000","last_peered":"2024-04-25T10:26:19.379764+0000","last_clean":"2024-04-25T10:26:19.379764+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:26:19.379764+0000","last_undegraded":"2024-04-25T10:26:19.379764+0000","last_fullsized":"2024-04-25T10:26:19.379764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696210+0000","last_change":"2024-04-25T10:25:37.199467+0000","last_active":"2024-04-25T10:26:18.696210+0000","last_peered":"2024-04-25T10:26:18.696210+0000","last_clean":"2024-04-25T10:26:18.696210+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:26:18.696210+0000","last_undegraded":"2024-04-25T10:26:18.696210+0000","last_fullsized":"2024-04-25T10:26:18.696210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695264+0000","last_change":"2024-04-25T10:25:41.234657+0000","last_active":"2024-04-25T10:26:18.695264+0000","last_peered":"2024-04-25T10:26:18.695264+0000","last_clean":"2024-04-25T10:26:18.695264+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:26:18.695264+0000","last_undegraded":"2024-04-25T10:26:18.695264+0000","last_fullsized":"2024-04-25T10:26:18.695264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:56.869031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696414+0000","last_change":"2024-04-25T10:25:36.166548+0000","last_active":"2024-04-25T10:26:18.696414+0000","last_peered":"2024-04-25T10:26:18.696414+0000","last_clean":"2024-04-25T10:26:18.696414+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:26:18.696414+0000","last_undegraded":"2024-04-25T10:26:18.696414+0000","last_fullsized":"2024-04-25T10:26:18.696414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696349+0000","last_change":"2024-04-25T10:25:37.179746+0000","last_active":"2024-04-25T10:26:18.696349+0000","last_peered":"2024-04-25T10:26:18.696349+0000","last_clean":"2024-04-25T10:26:18.696349+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:26:18.696349+0000","last_undegraded":"2024-04-25T10:26:18.696349+0000","last_fullsized":"2024-04-25T10:26:18.696349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.422898+0000","last_change":"2024-04-25T10:25:41.232828+0000","last_active":"2024-04-25T10:26:18.422898+0000","last_peered":"2024-04-25T10:26:18.422898+0000","last_clean":"2024-04-25T10:26:18.422898+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:26:18.422898+0000","last_undegraded":"2024-04-25T10:26:18.422898+0000","last_fullsized":"2024-04-25T10:26:18.422898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:01.782881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.383000+0000","last_change":"2024-04-25T10:25:36.190035+0000","last_active":"2024-04-25T10:26:19.383000+0000","last_peered":"2024-04-25T10:26:19.383000+0000","last_clean":"2024-04-25T10:26:19.383000+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:26:19.383000+0000","last_undegraded":"2024-04-25T10:26:19.383000+0000","last_fullsized":"2024-04-25T10:26:19.383000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.483844+0000","last_change":"2024-04-25T10:25:37.191742+0000","last_active":"2024-04-25T10:26:18.483844+0000","last_peered":"2024-04-25T10:26:18.483844+0000","last_clean":"2024-04-25T10:26:18.483844+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:26:18.483844+0000","last_undegraded":"2024-04-25T10:26:18.483844+0000","last_fullsized":"2024-04-25T10:26:18.483844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424882+0000","last_change":"2024-04-25T10:25:41.242444+0000","last_active":"2024-04-25T10:26:18.424882+0000","last_peered":"2024-04-25T10:26:18.424882+0000","last_clean":"2024-04-25T10:26:18.424882+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:26:18.424882+0000","last_undegraded":"2024-04-25T10:26:18.424882+0000","last_fullsized":"2024-04-25T10:26:18.424882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.712056+0000","last_change":"2024-04-25T10:25:36.190527+0000","last_active":"2024-04-25T10:26:18.712056+0000","last_peered":"2024-04-25T10:26:18.712056+0000","last_clean":"2024-04-25T10:26:18.712056+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:26:18.712056+0000","last_undegraded":"2024-04-25T10:26:18.712056+0000","last_fullsized":"2024-04-25T10:26:18.712056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416286+0000","last_change":"2024-04-25T10:25:37.204468+0000","last_active":"2024-04-25T10:26:18.416286+0000","last_peered":"2024-04-25T10:26:18.416286+0000","last_clean":"2024-04-25T10:26:18.416286+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:26:18.416286+0000","last_undegraded":"2024-04-25T10:26:18.416286+0000","last_fullsized":"2024-04-25T10:26:18.416286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423623+0000","last_change":"2024-04-25T10:25:41.236518+0000","last_active":"2024-04-25T10:26:18.423623+0000","last_peered":"2024-04-25T10:26:18.423623+0000","last_clean":"2024-04-25T10:26:18.423623+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:26:18.423623+0000","last_undegraded":"2024-04-25T10:26:18.423623+0000","last_fullsized":"2024-04-25T10:26:18.423623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.413629+0000","last_change":"2024-04-25T10:25:37.194114+0000","last_active":"2024-04-25T10:26:18.413629+0000","last_peered":"2024-04-25T10:26:18.413629+0000","last_clean":"2024-04-25T10:26:18.413629+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:26:18.413629+0000","last_undegraded":"2024-04-25T10:26:18.413629+0000","last_fullsized":"2024-04-25T10:26:18.413629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:40.192156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415768+0000","last_change":"2024-04-25T10:25:36.188266+0000","last_active":"2024-04-25T10:26:18.415768+0000","last_peered":"2024-04-25T10:26:18.415768+0000","last_clean":"2024-04-25T10:26:18.415768+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:26:18.415768+0000","last_undegraded":"2024-04-25T10:26:18.415768+0000","last_fullsized":"2024-04-25T10:26:18.415768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.845953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415983+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:26:18.415983+0000","last_peered":"2024-04-25T10:26:18.415983+0000","last_clean":"2024-04-25T10:26:18.415983+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:26:18.415983+0000","last_undegraded":"2024-04-25T10:26:18.415983+0000","last_fullsized":"2024-04-25T10:26:18.415983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:13.684019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697433+0000","last_change":"2024-04-25T10:25:37.166002+0000","last_active":"2024-04-25T10:26:18.697433+0000","last_peered":"2024-04-25T10:26:18.697433+0000","last_clean":"2024-04-25T10:26:18.697433+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:26:18.697433+0000","last_undegraded":"2024-04-25T10:26:18.697433+0000","last_fullsized":"2024-04-25T10:26:18.697433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406603+0000","last_change":"2024-04-25T10:25:36.168204+0000","last_active":"2024-04-25T10:26:18.406603+0000","last_peered":"2024-04-25T10:26:18.406603+0000","last_clean":"2024-04-25T10:26:18.406603+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:26:18.406603+0000","last_undegraded":"2024-04-25T10:26:18.406603+0000","last_fullsized":"2024-04-25T10:26:18.406603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.907635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.703010+0000","last_change":"2024-04-25T10:25:41.257264+0000","last_active":"2024-04-25T10:26:18.703010+0000","last_peered":"2024-04-25T10:26:18.703010+0000","last_clean":"2024-04-25T10:26:18.703010+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:26:18.703010+0000","last_undegraded":"2024-04-25T10:26:18.703010+0000","last_fullsized":"2024-04-25T10:26:18.703010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695190+0000","last_change":"2024-04-25T10:25:37.158884+0000","last_active":"2024-04-25T10:26:18.695190+0000","last_peered":"2024-04-25T10:26:18.695190+0000","last_clean":"2024-04-25T10:26:18.695190+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:26:18.695190+0000","last_undegraded":"2024-04-25T10:26:18.695190+0000","last_fullsized":"2024-04-25T10:26:18.695190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696653+0000","last_change":"2024-04-25T10:25:36.173499+0000","last_active":"2024-04-25T10:26:18.696653+0000","last_peered":"2024-04-25T10:26:18.696653+0000","last_clean":"2024-04-25T10:26:18.696653+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:26:18.696653+0000","last_undegraded":"2024-04-25T10:26:18.696653+0000","last_fullsized":"2024-04-25T10:26:18.696653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697166+0000","last_change":"2024-04-25T10:25:41.239990+0000","last_active":"2024-04-25T10:26:18.697166+0000","last_peered":"2024-04-25T10:26:18.697166+0000","last_clean":"2024-04-25T10:26:18.697166+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:26:18.697166+0000","last_undegraded":"2024-04-25T10:26:18.697166+0000","last_fullsized":"2024-04-25T10:26:18.697166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:15.055786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.412739+0000","last_change":"2024-04-25T10:25:37.193560+0000","last_active":"2024-04-25T10:26:18.412739+0000","last_peered":"2024-04-25T10:26:18.412739+0000","last_clean":"2024-04-25T10:26:18.412739+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:26:18.412739+0000","last_undegraded":"2024-04-25T10:26:18.412739+0000","last_fullsized":"2024-04-25T10:26:18.412739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.702410+0000","last_change":"2024-04-25T10:25:36.174077+0000","last_active":"2024-04-25T10:26:18.702410+0000","last_peered":"2024-04-25T10:26:18.702410+0000","last_clean":"2024-04-25T10:26:18.702410+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:26:18.702410+0000","last_undegraded":"2024-04-25T10:26:18.702410+0000","last_fullsized":"2024-04-25T10:26:18.702410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423418+0000","last_change":"2024-04-25T10:25:41.262158+0000","last_active":"2024-04-25T10:26:18.423418+0000","last_peered":"2024-04-25T10:26:18.423418+0000","last_clean":"2024-04-25T10:26:18.423418+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:26:18.423418+0000","last_undegraded":"2024-04-25T10:26:18.423418+0000","last_fullsized":"2024-04-25T10:26:18.423418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696683+0000","last_change":"2024-04-25T10:25:37.159876+0000","last_active":"2024-04-25T10:26:18.696683+0000","last_peered":"2024-04-25T10:26:18.696683+0000","last_clean":"2024-04-25T10:26:18.696683+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:26:18.696683+0000","last_undegraded":"2024-04-25T10:26:18.696683+0000","last_fullsized":"2024-04-25T10:26:18.696683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.417634+0000","last_change":"2024-04-25T10:25:36.194275+0000","last_active":"2024-04-25T10:26:18.417634+0000","last_peered":"2024-04-25T10:26:18.417634+0000","last_clean":"2024-04-25T10:26:18.417634+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:26:18.417634+0000","last_undegraded":"2024-04-25T10:26:18.417634+0000","last_fullsized":"2024-04-25T10:26:18.417634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423327+0000","last_change":"2024-04-25T10:25:41.261185+0000","last_active":"2024-04-25T10:26:18.423327+0000","last_peered":"2024-04-25T10:26:18.423327+0000","last_clean":"2024-04-25T10:26:18.423327+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:26:18.423327+0000","last_undegraded":"2024-04-25T10:26:18.423327+0000","last_fullsized":"2024-04-25T10:26:18.423327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696908+0000","last_change":"2024-04-25T10:25:37.165436+0000","last_active":"2024-04-25T10:26:18.696908+0000","last_peered":"2024-04-25T10:26:18.696908+0000","last_clean":"2024-04-25T10:26:18.696908+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:26:18.696908+0000","last_undegraded":"2024-04-25T10:26:18.696908+0000","last_fullsized":"2024-04-25T10:26:18.696908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.377939+0000","last_change":"2024-04-25T10:25:36.181966+0000","last_active":"2024-04-25T10:26:19.377939+0000","last_peered":"2024-04-25T10:26:19.377939+0000","last_clean":"2024-04-25T10:26:19.377939+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:26:19.377939+0000","last_undegraded":"2024-04-25T10:26:19.377939+0000","last_fullsized":"2024-04-25T10:26:19.377939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.694989+0000","last_change":"2024-04-25T10:25:41.246715+0000","last_active":"2024-04-25T10:26:18.694989+0000","last_peered":"2024-04-25T10:26:18.694989+0000","last_clean":"2024-04-25T10:26:18.694989+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:26:18.694989+0000","last_undegraded":"2024-04-25T10:26:18.694989+0000","last_fullsized":"2024-04-25T10:26:18.694989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:03.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406988+0000","last_change":"2024-04-25T10:25:37.170738+0000","last_active":"2024-04-25T10:26:18.406988+0000","last_peered":"2024-04-25T10:26:18.406988+0000","last_clean":"2024-04-25T10:26:18.406988+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:26:18.406988+0000","last_undegraded":"2024-04-25T10:26:18.406988+0000","last_fullsized":"2024-04-25T10:26:18.406988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:43.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416523+0000","last_change":"2024-04-25T10:25:36.186052+0000","last_active":"2024-04-25T10:26:18.416523+0000","last_peered":"2024-04-25T10:26:18.416523+0000","last_clean":"2024-04-25T10:26:18.416523+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:26:18.416523+0000","last_undegraded":"2024-04-25T10:26:18.416523+0000","last_fullsized":"2024-04-25T10:26:18.416523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:42.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406382+0000","last_change":"2024-04-25T10:25:41.244909+0000","last_active":"2024-04-25T10:26:18.406382+0000","last_peered":"2024-04-25T10:26:18.406382+0000","last_clean":"2024-04-25T10:26:18.406382+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:26:18.406382+0000","last_undegraded":"2024-04-25T10:26:18.406382+0000","last_fullsized":"2024-04-25T10:26:18.406382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424110+0000","last_change":"2024-04-25T10:25:37.181614+0000","last_active":"2024-04-25T10:26:18.424110+0000","last_peered":"2024-04-25T10:26:18.424110+0000","last_clean":"2024-04-25T10:26:18.424110+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:26:18.424110+0000","last_undegraded":"2024-04-25T10:26:18.424110+0000","last_fullsized":"2024-04-25T10:26:18.424110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695773+0000","last_change":"2024-04-25T10:25:36.166395+0000","last_active":"2024-04-25T10:26:18.695773+0000","last_peered":"2024-04-25T10:26:18.695773+0000","last_clean":"2024-04-25T10:26:18.695773+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:26:18.695773+0000","last_undegraded":"2024-04-25T10:26:18.695773+0000","last_fullsized":"2024-04-25T10:26:18.695773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406299+0000","last_change":"2024-04-25T10:25:41.237175+0000","last_active":"2024-04-25T10:26:18.406299+0000","last_peered":"2024-04-25T10:26:18.406299+0000","last_clean":"2024-04-25T10:26:18.406299+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:26:18.406299+0000","last_undegraded":"2024-04-25T10:26:18.406299+0000","last_fullsized":"2024-04-25T10:26:18.406299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.703996+0000","last_change":"2024-04-25T10:25:37.192638+0000","last_active":"2024-04-25T10:26:18.703996+0000","last_peered":"2024-04-25T10:26:18.703996+0000","last_clean":"2024-04-25T10:26:18.703996+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:26:18.703996+0000","last_undegraded":"2024-04-25T10:26:18.703996+0000","last_fullsized":"2024-04-25T10:26:18.703996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.414105+0000","last_change":"2024-04-25T10:25:36.182126+0000","last_active":"2024-04-25T10:26:18.414105+0000","last_peered":"2024-04-25T10:26:18.414105+0000","last_clean":"2024-04-25T10:26:18.414105+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:26:18.414105+0000","last_undegraded":"2024-04-25T10:26:18.414105+0000","last_fullsized":"2024-04-25T10:26:18.414105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:50.385012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406660+0000","last_change":"2024-04-25T10:25:41.247504+0000","last_active":"2024-04-25T10:26:18.406660+0000","last_peered":"2024-04-25T10:26:18.406660+0000","last_clean":"2024-04-25T10:26:18.406660+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:26:18.406660+0000","last_undegraded":"2024-04-25T10:26:18.406660+0000","last_fullsized":"2024-04-25T10:26:18.406660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697789+0000","last_change":"2024-04-25T10:25:37.171962+0000","last_active":"2024-04-25T10:26:18.697789+0000","last_peered":"2024-04-25T10:26:18.697789+0000","last_clean":"2024-04-25T10:26:18.697789+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:26:18.697789+0000","last_undegraded":"2024-04-25T10:26:18.697789+0000","last_fullsized":"2024-04-25T10:26:18.697789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.376707+0000","last_change":"2024-04-25T10:25:36.167914+0000","last_active":"2024-04-25T10:26:19.376707+0000","last_peered":"2024-04-25T10:26:19.376707+0000","last_clean":"2024-04-25T10:26:19.376707+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:26:19.376707+0000","last_undegraded":"2024-04-25T10:26:19.376707+0000","last_fullsized":"2024-04-25T10:26:19.376707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406781+0000","last_change":"2024-04-25T10:25:41.250414+0000","last_active":"2024-04-25T10:26:18.406781+0000","last_peered":"2024-04-25T10:26:18.406781+0000","last_clean":"2024-04-25T10:26:18.406781+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:26:18.406781+0000","last_undegraded":"2024-04-25T10:26:18.406781+0000","last_fullsized":"2024-04-25T10:26:18.406781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406299+0000","last_change":"2024-04-25T10:25:37.179610+0000","last_active":"2024-04-25T10:26:18.406299+0000","last_peered":"2024-04-25T10:26:18.406299+0000","last_clean":"2024-04-25T10:26:18.406299+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:26:18.406299+0000","last_undegraded":"2024-04-25T10:26:18.406299+0000","last_fullsized":"2024-04-25T10:26:18.406299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:22.862181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.377997+0000","last_change":"2024-04-25T10:25:36.187683+0000","last_active":"2024-04-25T10:26:19.377997+0000","last_peered":"2024-04-25T10:26:19.377997+0000","last_clean":"2024-04-25T10:26:19.377997+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:26:19.377997+0000","last_undegraded":"2024-04-25T10:26:19.377997+0000","last_fullsized":"2024-04-25T10:26:19.377997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696093+0000","last_change":"2024-04-25T10:25:41.239687+0000","last_active":"2024-04-25T10:26:18.696093+0000","last_peered":"2024-04-25T10:26:18.696093+0000","last_clean":"2024-04-25T10:26:18.696093+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:26:18.696093+0000","last_undegraded":"2024-04-25T10:26:18.696093+0000","last_fullsized":"2024-04-25T10:26:18.696093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.061875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696051+0000","last_change":"2024-04-25T10:25:37.172981+0000","last_active":"2024-04-25T10:26:18.696051+0000","last_peered":"2024-04-25T10:26:18.696051+0000","last_clean":"2024-04-25T10:26:18.696051+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:26:18.696051+0000","last_undegraded":"2024-04-25T10:26:18.696051+0000","last_fullsized":"2024-04-25T10:26:18.696051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415945+0000","last_change":"2024-04-25T10:25:36.186586+0000","last_active":"2024-04-25T10:26:18.415945+0000","last_peered":"2024-04-25T10:26:18.415945+0000","last_clean":"2024-04-25T10:26:18.415945+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:26:18.415945+0000","last_undegraded":"2024-04-25T10:26:18.415945+0000","last_fullsized":"2024-04-25T10:26:18.415945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:00.696356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":122,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484332+0000","last_change":"2024-04-25T10:25:25.811918+0000","last_active":"2024-04-25T10:26:18.484332+0000","last_peered":"2024-04-25T10:26:18.484332+0000","last_clean":"2024-04-25T10:26:18.484332+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:26:18.484332+0000","last_undegraded":"2024-04-25T10:26:18.484332+0000","last_fullsized":"2024-04-25T10:26:18.484332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_clean_scrub_stamp":"2024-04-25T10:25:24.774439+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:46.603072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416400+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:26:18.416400+0000","last_peered":"2024-04-25T10:26:18.416400+0000","last_clean":"2024-04-25T10:26:18.416400+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:26:18.416400+0000","last_undegraded":"2024-04-25T10:26:18.416400+0000","last_fullsized":"2024-04-25T10:26:18.416400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:56.121358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416362+0000","last_change":"2024-04-25T10:25:37.187670+0000","last_active":"2024-04-25T10:26:18.416362+0000","last_peered":"2024-04-25T10:26:18.416362+0000","last_clean":"2024-04-25T10:26:18.416362+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:26:18.416362+0000","last_undegraded":"2024-04-25T10:26:18.416362+0000","last_fullsized":"2024-04-25T10:26:18.416362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:09.567527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.378267+0000","last_change":"2024-04-25T10:25:36.190434+0000","last_active":"2024-04-25T10:26:19.378267+0000","last_peered":"2024-04-25T10:26:19.378267+0000","last_clean":"2024-04-25T10:26:19.378267+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:26:19.378267+0000","last_undegraded":"2024-04-25T10:26:19.378267+0000","last_fullsized":"2024-04-25T10:26:19.378267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424597+0000","last_change":"2024-04-25T10:25:41.249210+0000","last_active":"2024-04-25T10:26:18.424597+0000","last_peered":"2024-04-25T10:26:18.424597+0000","last_clean":"2024-04-25T10:26:18.424597+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:26:18.424597+0000","last_undegraded":"2024-04-25T10:26:18.424597+0000","last_fullsized":"2024-04-25T10:26:18.424597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.711880+0000","last_change":"2024-04-25T10:25:37.176608+0000","last_active":"2024-04-25T10:26:18.711880+0000","last_peered":"2024-04-25T10:26:18.711880+0000","last_clean":"2024-04-25T10:26:18.711880+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:26:18.711880+0000","last_undegraded":"2024-04-25T10:26:18.711880+0000","last_fullsized":"2024-04-25T10:26:18.711880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696156+0000","last_change":"2024-04-25T10:25:36.175833+0000","last_active":"2024-04-25T10:26:18.696156+0000","last_peered":"2024-04-25T10:26:18.696156+0000","last_clean":"2024-04-25T10:26:18.696156+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:26:18.696156+0000","last_undegraded":"2024-04-25T10:26:18.696156+0000","last_fullsized":"2024-04-25T10:26:18.696156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695573+0000","last_change":"2024-04-25T10:25:41.256600+0000","last_active":"2024-04-25T10:26:18.695573+0000","last_peered":"2024-04-25T10:26:18.695573+0000","last_clean":"2024-04-25T10:26:18.695573+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:26:18.695573+0000","last_undegraded":"2024-04-25T10:26:18.695573+0000","last_fullsized":"2024-04-25T10:26:18.695573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.707289+0000","last_change":"2024-04-25T10:25:37.185203+0000","last_active":"2024-04-25T10:26:18.707289+0000","last_peered":"2024-04-25T10:26:18.707289+0000","last_clean":"2024-04-25T10:26:18.707289+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:26:18.707289+0000","last_undegraded":"2024-04-25T10:26:18.707289+0000","last_fullsized":"2024-04-25T10:26:18.707289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696810+0000","last_change":"2024-04-25T10:25:36.168542+0000","last_active":"2024-04-25T10:26:18.696810+0000","last_peered":"2024-04-25T10:26:18.696810+0000","last_clean":"2024-04-25T10:26:18.696810+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:26:18.696810+0000","last_undegraded":"2024-04-25T10:26:18.696810+0000","last_fullsized":"2024-04-25T10:26:18.696810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.411567+0000","last_change":"2024-04-25T10:25:41.242053+0000","last_active":"2024-04-25T10:26:18.411567+0000","last_peered":"2024-04-25T10:26:18.411567+0000","last_clean":"2024-04-25T10:26:18.411567+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:26:18.411567+0000","last_undegraded":"2024-04-25T10:26:18.411567+0000","last_fullsized":"2024-04-25T10:26:18.411567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:05.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424358+0000","last_change":"2024-04-25T10:25:37.198952+0000","last_active":"2024-04-25T10:26:18.424358+0000","last_peered":"2024-04-25T10:26:18.424358+0000","last_clean":"2024-04-25T10:26:18.424358+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:26:18.424358+0000","last_undegraded":"2024-04-25T10:26:18.424358+0000","last_fullsized":"2024-04-25T10:26:18.424358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.707431+0000","last_change":"2024-04-25T10:25:36.179694+0000","last_active":"2024-04-25T10:26:18.707431+0000","last_peered":"2024-04-25T10:26:18.707431+0000","last_clean":"2024-04-25T10:26:18.707431+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:26:18.707431+0000","last_undegraded":"2024-04-25T10:26:18.707431+0000","last_fullsized":"2024-04-25T10:26:18.707431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484604+0000","last_change":"2024-04-25T10:25:41.251379+0000","last_active":"2024-04-25T10:26:18.484604+0000","last_peered":"2024-04-25T10:26:18.484604+0000","last_clean":"2024-04-25T10:26:18.484604+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:26:18.484604+0000","last_undegraded":"2024-04-25T10:26:18.484604+0000","last_fullsized":"2024-04-25T10:26:18.484604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:47.690188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.412626+0000","last_change":"2024-04-25T10:25:37.202390+0000","last_active":"2024-04-25T10:26:18.412626+0000","last_peered":"2024-04-25T10:26:18.412626+0000","last_clean":"2024-04-25T10:26:18.412626+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:26:18.412626+0000","last_undegraded":"2024-04-25T10:26:18.412626+0000","last_fullsized":"2024-04-25T10:26:18.412626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.378489+0000","last_change":"2024-04-25T10:25:36.154879+0000","last_active":"2024-04-25T10:26:19.378489+0000","last_peered":"2024-04-25T10:26:19.378489+0000","last_clean":"2024-04-25T10:26:19.378489+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:26:19.378489+0000","last_undegraded":"2024-04-25T10:26:19.378489+0000","last_fullsized":"2024-04-25T10:26:19.378489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696206+0000","last_change":"2024-04-25T10:25:41.239631+0000","last_active":"2024-04-25T10:26:18.696206+0000","last_peered":"2024-04-25T10:26:18.696206+0000","last_clean":"2024-04-25T10:26:18.696206+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:26:18.696206+0000","last_undegraded":"2024-04-25T10:26:18.696206+0000","last_fullsized":"2024-04-25T10:26:18.696206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.684623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484230+0000","last_change":"2024-04-25T10:25:37.181525+0000","last_active":"2024-04-25T10:26:18.484230+0000","last_peered":"2024-04-25T10:26:18.484230+0000","last_clean":"2024-04-25T10:26:18.484230+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:26:18.484230+0000","last_undegraded":"2024-04-25T10:26:18.484230+0000","last_fullsized":"2024-04-25T10:26:18.484230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.380319+0000","last_change":"2024-04-25T10:25:36.192797+0000","last_active":"2024-04-25T10:26:19.380319+0000","last_peered":"2024-04-25T10:26:19.380319+0000","last_clean":"2024-04-25T10:26:19.380319+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:26:19.380319+0000","last_undegraded":"2024-04-25T10:26:19.380319+0000","last_fullsized":"2024-04-25T10:26:19.380319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696218+0000","last_change":"2024-04-25T10:25:41.244618+0000","last_active":"2024-04-25T10:26:18.696218+0000","last_peered":"2024-04-25T10:26:18.696218+0000","last_clean":"2024-04-25T10:26:18.696218+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:26:18.696218+0000","last_undegraded":"2024-04-25T10:26:18.696218+0000","last_fullsized":"2024-04-25T10:26:18.696218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:13.625947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415549+0000","last_change":"2024-04-25T10:25:37.208984+0000","last_active":"2024-04-25T10:26:18.415549+0000","last_peered":"2024-04-25T10:26:18.415549+0000","last_clean":"2024-04-25T10:26:18.415549+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:26:18.415549+0000","last_undegraded":"2024-04-25T10:26:18.415549+0000","last_fullsized":"2024-04-25T10:26:18.415549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.413938+0000","last_change":"2024-04-25T10:25:36.185689+0000","last_active":"2024-04-25T10:26:18.413938+0000","last_peered":"2024-04-25T10:26:18.413938+0000","last_clean":"2024-04-25T10:26:18.413938+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:26:18.413938+0000","last_undegraded":"2024-04-25T10:26:18.413938+0000","last_fullsized":"2024-04-25T10:26:18.413938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:35.671970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406736+0000","last_change":"2024-04-25T10:25:41.247314+0000","last_active":"2024-04-25T10:26:18.406736+0000","last_peered":"2024-04-25T10:26:18.406736+0000","last_clean":"2024-04-25T10:26:18.406736+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:26:18.406736+0000","last_undegraded":"2024-04-25T10:26:18.406736+0000","last_fullsized":"2024-04-25T10:26:18.406736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406474+0000","last_change":"2024-04-25T10:25:37.193696+0000","last_active":"2024-04-25T10:26:18.406474+0000","last_peered":"2024-04-25T10:26:18.406474+0000","last_clean":"2024-04-25T10:26:18.406474+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:26:18.406474+0000","last_undegraded":"2024-04-25T10:26:18.406474+0000","last_fullsized":"2024-04-25T10:26:18.406474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.381011+0000","last_change":"2024-04-25T10:25:36.181843+0000","last_active":"2024-04-25T10:26:19.381011+0000","last_peered":"2024-04-25T10:26:19.381011+0000","last_clean":"2024-04-25T10:26:19.381011+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:26:19.381011+0000","last_undegraded":"2024-04-25T10:26:19.381011+0000","last_fullsized":"2024-04-25T10:26:19.381011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416172+0000","last_change":"2024-04-25T10:25:41.247061+0000","last_active":"2024-04-25T10:26:18.416172+0000","last_peered":"2024-04-25T10:26:18.416172+0000","last_clean":"2024-04-25T10:26:18.416172+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:26:18.416172+0000","last_undegraded":"2024-04-25T10:26:18.416172+0000","last_fullsized":"2024-04-25T10:26:18.416172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.491573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.704685+0000","last_change":"2024-04-25T10:25:37.185402+0000","last_active":"2024-04-25T10:26:18.704685+0000","last_peered":"2024-04-25T10:26:18.704685+0000","last_clean":"2024-04-25T10:26:18.704685+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:26:18.704685+0000","last_undegraded":"2024-04-25T10:26:18.704685+0000","last_fullsized":"2024-04-25T10:26:18.704685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'14","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:33.545534+0000","last_change":"2024-04-25T10:25:36.166998+0000","last_active":"2024-04-25T10:26:33.545534+0000","last_peered":"2024-04-25T10:26:33.545534+0000","last_clean":"2024-04-25T10:26:33.545534+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:26:33.545534+0000","last_undegraded":"2024-04-25T10:26:33.545534+0000","last_fullsized":"2024-04-25T10:26:33.545534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:25.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695909+0000","last_change":"2024-04-25T10:25:41.248522+0000","last_active":"2024-04-25T10:26:18.695909+0000","last_peered":"2024-04-25T10:26:18.695909+0000","last_clean":"2024-04-25T10:26:18.695909+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:26:18.695909+0000","last_undegraded":"2024-04-25T10:26:18.695909+0000","last_fullsized":"2024-04-25T10:26:18.695909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:51.139406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.415590+0000","last_change":"2024-04-25T10:25:37.196588+0000","last_active":"2024-04-25T10:26:18.415590+0000","last_peered":"2024-04-25T10:26:18.415590+0000","last_clean":"2024-04-25T10:26:18.415590+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:26:18.415590+0000","last_undegraded":"2024-04-25T10:26:18.415590+0000","last_fullsized":"2024-04-25T10:26:18.415590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:00.003456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697119+0000","last_change":"2024-04-25T10:25:36.156630+0000","last_active":"2024-04-25T10:26:18.697119+0000","last_peered":"2024-04-25T10:26:18.697119+0000","last_clean":"2024-04-25T10:26:18.697119+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:26:18.697119+0000","last_undegraded":"2024-04-25T10:26:18.697119+0000","last_fullsized":"2024-04-25T10:26:18.697119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.708803+0000","last_change":"2024-04-25T10:26:18.708803+0000","last_active":"2024-04-25T10:26:18.708803+0000","last_peered":"2024-04-25T10:26:18.708803+0000","last_clean":"2024-04-25T10:26:18.708803+0000","last_became_active":"2024-04-25T10:26:18.708320+0000","last_became_peered":"2024-04-25T10:26:18.708320+0000","last_unstale":"2024-04-25T10:26:18.708803+0000","last_undegraded":"2024-04-25T10:26:18.708803+0000","last_fullsized":"2024-04-25T10:26:18.708803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:09.714453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,7],"acting":[2,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696354+0000","last_change":"2024-04-25T10:25:37.187575+0000","last_active":"2024-04-25T10:26:18.696354+0000","last_peered":"2024-04-25T10:26:18.696354+0000","last_clean":"2024-04-25T10:26:18.696354+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:26:18.696354+0000","last_undegraded":"2024-04-25T10:26:18.696354+0000","last_fullsized":"2024-04-25T10:26:18.696354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.706876+0000","last_change":"2024-04-25T10:25:36.183582+0000","last_active":"2024-04-25T10:26:18.706876+0000","last_peered":"2024-04-25T10:26:18.706876+0000","last_clean":"2024-04-25T10:26:18.706876+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:26:18.706876+0000","last_undegraded":"2024-04-25T10:26:18.706876+0000","last_fullsized":"2024-04-25T10:26:18.706876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.694984+0000","last_change":"2024-04-25T10:25:41.238488+0000","last_active":"2024-04-25T10:26:18.694984+0000","last_peered":"2024-04-25T10:26:18.694984+0000","last_clean":"2024-04-25T10:26:18.694984+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:26:18.694984+0000","last_undegraded":"2024-04-25T10:26:18.694984+0000","last_fullsized":"2024-04-25T10:26:18.694984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:05.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424244+0000","last_change":"2024-04-25T10:25:37.192707+0000","last_active":"2024-04-25T10:26:18.424244+0000","last_peered":"2024-04-25T10:26:18.424244+0000","last_clean":"2024-04-25T10:26:18.424244+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:26:18.424244+0000","last_undegraded":"2024-04-25T10:26:18.424244+0000","last_fullsized":"2024-04-25T10:26:18.424244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.488211+0000","last_change":"2024-04-25T10:25:36.173755+0000","last_active":"2024-04-25T10:26:18.488211+0000","last_peered":"2024-04-25T10:26:18.488211+0000","last_clean":"2024-04-25T10:26:18.488211+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:26:18.488211+0000","last_undegraded":"2024-04-25T10:26:18.488211+0000","last_fullsized":"2024-04-25T10:26:18.488211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696449+0000","last_change":"2024-04-25T10:25:41.248983+0000","last_active":"2024-04-25T10:26:18.696449+0000","last_peered":"2024-04-25T10:26:18.696449+0000","last_clean":"2024-04-25T10:26:18.696449+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:26:18.696449+0000","last_undegraded":"2024-04-25T10:26:18.696449+0000","last_fullsized":"2024-04-25T10:26:18.696449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.880608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696825+0000","last_change":"2024-04-25T10:25:41.246692+0000","last_active":"2024-04-25T10:26:18.696825+0000","last_peered":"2024-04-25T10:26:18.696825+0000","last_clean":"2024-04-25T10:26:18.696825+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:26:18.696825+0000","last_undegraded":"2024-04-25T10:26:18.696825+0000","last_fullsized":"2024-04-25T10:26:18.696825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:44.250576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696507+0000","last_change":"2024-04-25T10:25:37.178691+0000","last_active":"2024-04-25T10:26:18.696507+0000","last_peered":"2024-04-25T10:26:18.696507+0000","last_clean":"2024-04-25T10:26:18.696507+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:26:18.696507+0000","last_undegraded":"2024-04-25T10:26:18.696507+0000","last_fullsized":"2024-04-25T10:26:18.696507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.412013+0000","last_change":"2024-04-25T10:25:36.191338+0000","last_active":"2024-04-25T10:26:18.412013+0000","last_peered":"2024-04-25T10:26:18.412013+0000","last_clean":"2024-04-25T10:26:18.412013+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:26:18.412013+0000","last_undegraded":"2024-04-25T10:26:18.412013+0000","last_fullsized":"2024-04-25T10:26:18.412013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.417101+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:26:18.417101+0000","last_peered":"2024-04-25T10:26:18.417101+0000","last_clean":"2024-04-25T10:26:18.417101+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:26:18.417101+0000","last_undegraded":"2024-04-25T10:26:18.417101+0000","last_fullsized":"2024-04-25T10:26:18.417101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:21.254459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697789+0000","last_change":"2024-04-25T10:25:37.170931+0000","last_active":"2024-04-25T10:26:18.697789+0000","last_peered":"2024-04-25T10:26:18.697789+0000","last_clean":"2024-04-25T10:26:18.697789+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:26:18.697789+0000","last_undegraded":"2024-04-25T10:26:18.697789+0000","last_fullsized":"2024-04-25T10:26:18.697789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.377822+0000","last_change":"2024-04-25T10:25:36.173721+0000","last_active":"2024-04-25T10:26:19.377822+0000","last_peered":"2024-04-25T10:26:19.377822+0000","last_clean":"2024-04-25T10:26:19.377822+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:26:19.377822+0000","last_undegraded":"2024-04-25T10:26:19.377822+0000","last_fullsized":"2024-04-25T10:26:19.377822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:42.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:19.378676+0000","last_change":"2024-04-25T10:25:36.195499+0000","last_active":"2024-04-25T10:26:19.378676+0000","last_peered":"2024-04-25T10:26:19.378676+0000","last_clean":"2024-04-25T10:26:19.378676+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:26:19.378676+0000","last_undegraded":"2024-04-25T10:26:19.378676+0000","last_fullsized":"2024-04-25T10:26:19.378676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:05.600702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696309+0000","last_change":"2024-04-25T10:25:37.180896+0000","last_active":"2024-04-25T10:26:18.696309+0000","last_peered":"2024-04-25T10:26:18.696309+0000","last_clean":"2024-04-25T10:26:18.696309+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:26:18.696309+0000","last_undegraded":"2024-04-25T10:26:18.696309+0000","last_fullsized":"2024-04-25T10:26:18.696309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696525+0000","last_change":"2024-04-25T10:25:41.231793+0000","last_active":"2024-04-25T10:26:18.696525+0000","last_peered":"2024-04-25T10:26:18.696525+0000","last_clean":"2024-04-25T10:26:18.696525+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:26:18.696525+0000","last_undegraded":"2024-04-25T10:26:18.696525+0000","last_fullsized":"2024-04-25T10:26:18.696525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:33.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695714+0000","last_change":"2024-04-25T10:25:36.166742+0000","last_active":"2024-04-25T10:26:18.695714+0000","last_peered":"2024-04-25T10:26:18.695714+0000","last_clean":"2024-04-25T10:26:18.695714+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:26:18.695714+0000","last_undegraded":"2024-04-25T10:26:18.695714+0000","last_fullsized":"2024-04-25T10:26:18.695714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.485032+0000","last_change":"2024-04-25T10:25:37.185699+0000","last_active":"2024-04-25T10:26:18.485032+0000","last_peered":"2024-04-25T10:26:18.485032+0000","last_clean":"2024-04-25T10:26:18.485032+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:26:18.485032+0000","last_undegraded":"2024-04-25T10:26:18.485032+0000","last_fullsized":"2024-04-25T10:26:18.485032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696812+0000","last_change":"2024-04-25T10:25:41.258191+0000","last_active":"2024-04-25T10:26:18.696812+0000","last_peered":"2024-04-25T10:26:18.696812+0000","last_clean":"2024-04-25T10:26:18.696812+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:26:18.696812+0000","last_undegraded":"2024-04-25T10:26:18.696812+0000","last_fullsized":"2024-04-25T10:26:18.696812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.479785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423035+0000","last_change":"2024-04-25T10:25:37.183192+0000","last_active":"2024-04-25T10:26:18.423035+0000","last_peered":"2024-04-25T10:26:18.423035+0000","last_clean":"2024-04-25T10:26:18.423035+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:26:18.423035+0000","last_undegraded":"2024-04-25T10:26:18.423035+0000","last_fullsized":"2024-04-25T10:26:18.423035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695394+0000","last_change":"2024-04-25T10:25:37.180242+0000","last_active":"2024-04-25T10:26:18.695394+0000","last_peered":"2024-04-25T10:26:18.695394+0000","last_clean":"2024-04-25T10:26:18.695394+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:26:18.695394+0000","last_undegraded":"2024-04-25T10:26:18.695394+0000","last_fullsized":"2024-04-25T10:26:18.695394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.413509+0000","last_change":"2024-04-25T10:25:37.187312+0000","last_active":"2024-04-25T10:26:18.413509+0000","last_peered":"2024-04-25T10:26:18.413509+0000","last_clean":"2024-04-25T10:26:18.413509+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:26:18.413509+0000","last_undegraded":"2024-04-25T10:26:18.413509+0000","last_fullsized":"2024-04-25T10:26:18.413509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:22.595222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695638+0000","last_change":"2024-04-25T10:25:37.166351+0000","last_active":"2024-04-25T10:26:18.695638+0000","last_peered":"2024-04-25T10:26:18.695638+0000","last_clean":"2024-04-25T10:26:18.695638+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:26:18.695638+0000","last_undegraded":"2024-04-25T10:26:18.695638+0000","last_fullsized":"2024-04-25T10:26:18.695638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.699084+0000","last_change":"2024-04-25T10:26:18.699084+0000","last_active":"2024-04-25T10:26:18.699084+0000","last_peered":"2024-04-25T10:26:18.699084+0000","last_clean":"2024-04-25T10:26:18.699084+0000","last_became_active":"2024-04-25T10:26:18.698625+0000","last_became_peered":"2024-04-25T10:26:18.698625+0000","last_unstale":"2024-04-25T10:26:18.699084+0000","last_undegraded":"2024-04-25T10:26:18.699084+0000","last_fullsized":"2024-04-25T10:26:18.699084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:44.112645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406765+0000","last_change":"2024-04-25T10:25:37.170647+0000","last_active":"2024-04-25T10:26:18.406765+0000","last_peered":"2024-04-25T10:26:18.406765+0000","last_clean":"2024-04-25T10:26:18.406765+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:26:18.406765+0000","last_undegraded":"2024-04-25T10:26:18.406765+0000","last_fullsized":"2024-04-25T10:26:18.406765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423553+0000","last_change":"2024-04-25T10:25:37.196676+0000","last_active":"2024-04-25T10:26:18.423553+0000","last_peered":"2024-04-25T10:26:18.423553+0000","last_clean":"2024-04-25T10:26:18.423553+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:26:18.423553+0000","last_undegraded":"2024-04-25T10:26:18.423553+0000","last_fullsized":"2024-04-25T10:26:18.423553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696213+0000","last_change":"2024-04-25T10:25:37.186567+0000","last_active":"2024-04-25T10:26:18.696213+0000","last_peered":"2024-04-25T10:26:18.696213+0000","last_clean":"2024-04-25T10:26:18.696213+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:26:18.696213+0000","last_undegraded":"2024-04-25T10:26:18.696213+0000","last_fullsized":"2024-04-25T10:26:18.696213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.411895+0000","last_change":"2024-04-25T10:25:37.184887+0000","last_active":"2024-04-25T10:26:18.411895+0000","last_peered":"2024-04-25T10:26:18.411895+0000","last_clean":"2024-04-25T10:26:18.411895+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:26:18.411895+0000","last_undegraded":"2024-04-25T10:26:18.411895+0000","last_fullsized":"2024-04-25T10:26:18.411895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695758+0000","last_change":"2024-04-25T10:25:37.196649+0000","last_active":"2024-04-25T10:26:18.695758+0000","last_peered":"2024-04-25T10:26:18.695758+0000","last_clean":"2024-04-25T10:26:18.695758+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:26:18.695758+0000","last_undegraded":"2024-04-25T10:26:18.695758+0000","last_fullsized":"2024-04-25T10:26:18.695758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.484928+0000","last_change":"2024-04-25T10:25:37.192093+0000","last_active":"2024-04-25T10:26:18.484928+0000","last_peered":"2024-04-25T10:26:18.484928+0000","last_clean":"2024-04-25T10:26:18.484928+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:26:18.484928+0000","last_undegraded":"2024-04-25T10:26:18.484928+0000","last_fullsized":"2024-04-25T10:26:18.484928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696179+0000","last_change":"2024-04-25T10:25:37.184014+0000","last_active":"2024-04-25T10:26:18.696179+0000","last_peered":"2024-04-25T10:26:18.696179+0000","last_clean":"2024-04-25T10:26:18.696179+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:26:18.696179+0000","last_undegraded":"2024-04-25T10:26:18.696179+0000","last_fullsized":"2024-04-25T10:26:18.696179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:52.810612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.711777+0000","last_change":"2024-04-25T10:25:37.187384+0000","last_active":"2024-04-25T10:26:18.711777+0000","last_peered":"2024-04-25T10:26:18.711777+0000","last_clean":"2024-04-25T10:26:18.711777+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:26:18.711777+0000","last_undegraded":"2024-04-25T10:26:18.711777+0000","last_fullsized":"2024-04-25T10:26:18.711777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.416473+0000","last_change":"2024-04-25T10:25:37.195712+0000","last_active":"2024-04-25T10:26:18.416473+0000","last_peered":"2024-04-25T10:26:18.416473+0000","last_clean":"2024-04-25T10:26:18.416473+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:26:18.416473+0000","last_undegraded":"2024-04-25T10:26:18.416473+0000","last_fullsized":"2024-04-25T10:26:18.416473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:13.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697258+0000","last_change":"2024-04-25T10:25:37.198664+0000","last_active":"2024-04-25T10:26:18.697258+0000","last_peered":"2024-04-25T10:26:18.697258+0000","last_clean":"2024-04-25T10:26:18.697258+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:26:18.697258+0000","last_undegraded":"2024-04-25T10:26:18.697258+0000","last_fullsized":"2024-04-25T10:26:18.697258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.417210+0000","last_change":"2024-04-25T10:25:37.203174+0000","last_active":"2024-04-25T10:26:18.417210+0000","last_peered":"2024-04-25T10:26:18.417210+0000","last_clean":"2024-04-25T10:26:18.417210+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:26:18.417210+0000","last_undegraded":"2024-04-25T10:26:18.417210+0000","last_fullsized":"2024-04-25T10:26:18.417210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:05.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.411779+0000","last_change":"2024-04-25T10:25:37.199911+0000","last_active":"2024-04-25T10:26:18.411779+0000","last_peered":"2024-04-25T10:26:18.411779+0000","last_clean":"2024-04-25T10:26:18.411779+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:26:18.411779+0000","last_undegraded":"2024-04-25T10:26:18.411779+0000","last_fullsized":"2024-04-25T10:26:18.411779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:29.272654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.695806+0000","last_change":"2024-04-25T10:25:37.177405+0000","last_active":"2024-04-25T10:26:18.695806+0000","last_peered":"2024-04-25T10:26:18.695806+0000","last_clean":"2024-04-25T10:26:18.695806+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:26:18.695806+0000","last_undegraded":"2024-04-25T10:26:18.695806+0000","last_fullsized":"2024-04-25T10:26:18.695806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406403+0000","last_change":"2024-04-25T10:25:37.167752+0000","last_active":"2024-04-25T10:26:18.406403+0000","last_peered":"2024-04-25T10:26:18.406403+0000","last_clean":"2024-04-25T10:26:18.406403+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:26:18.406403+0000","last_undegraded":"2024-04-25T10:26:18.406403+0000","last_fullsized":"2024-04-25T10:26:18.406403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.406601+0000","last_change":"2024-04-25T10:25:37.180781+0000","last_active":"2024-04-25T10:26:18.406601+0000","last_peered":"2024-04-25T10:26:18.406601+0000","last_clean":"2024-04-25T10:26:18.406601+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:26:18.406601+0000","last_undegraded":"2024-04-25T10:26:18.406601+0000","last_fullsized":"2024-04-25T10:26:18.406601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.711666+0000","last_change":"2024-04-25T10:25:37.192759+0000","last_active":"2024-04-25T10:26:18.711666+0000","last_peered":"2024-04-25T10:26:18.711666+0000","last_clean":"2024-04-25T10:26:18.711666+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:26:18.711666+0000","last_undegraded":"2024-04-25T10:26:18.711666+0000","last_fullsized":"2024-04-25T10:26:18.711666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.704592+0000","last_change":"2024-04-25T10:25:37.195532+0000","last_active":"2024-04-25T10:26:18.704592+0000","last_peered":"2024-04-25T10:26:18.704592+0000","last_clean":"2024-04-25T10:26:18.704592+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:26:18.704592+0000","last_undegraded":"2024-04-25T10:26:18.704592+0000","last_fullsized":"2024-04-25T10:26:18.704592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.706704+0000","last_change":"2024-04-25T10:25:37.200331+0000","last_active":"2024-04-25T10:26:18.706704+0000","last_peered":"2024-04-25T10:26:18.706704+0000","last_clean":"2024-04-25T10:26:18.706704+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:26:18.706704+0000","last_undegraded":"2024-04-25T10:26:18.706704+0000","last_fullsized":"2024-04-25T10:26:18.706704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.488103+0000","last_change":"2024-04-25T10:25:37.194514+0000","last_active":"2024-04-25T10:26:18.488103+0000","last_peered":"2024-04-25T10:26:18.488103+0000","last_clean":"2024-04-25T10:26:18.488103+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:26:18.488103+0000","last_undegraded":"2024-04-25T10:26:18.488103+0000","last_fullsized":"2024-04-25T10:26:18.488103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.697663+0000","last_change":"2024-04-25T10:25:37.177730+0000","last_active":"2024-04-25T10:26:18.697663+0000","last_peered":"2024-04-25T10:26:18.697663+0000","last_clean":"2024-04-25T10:26:18.697663+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:26:18.697663+0000","last_undegraded":"2024-04-25T10:26:18.697663+0000","last_fullsized":"2024-04-25T10:26:18.697663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.703366+0000","last_change":"2024-04-25T10:25:37.173419+0000","last_active":"2024-04-25T10:26:18.703366+0000","last_peered":"2024-04-25T10:26:18.703366+0000","last_clean":"2024-04-25T10:26:18.703366+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:26:18.703366+0000","last_undegraded":"2024-04-25T10:26:18.703366+0000","last_fullsized":"2024-04-25T10:26:18.703366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.424758+0000","last_change":"2024-04-25T10:25:37.182871+0000","last_active":"2024-04-25T10:26:18.424758+0000","last_peered":"2024-04-25T10:26:18.424758+0000","last_clean":"2024-04-25T10:26:18.424758+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:26:18.424758+0000","last_undegraded":"2024-04-25T10:26:18.424758+0000","last_fullsized":"2024-04-25T10:26:18.424758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.704091+0000","last_change":"2024-04-25T10:25:37.173983+0000","last_active":"2024-04-25T10:26:18.704091+0000","last_peered":"2024-04-25T10:26:18.704091+0000","last_clean":"2024-04-25T10:26:18.704091+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:26:18.704091+0000","last_undegraded":"2024-04-25T10:26:18.704091+0000","last_fullsized":"2024-04-25T10:26:18.704091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.423770+0000","last_change":"2024-04-25T10:25:37.182178+0000","last_active":"2024-04-25T10:26:18.423770+0000","last_peered":"2024-04-25T10:26:18.423770+0000","last_clean":"2024-04-25T10:26:18.423770+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:26:18.423770+0000","last_undegraded":"2024-04-25T10:26:18.423770+0000","last_fullsized":"2024-04-25T10:26:18.423770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696072+0000","last_change":"2024-04-25T10:25:37.170383+0000","last_active":"2024-04-25T10:26:18.696072+0000","last_peered":"2024-04-25T10:26:18.696072+0000","last_clean":"2024-04-25T10:26:18.696072+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:26:18.696072+0000","last_undegraded":"2024-04-25T10:26:18.696072+0000","last_fullsized":"2024-04-25T10:26:18.696072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.696055+0000","last_change":"2024-04-25T10:25:37.167687+0000","last_active":"2024-04-25T10:26:18.696055+0000","last_peered":"2024-04-25T10:26:18.696055+0000","last_clean":"2024-04-25T10:26:18.696055+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:26:18.696055+0000","last_undegraded":"2024-04-25T10:26:18.696055+0000","last_fullsized":"2024-04-25T10:26:18.696055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:26:18.707196+0000","last_change":"2024-04-25T10:25:37.196591+0000","last_active":"2024-04-25T10:26:18.707196+0000","last_peered":"2024-04-25T10:26:18.707196+0000","last_clean":"2024-04-25T10:26:18.707196+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:26:18.707196+0000","last_undegraded":"2024-04-25T10:26:18.707196+0000","last_fullsized":"2024-04-25T10:26:18.707196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":115122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":705090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":119586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":704446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":115234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:26:42.087 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:42.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.403+0000 7fc26ce00640 1 Processor -- start 2024-04-25T10:26:42.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.403+0000 7fc26ce00640 1 -- start start 2024-04-25T10:26:42.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.405+0000 7fc26ce00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2680b50e0 0x7fc2681567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.405+0000 7fc26ce00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2680ccdc0 0x7fc2680cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.405+0000 7fc26ce00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc26815c5f0 con 0x7fc2680b4090 2024-04-25T10:26:42.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.405+0000 7fc26ce00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc2680cd1d0 con 0x7fc2680b50e0 2024-04-25T10:26:42.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.405+0000 7fc26ce00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc26815c8d0 con 0x7fc2680ccdc0 2024-04-25T10:26:42.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.405+0000 7fc266a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2680b50e0 0x7fc2681567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.406+0000 7fc267e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2680ccdc0 0x7fc2680cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.406+0000 7fc266a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2680b50e0 0x7fc2681567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53928/0 (socket says 172.21.15.19:53928) 2024-04-25T10:26:42.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.406+0000 7fc266a00640 1 -- 172.21.15.19:0/2429036759 learned_addr learned my addr 172.21.15.19:0/2429036759 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:42.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.406+0000 7fc267e00640 1 -- 172.21.15.19:0/2429036759 >> v2:172.21.15.19:3300/0 conn(0x7fc2680b50e0 msgr2=0x7fc2681567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:42.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.406+0000 7fc267e00640 1 --2- 172.21.15.19:0/2429036759 >> v2:172.21.15.19:3300/0 conn(0x7fc2680b50e0 0x7fc2681567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.406+0000 7fc267e00640 1 -- 172.21.15.19:0/2429036759 >> v1:172.21.15.19:6789/0 conn(0x7fc2680b4090 legacy=0x7fc2680b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.406+0000 7fc267e00640 1 -- 172.21.15.19:0/2429036759 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26815cbb0 con 0x7fc2680ccdc0 2024-04-25T10:26:42.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.407+0000 7fc267e00640 1 --2- 172.21.15.19:0/2429036759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2680ccdc0 0x7fc2680cdf50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc260009d90 tx=0x7fc26002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=224ae20dbb52e6e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:42.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.407+0000 7fc266000640 1 -- 172.21.15.19:0/2429036759 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260007740 con 0x7fc2680ccdc0 2024-04-25T10:26:42.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.407+0000 7fc266000640 1 -- 172.21.15.19:0/2429036759 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2600078e0 con 0x7fc2680ccdc0 2024-04-25T10:26:42.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.408+0000 7fc266000640 1 -- 172.21.15.19:0/2429036759 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260007cb0 con 0x7fc2680ccdc0 2024-04-25T10:26:42.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.408+0000 7fc26ce00640 1 -- 172.21.15.19:0/2429036759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2680ccdc0 msgr2=0x7fc2680cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.408+0000 7fc26ce00640 1 --2- 172.21.15.19:0/2429036759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2680ccdc0 0x7fc2680cdf50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc260009d90 tx=0x7fc26002a660 comp rx=0 tx=0).stop 2024-04-25T10:26:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.408+0000 7fc26ce00640 1 -- 172.21.15.19:0/2429036759 shutdown_connections 2024-04-25T10:26:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.408+0000 7fc26ce00640 1 --2- 172.21.15.19:0/2429036759 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2680ccdc0 0x7fc2680cdf50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.408+0000 7fc26ce00640 1 --2- 172.21.15.19:0/2429036759 >> v2:172.21.15.19:3300/0 conn(0x7fc2680b50e0 0x7fc2681567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.408+0000 7fc26ce00640 1 -- 172.21.15.19:0/2429036759 >> 172.21.15.19:0/2429036759 conn(0x7fc26808d940 msgr2=0x7fc26808dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.408+0000 7fc26ce00640 1 -- 172.21.15.19:0/2429036759 shutdown_connections 2024-04-25T10:26:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.408+0000 7fc26ce00640 1 -- 172.21.15.19:0/2429036759 wait complete. 2024-04-25T10:26:42.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.411+0000 7fc26ce00640 1 Processor -- start 2024-04-25T10:26:42.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.411+0000 7fc26ce00640 1 -- start start 2024-04-25T10:26:42.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.412+0000 7fc26ce00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2680b4090 0x7fc2681584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.412+0000 7fc26ce00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2680b50e0 0x7fc26815e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.412+0000 7fc26ce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2680ccdc0 0x7fc2681f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.412+0000 7fc26ce00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc2680b4cf0 con 0x7fc2680b4090 2024-04-25T10:26:42.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.412+0000 7fc26ce00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc26815d170 con 0x7fc2680ccdc0 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.412+0000 7fc26ce00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc2680b4e70 con 0x7fc2680b50e0 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.412+0000 7fc267400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2680b4090 0x7fc2681584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.413+0000 7fc267400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2680b4090 0x7fc2681584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53944/0 (socket says 172.21.15.19:53944) 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.413+0000 7fc266a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2680b50e0 0x7fc26815e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.413+0000 7fc267400640 1 -- 172.21.15.19:0/2950948224 learned_addr learned my addr 172.21.15.19:0/2950948224 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.413+0000 7fc267e00640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2680ccdc0 0x7fc2681f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.413+0000 7fc267400640 1 -- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2680b50e0 msgr2=0x7fc26815e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.413+0000 7fc267400640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2680b50e0 0x7fc26815e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.413+0000 7fc267400640 1 -- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2680ccdc0 msgr2=0x7fc2681f6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.413+0000 7fc267400640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2680ccdc0 0x7fc2681f6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.413+0000 7fc267400640 1 -- 172.21.15.19:0/2950948224 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2681f71c0 con 0x7fc2680b4090 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.413+0000 7fc267400640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2680b4090 0x7fc2681584d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc25000c3c0 tx=0x7fc25000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.414+0000 7fc25f400640 1 -- 172.21.15.19:0/2950948224 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2500052d0 con 0x7fc2680b4090 2024-04-25T10:26:42.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.414+0000 7fc25f400640 1 -- 172.21.15.19:0/2950948224 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc250005490 con 0x7fc2680b4090 2024-04-25T10:26:42.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.414+0000 7fc25f400640 1 -- 172.21.15.19:0/2950948224 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250007260 con 0x7fc2680b4090 2024-04-25T10:26:42.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.414+0000 7fc26ce00640 1 -- 172.21.15.19:0/2950948224 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26815eaa0 con 0x7fc2680b4090 2024-04-25T10:26:42.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.414+0000 7fc26ce00640 1 -- 172.21.15.19:0/2950948224 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2681f6760 con 0x7fc2680b4090 2024-04-25T10:26:42.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.415+0000 7fc26ce00640 1 -- 172.21.15.19:0/2950948224 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc268153df0 con 0x7fc2680b4090 2024-04-25T10:26:42.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.416+0000 7fc25f400640 1 -- 172.21.15.19:0/2950948224 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc250007400 con 0x7fc2680b4090 2024-04-25T10:26:42.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.417+0000 7fc25f400640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc2440744b0 0x7fc2440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.417+0000 7fc25f400640 1 -- 172.21.15.19:0/2950948224 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fc2500949c0 con 0x7fc2680b4090 2024-04-25T10:26:42.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.417+0000 7fc266a00640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc2440744b0 0x7fc2440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.418+0000 7fc266a00640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc2440744b0 0x7fc2440769c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc2681f3f10 tx=0x7fc258009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:42.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.422+0000 7fc25f400640 1 -- 172.21.15.19:0/2950948224 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc25005e780 con 0x7fc2680b4090 2024-04-25T10:26:42.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.621+0000 7fc26ce00640 1 -- 172.21.15.19:0/2950948224 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc268050740 con 0x7fc2680b4090 2024-04-25T10:26:42.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.624+0000 7fc25f400640 1 -- 172.21.15.19:0/2950948224 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7fc250062a80 con 0x7fc2680b4090 2024-04-25T10:26:42.627 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:42.627 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:26:18.399567+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:42.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.626+0000 7fc26ce00640 1 -- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc2440744b0 msgr2=0x7fc2440769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.626+0000 7fc26ce00640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc2440744b0 0x7fc2440769c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc2681f3f10 tx=0x7fc258009240 comp rx=0 tx=0).stop 2024-04-25T10:26:42.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.626+0000 7fc26ce00640 1 -- 172.21.15.19:0/2950948224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2680b4090 msgr2=0x7fc2681584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.626+0000 7fc26ce00640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2680b4090 0x7fc2681584d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc25000c3c0 tx=0x7fc25000c880 comp rx=0 tx=0).stop 2024-04-25T10:26:42.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.627+0000 7fc26ce00640 1 -- 172.21.15.19:0/2950948224 shutdown_connections 2024-04-25T10:26:42.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.627+0000 7fc26ce00640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2680ccdc0 0x7fc2681f6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.627+0000 7fc26ce00640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc2440744b0 0x7fc2440769c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.627+0000 7fc26ce00640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2680b50e0 0x7fc26815e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.627+0000 7fc26ce00640 1 --2- 172.21.15.19:0/2950948224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2680b4090 0x7fc2681584d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.627+0000 7fc26ce00640 1 -- 172.21.15.19:0/2950948224 >> 172.21.15.19:0/2950948224 conn(0x7fc26808d940 msgr2=0x7fc26808dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:42.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.627+0000 7fc26ce00640 1 -- 172.21.15.19:0/2950948224 shutdown_connections 2024-04-25T10:26:42.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.627+0000 7fc26ce00640 1 -- 172.21.15.19:0/2950948224 wait complete. 2024-04-25T10:26:42.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:25:24.611615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:25:34.760347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:25:35.692430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:25:39.212157+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:26:42.656 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:26:42.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.940+0000 7f7632c00640 1 Processor -- start 2024-04-25T10:26:42.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.940+0000 7f7632c00640 1 -- start start 2024-04-25T10:26:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.942+0000 7f7632c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f762c06fd20 0x7f762c0c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.942+0000 7f7632c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f762c0c77a0 0x7f762c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.942+0000 7f7632c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762c15af60 con 0x7f762c1544e0 2024-04-25T10:26:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.942+0000 7f7632c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f762c1548f0 con 0x7f762c0c77a0 2024-04-25T10:26:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.942+0000 7f7632c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f762c0c6dd0 con 0x7f762c06fd20 2024-04-25T10:26:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.942+0000 7f7630e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f762c0c77a0 0x7f762c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.942+0000 7f7632200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f762c1544e0 0x7f762c06ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39644/0 (socket says 172.21.15.19:39644) 2024-04-25T10:26:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.942+0000 7f7630e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f762c0c77a0 0x7f762c153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53952/0 (socket says 172.21.15.19:53952) 2024-04-25T10:26:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.942+0000 7f7632200640 1 -- 172.21.15.19:0/375186138 learned_addr learned my addr 172.21.15.19:0/375186138 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.942+0000 7f7631800640 1 --2- 172.21.15.19:0/375186138 >> v2:172.21.15.112:3300/0 conn(0x7f762c06fd20 0x7f762c0c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.943+0000 7f7630e00640 1 -- 172.21.15.19:0/375186138 >> v2:172.21.15.112:3300/0 conn(0x7f762c06fd20 msgr2=0x7f762c0c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:42.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.943+0000 7f7630e00640 1 --2- 172.21.15.19:0/375186138 >> v2:172.21.15.112:3300/0 conn(0x7f762c06fd20 0x7f762c0c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.943+0000 7f7630e00640 1 -- 172.21.15.19:0/375186138 >> v1:172.21.15.19:6789/0 conn(0x7f762c1544e0 legacy=0x7f762c06ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.943+0000 7f7630e00640 1 -- 172.21.15.19:0/375186138 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c0c61c0 con 0x7f762c0c77a0 2024-04-25T10:26:42.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.943+0000 7f762be00640 1 -- 172.21.15.19:0/375186138 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308738734 0 0) 0x7f762c15af60 con 0x7f762c1544e0 2024-04-25T10:26:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.943+0000 7f7631800640 1 --2- 172.21.15.19:0/375186138 >> v2:172.21.15.112:3300/0 conn(0x7f762c06fd20 0x7f762c0c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.944+0000 7f7630e00640 1 --2- 172.21.15.19:0/375186138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f762c0c77a0 0x7f762c153fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f762c072970 tx=0x7f761802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133ab9ff1c279616 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:42.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.944+0000 7f762be00640 1 -- 172.21.15.19:0/375186138 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618037070 con 0x7f762c0c77a0 2024-04-25T10:26:42.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.944+0000 7f762be00640 1 -- 172.21.15.19:0/375186138 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7618032440 con 0x7f762c0c77a0 2024-04-25T10:26:42.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.944+0000 7f762be00640 1 -- 172.21.15.19:0/375186138 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618032810 con 0x7f762c0c77a0 2024-04-25T10:26:42.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.945+0000 7f7632c00640 1 -- 172.21.15.19:0/375186138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f762c0c77a0 msgr2=0x7f762c153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.945+0000 7f7632c00640 1 --2- 172.21.15.19:0/375186138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f762c0c77a0 0x7f762c153fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f762c072970 tx=0x7f761802a250 comp rx=0 tx=0).stop 2024-04-25T10:26:42.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.945+0000 7f7632c00640 1 -- 172.21.15.19:0/375186138 shutdown_connections 2024-04-25T10:26:42.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.945+0000 7f7632c00640 1 --2- 172.21.15.19:0/375186138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f762c0c77a0 0x7f762c153fa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.945+0000 7f7632c00640 1 --2- 172.21.15.19:0/375186138 >> v2:172.21.15.112:3300/0 conn(0x7f762c06fd20 0x7f762c0c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.945+0000 7f7632c00640 1 -- 172.21.15.19:0/375186138 >> 172.21.15.19:0/375186138 conn(0x7f762c0ca120 msgr2=0x7f762c0ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:42.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.945+0000 7f7632c00640 1 -- 172.21.15.19:0/375186138 shutdown_connections 2024-04-25T10:26:42.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.945+0000 7f7632c00640 1 -- 172.21.15.19:0/375186138 wait complete. 2024-04-25T10:26:42.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.947+0000 7f7632c00640 1 Processor -- start 2024-04-25T10:26:42.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.948+0000 7f7632c00640 1 -- start start 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.949+0000 7f7632c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f762c06fd20 0x7f762c1f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.949+0000 7f7632c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f762c0c77a0 0x7f762c146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.949+0000 7f7632c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f762c1544e0 0x7f762c152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.949+0000 7f7632c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f762c0c6a60 con 0x7f762c06fd20 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.949+0000 7f7632c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f762c0c6780 con 0x7f762c0c77a0 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.949+0000 7f7632c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f762c073010 con 0x7f762c1544e0 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.949+0000 7f7631800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f762c06fd20 0x7f762c1f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.949+0000 7f7631800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f762c06fd20 0x7f762c1f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53962/0 (socket says 172.21.15.19:53962) 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.949+0000 7f7631800640 1 -- 172.21.15.19:0/328496856 learned_addr learned my addr 172.21.15.19:0/328496856 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.949+0000 7f7632200640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f762c1544e0 0x7f762c152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.949+0000 7f7630e00640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f762c0c77a0 0x7f762c146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.950+0000 7f7631800640 1 -- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f762c1544e0 msgr2=0x7f762c152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.950+0000 7f7631800640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f762c1544e0 0x7f762c152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.950+0000 7f7631800640 1 -- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f762c0c77a0 msgr2=0x7f762c146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:42.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.950+0000 7f7631800640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f762c0c77a0 0x7f762c146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:42.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.950+0000 7f7631800640 1 -- 172.21.15.19:0/328496856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c1f5bf0 con 0x7f762c06fd20 2024-04-25T10:26:42.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.950+0000 7f7630e00640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f762c0c77a0 0x7f762c146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:42.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.950+0000 7f7632200640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f762c1544e0 0x7f762c152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:42.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.950+0000 7f7631800640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f762c06fd20 0x7f762c1f56b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f762000e990 tx=0x7f762000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.951+0000 7f7629600640 1 -- 172.21.15.19:0/328496856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620017070 con 0x7f762c06fd20 2024-04-25T10:26:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.951+0000 7f7629600640 1 -- 172.21.15.19:0/328496856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f762000c980 con 0x7f762c06fd20 2024-04-25T10:26:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.951+0000 7f7629600640 1 -- 172.21.15.19:0/328496856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762000cd50 con 0x7f762c06fd20 2024-04-25T10:26:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.951+0000 7f7632c00640 1 -- 172.21.15.19:0/328496856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762c0c8240 con 0x7f762c06fd20 2024-04-25T10:26:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.951+0000 7f7632c00640 1 -- 172.21.15.19:0/328496856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762c14f320 con 0x7f762c06fd20 2024-04-25T10:26:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.952+0000 7f7632c00640 1 -- 172.21.15.19:0/328496856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762c076520 con 0x7f762c06fd20 2024-04-25T10:26:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.953+0000 7f7629600640 1 -- 172.21.15.19:0/328496856 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f762001a070 con 0x7f762c06fd20 2024-04-25T10:26:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.954+0000 7f7629600640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f760c0744e0 0x7f760c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.954+0000 7f7629600640 1 -- 172.21.15.19:0/328496856 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f7620095270 con 0x7f762c06fd20 2024-04-25T10:26:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.955+0000 7f7630e00640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f760c0744e0 0x7f760c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.955+0000 7f7630e00640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f760c0744e0 0x7f760c0769f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7618034000 tx=0x7f761802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:42.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:42.959+0000 7f7629600640 1 -- 172.21.15.19:0/328496856 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f762005f0d0 con 0x7f762c06fd20 2024-04-25T10:26:43.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.165+0000 7f7632c00640 1 -- 172.21.15.19:0/328496856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f762c14ab00 con 0x7f762c06fd20 2024-04-25T10:26:43.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.167+0000 7f7629600640 1 -- 172.21.15.19:0/328496856 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f76200633d0 con 0x7f762c06fd20 2024-04-25T10:26:43.168 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-04-25T10:26:43.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.169+0000 7f7632c00640 1 -- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f760c0744e0 msgr2=0x7f760c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:43.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.169+0000 7f7632c00640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f760c0744e0 0x7f760c0769f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7618034000 tx=0x7f761802e000 comp rx=0 tx=0).stop 2024-04-25T10:26:43.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.169+0000 7f7632c00640 1 -- 172.21.15.19:0/328496856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f762c06fd20 msgr2=0x7f762c1f56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:43.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.169+0000 7f7632c00640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f762c06fd20 0x7f762c1f56b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f762000e990 tx=0x7f762000ee50 comp rx=0 tx=0).stop 2024-04-25T10:26:43.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.170+0000 7f7632c00640 1 -- 172.21.15.19:0/328496856 shutdown_connections 2024-04-25T10:26:43.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.170+0000 7f7632c00640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f760c0744e0 0x7f760c0769f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.170+0000 7f7632c00640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f762c1544e0 0x7f762c152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.170+0000 7f7632c00640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f762c0c77a0 0x7f762c146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.170+0000 7f7632c00640 1 --2- 172.21.15.19:0/328496856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f762c06fd20 0x7f762c1f56b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.170+0000 7f7632c00640 1 -- 172.21.15.19:0/328496856 >> 172.21.15.19:0/328496856 conn(0x7f762c0ca120 msgr2=0x7f762c06ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:43.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.170+0000 7f7632c00640 1 -- 172.21.15.19:0/328496856 shutdown_connections 2024-04-25T10:26:43.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.170+0000 7f7632c00640 1 -- 172.21.15.19:0/328496856 wait complete. 2024-04-25T10:26:43.199 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:26:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.475+0000 7f17d5800640 1 Processor -- start 2024-04-25T10:26:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.476+0000 7f17d5800640 1 -- start start 2024-04-25T10:26:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.478+0000 7f17d5800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 0x7f17d00c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.478+0000 7f17d5800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17d0156710 0x7f17d006ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.478+0000 7f17d5800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17d006f2a0 0x7f17d015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.478+0000 7f17d5800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f17d006ffd0 con 0x7f17d006f2a0 2024-04-25T10:26:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.478+0000 7f17d5800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f17d00c8b10 con 0x7f17d0156710 2024-04-25T10:26:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.478+0000 7f17d5800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f17d0070200 con 0x7f17d00c2640 2024-04-25T10:26:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.478+0000 7f17d4e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17d006f2a0 0x7f17d015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.478+0000 7f17cfe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 0x7f17d00c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.479+0000 7f17d4e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17d006f2a0 0x7f17d015f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53966/0 (socket says 172.21.15.19:53966) 2024-04-25T10:26:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.479+0000 7f17d4e00640 1 -- 172.21.15.19:0/3032150817 learned_addr learned my addr 172.21.15.19:0/3032150817 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.479+0000 7f17cf400640 1 --2- 172.21.15.19:0/3032150817 >> v2:172.21.15.112:3300/0 conn(0x7f17d0156710 0x7f17d006ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.479+0000 7f17cfe00640 1 -- 172.21.15.19:0/3032150817 >> v2:172.21.15.112:3300/0 conn(0x7f17d0156710 msgr2=0x7f17d006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.479+0000 7f17cfe00640 1 --2- 172.21.15.19:0/3032150817 >> v2:172.21.15.112:3300/0 conn(0x7f17d0156710 0x7f17d006ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.479+0000 7f17cfe00640 1 -- 172.21.15.19:0/3032150817 >> v2:172.21.15.19:3300/0 conn(0x7f17d006f2a0 msgr2=0x7f17d015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.479+0000 7f17cfe00640 1 --2- 172.21.15.19:0/3032150817 >> v2:172.21.15.19:3300/0 conn(0x7f17d006f2a0 0x7f17d015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.479+0000 7f17cfe00640 1 -- 172.21.15.19:0/3032150817 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d00c8d60 con 0x7f17d00c2640 2024-04-25T10:26:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.479+0000 7f17d4e00640 1 --2- 172.21.15.19:0/3032150817 >> v2:172.21.15.19:3300/0 conn(0x7f17d006f2a0 0x7f17d015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.480+0000 7f17cfe00640 1 --2- 172.21.15.19:0/3032150817 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 0x7f17d00c9710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f17d0072680 tx=0x7f17c002a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e334dfa0bbbb8116 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.481+0000 7f17cea00640 1 -- 172.21.15.19:0/3032150817 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c0007740 con 0x7f17d00c2640 2024-04-25T10:26:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.481+0000 7f17cea00640 1 -- 172.21.15.19:0/3032150817 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c00078e0 con 0x7f17d00c2640 2024-04-25T10:26:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.481+0000 7f17cea00640 1 -- 172.21.15.19:0/3032150817 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c0007cb0 con 0x7f17d00c2640 2024-04-25T10:26:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.482+0000 7f17d5800640 1 -- 172.21.15.19:0/3032150817 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 msgr2=0x7f17d00c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.482+0000 7f17d5800640 1 --2- 172.21.15.19:0/3032150817 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 0x7f17d00c9710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f17d0072680 tx=0x7f17c002a540 comp rx=0 tx=0).stop 2024-04-25T10:26:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.482+0000 7f17d5800640 1 -- 172.21.15.19:0/3032150817 shutdown_connections 2024-04-25T10:26:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.482+0000 7f17d5800640 1 --2- 172.21.15.19:0/3032150817 >> v2:172.21.15.19:3300/0 conn(0x7f17d006f2a0 0x7f17d015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.482+0000 7f17d5800640 1 --2- 172.21.15.19:0/3032150817 >> v2:172.21.15.112:3300/0 conn(0x7f17d0156710 0x7f17d006ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.482+0000 7f17d5800640 1 --2- 172.21.15.19:0/3032150817 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 0x7f17d00c9710 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.482+0000 7f17d5800640 1 -- 172.21.15.19:0/3032150817 >> 172.21.15.19:0/3032150817 conn(0x7f17d00ca120 msgr2=0x7f17d00ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.482+0000 7f17d5800640 1 -- 172.21.15.19:0/3032150817 shutdown_connections 2024-04-25T10:26:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.482+0000 7f17d5800640 1 -- 172.21.15.19:0/3032150817 wait complete. 2024-04-25T10:26:43.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.485+0000 7f17d5800640 1 Processor -- start 2024-04-25T10:26:43.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.485+0000 7f17d5800640 1 -- start start 2024-04-25T10:26:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.487+0000 7f17d5800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d006f2a0 0x7f17d014cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.487+0000 7f17d5800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 0x7f17d01e5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.487+0000 7f17d5800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17d0156710 0x7f17d0149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.487+0000 7f17d5800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f17d00c91f0 con 0x7f17d0156710 2024-04-25T10:26:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.487+0000 7f17d5800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f17d00c84a0 con 0x7f17d006f2a0 2024-04-25T10:26:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.487+0000 7f17d5800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f17d0074990 con 0x7f17d00c2640 2024-04-25T10:26:43.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.487+0000 7f17d4e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17d0156710 0x7f17d0149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:43.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17cfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d006f2a0 0x7f17d014cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17cf400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 0x7f17d01e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17cfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d006f2a0 0x7f17d014cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:51994/0 (socket says 172.21.15.19:51994) 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17d4e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17d0156710 0x7f17d0149e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53976/0 (socket says 172.21.15.19:53976) 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17cfe00640 1 -- 172.21.15.19:0/3723695798 learned_addr learned my addr 172.21.15.19:0/3723695798 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17cf400640 1 -- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d006f2a0 msgr2=0x7f17d014cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17cf400640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d006f2a0 0x7f17d014cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17cf400640 1 -- 172.21.15.19:0/3723695798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17d0156710 msgr2=0x7f17d0149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17cf400640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17d0156710 0x7f17d0149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17cf400640 1 -- 172.21.15.19:0/3723695798 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d01f3860 con 0x7f17d00c2640 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17cfe00640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d006f2a0 0x7f17d014cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.488+0000 7f17cf400640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 0x7f17d01e5910 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00e8a0 tx=0x7f17bc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.489+0000 7f17c7e00640 1 -- 172.21.15.19:0/3723695798 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc017070 con 0x7f17d00c2640 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.489+0000 7f17c7e00640 1 -- 172.21.15.19:0/3723695798 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17bc00c940 con 0x7f17d00c2640 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.489+0000 7f17c7e00640 1 -- 172.21.15.19:0/3723695798 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc009e60 con 0x7f17d00c2640 2024-04-25T10:26:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.489+0000 7f17d5800640 1 -- 172.21.15.19:0/3723695798 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d01e8790 con 0x7f17d00c2640 2024-04-25T10:26:43.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.489+0000 7f17d5800640 1 -- 172.21.15.19:0/3723695798 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d014dcf0 con 0x7f17d00c2640 2024-04-25T10:26:43.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.490+0000 7f17d5800640 1 -- 172.21.15.19:0/3723695798 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17d0076520 con 0x7f17d00c2640 2024-04-25T10:26:43.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.491+0000 7f17c7e00640 1 -- 172.21.15.19:0/3723695798 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f17bc01a070 con 0x7f17d00c2640 2024-04-25T10:26:43.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.492+0000 7f17c7e00640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f17b00744e0 0x7f17b00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:43.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.493+0000 7f17c7e00640 1 -- 172.21.15.19:0/3723695798 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f17bc0955f0 con 0x7f17d00c2640 2024-04-25T10:26:43.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.493+0000 7f17cfe00640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f17b00744e0 0x7f17b00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:43.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.494+0000 7f17cfe00640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f17b00744e0 0x7f17b00769f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f17c0000f80 tx=0x7f17c002f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:43.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.498+0000 7f17c7e00640 1 -- 172.21.15.19:0/3723695798 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f17bc05f440 con 0x7f17d00c2640 2024-04-25T10:26:43.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.712+0000 7f17d5800640 1 -- 172.21.15.19:0/3723695798 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f17d0073a80 con 0x7f17d00c2640 2024-04-25T10:26:43.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.713+0000 7f17c7e00640 1 -- 172.21.15.19:0/3723695798 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f17bc063740 con 0x7f17d00c2640 2024-04-25T10:26:43.715 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:26:43.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 -- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f17b00744e0 msgr2=0x7f17b00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f17b00744e0 0x7f17b00769f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f17c0000f80 tx=0x7f17c002f000 comp rx=0 tx=0).stop 2024-04-25T10:26:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 -- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 msgr2=0x7f17d01e5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 0x7f17d01e5910 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00e8a0 tx=0x7f17bc00ed60 comp rx=0 tx=0).stop 2024-04-25T10:26:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 -- 172.21.15.19:0/3723695798 shutdown_connections 2024-04-25T10:26:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17d0156710 0x7f17d0149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f17b00744e0 0x7f17b00769f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d00c2640 0x7f17d01e5910 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 --2- 172.21.15.19:0/3723695798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d006f2a0 0x7f17d014cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 -- 172.21.15.19:0/3723695798 >> 172.21.15.19:0/3723695798 conn(0x7f17d00ca120 msgr2=0x7f17d015c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 -- 172.21.15.19:0/3723695798 shutdown_connections 2024-04-25T10:26:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:43.716+0000 7f17d5800640 1 -- 172.21.15.19:0/3723695798 wait complete. 2024-04-25T10:26:43.743 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:26:44.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.032+0000 7ff094a00640 1 Processor -- start 2024-04-25T10:26:44.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.032+0000 7ff094a00640 1 -- start start 2024-04-25T10:26:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.034+0000 7ff094a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff090152e80 0x7ff090073960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.034+0000 7ff094a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff09015cb10 0x7ff0900c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.034+0000 7ff094a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0900c4bd0 con 0x7ff0900c40d0 2024-04-25T10:26:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.034+0000 7ff094a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff090158bb0 con 0x7ff09015cb10 2024-04-25T10:26:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.034+0000 7ff094a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff090158e70 con 0x7ff090152e80 2024-04-25T10:26:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.034+0000 7ff08e800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff09015cb10 0x7ff0900c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.034+0000 7ff08de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff090152e80 0x7ff090073960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.034+0000 7ff087e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff0900c40d0 0x7ff09015c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:54986/0 (socket says 172.21.15.19:54986) 2024-04-25T10:26:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.035+0000 7ff087e00640 1 -- 172.21.15.19:0/2587916328 learned_addr learned my addr 172.21.15.19:0/2587916328 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:44.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.035+0000 7ff08de00640 1 -- 172.21.15.19:0/2587916328 >> v2:172.21.15.19:3300/0 conn(0x7ff09015cb10 msgr2=0x7ff0900c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:44.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.035+0000 7ff08de00640 1 --2- 172.21.15.19:0/2587916328 >> v2:172.21.15.19:3300/0 conn(0x7ff09015cb10 0x7ff0900c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.035+0000 7ff08de00640 1 -- 172.21.15.19:0/2587916328 >> v1:172.21.15.112:6789/0 conn(0x7ff0900c40d0 legacy=0x7ff09015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.035+0000 7ff08de00640 1 -- 172.21.15.19:0/2587916328 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff090159150 con 0x7ff090152e80 2024-04-25T10:26:44.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.035+0000 7ff08d400640 1 -- 172.21.15.19:0/2587916328 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584318641 0 0) 0x7ff0900c4bd0 con 0x7ff0900c40d0 2024-04-25T10:26:44.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.036+0000 7ff08de00640 1 --2- 172.21.15.19:0/2587916328 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff090152e80 0x7ff090073960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0800097a0 tx=0x7ff08002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e4c08de0a8687ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:44.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.036+0000 7ff08d400640 1 -- 172.21.15.19:0/2587916328 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080037070 con 0x7ff090152e80 2024-04-25T10:26:44.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.036+0000 7ff08d400640 1 -- 172.21.15.19:0/2587916328 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff080032440 con 0x7ff090152e80 2024-04-25T10:26:44.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.036+0000 7ff08d400640 1 -- 172.21.15.19:0/2587916328 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080032810 con 0x7ff090152e80 2024-04-25T10:26:44.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.037+0000 7ff094a00640 1 -- 172.21.15.19:0/2587916328 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff090152e80 msgr2=0x7ff090073960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.037+0000 7ff094a00640 1 --2- 172.21.15.19:0/2587916328 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff090152e80 0x7ff090073960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0800097a0 tx=0x7ff08002a230 comp rx=0 tx=0).stop 2024-04-25T10:26:44.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.037+0000 7ff094a00640 1 -- 172.21.15.19:0/2587916328 shutdown_connections 2024-04-25T10:26:44.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.037+0000 7ff094a00640 1 --2- 172.21.15.19:0/2587916328 >> v2:172.21.15.19:3300/0 conn(0x7ff09015cb10 0x7ff0900c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.037+0000 7ff094a00640 1 --2- 172.21.15.19:0/2587916328 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff090152e80 0x7ff090073960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.037+0000 7ff094a00640 1 -- 172.21.15.19:0/2587916328 >> 172.21.15.19:0/2587916328 conn(0x7ff09006f1f0 msgr2=0x7ff09006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:44.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.037+0000 7ff094a00640 1 -- 172.21.15.19:0/2587916328 shutdown_connections 2024-04-25T10:26:44.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.037+0000 7ff094a00640 1 -- 172.21.15.19:0/2587916328 wait complete. 2024-04-25T10:26:44.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.040+0000 7ff094a00640 1 Processor -- start 2024-04-25T10:26:44.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.040+0000 7ff094a00640 1 -- start start 2024-04-25T10:26:44.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.041+0000 7ff094a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0900c40d0 0x7ff0900c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.041+0000 7ff094a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff090152e80 0x7ff09014c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.041+0000 7ff094a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09015cb10 0x7ff0900cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.041+0000 7ff094a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff0900c2a10 con 0x7ff090152e80 2024-04-25T10:26:44.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.041+0000 7ff094a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff090159710 con 0x7ff09015cb10 2024-04-25T10:26:44.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.041+0000 7ff094a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff090073ea0 con 0x7ff0900c40d0 2024-04-25T10:26:44.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.042+0000 7ff087e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff090152e80 0x7ff09014c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.042+0000 7ff087e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff090152e80 0x7ff09014c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54000/0 (socket says 172.21.15.19:54000) 2024-04-25T10:26:44.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.042+0000 7ff08de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0900c40d0 0x7ff0900c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.042+0000 7ff087e00640 1 -- 172.21.15.19:0/2740562955 learned_addr learned my addr 172.21.15.19:0/2740562955 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:44.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.042+0000 7ff08e800640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09015cb10 0x7ff0900cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.042+0000 7ff08de00640 1 -- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09015cb10 msgr2=0x7ff0900cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.042+0000 7ff08de00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09015cb10 0x7ff0900cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.042+0000 7ff08de00640 1 -- 172.21.15.19:0/2740562955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff090152e80 msgr2=0x7ff09014c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.042+0000 7ff08de00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff090152e80 0x7ff09014c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.042+0000 7ff08de00640 1 -- 172.21.15.19:0/2740562955 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0900c8240 con 0x7ff0900c40d0 2024-04-25T10:26:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.042+0000 7ff087e00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff090152e80 0x7ff09014c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.043+0000 7ff08de00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0900c40d0 0x7ff0900c7690 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff080031000 tx=0x7ff0800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:44.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.043+0000 7ff086000640 1 -- 172.21.15.19:0/2740562955 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080041020 con 0x7ff0900c40d0 2024-04-25T10:26:44.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.043+0000 7ff086000640 1 -- 172.21.15.19:0/2740562955 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff080030700 con 0x7ff0900c40d0 2024-04-25T10:26:44.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.043+0000 7ff086000640 1 -- 172.21.15.19:0/2740562955 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080037040 con 0x7ff0900c40d0 2024-04-25T10:26:44.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.043+0000 7ff094a00640 1 -- 172.21.15.19:0/2740562955 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0900c8520 con 0x7ff0900c40d0 2024-04-25T10:26:44.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.043+0000 7ff094a00640 1 -- 172.21.15.19:0/2740562955 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09015bd70 con 0x7ff0900c40d0 2024-04-25T10:26:44.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.044+0000 7ff094a00640 1 -- 172.21.15.19:0/2740562955 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff090076520 con 0x7ff0900c40d0 2024-04-25T10:26:44.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.046+0000 7ff086000640 1 -- 172.21.15.19:0/2740562955 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff080044020 con 0x7ff0900c40d0 2024-04-25T10:26:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.047+0000 7ff086000640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff06c0744b0 0x7ff06c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.047+0000 7ff086000640 1 -- 172.21.15.19:0/2740562955 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7ff0800b5a10 con 0x7ff0900c40d0 2024-04-25T10:26:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.047+0000 7ff087e00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff06c0744b0 0x7ff06c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.048+0000 7ff087e00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff06c0744b0 0x7ff06c0769c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff0900c70a0 tx=0x7ff078007ea0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:44.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.052+0000 7ff086000640 1 -- 172.21.15.19:0/2740562955 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff08004b030 con 0x7ff0900c40d0 2024-04-25T10:26:44.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.259+0000 7ff094a00640 1 -- 172.21.15.19:0/2740562955 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff0901588c0 con 0x7ff0900c40d0 2024-04-25T10:26:44.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.259+0000 7ff086000640 1 -- 172.21.15.19:0/2740562955 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7ff08007f740 con 0x7ff0900c40d0 2024-04-25T10:26:44.262 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-04-25T10:26:44.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 -- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff06c0744b0 msgr2=0x7ff06c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff06c0744b0 0x7ff06c0769c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff0900c70a0 tx=0x7ff078007ea0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 -- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0900c40d0 msgr2=0x7ff0900c7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0900c40d0 0x7ff0900c7690 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff080031000 tx=0x7ff0800046c0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 -- 172.21.15.19:0/2740562955 shutdown_connections 2024-04-25T10:26:44.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff09015cb10 0x7ff0900cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff090152e80 0x7ff09014c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff06c0744b0 0x7ff06c0769c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 --2- 172.21.15.19:0/2740562955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff0900c40d0 0x7ff0900c7690 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 -- 172.21.15.19:0/2740562955 >> 172.21.15.19:0/2740562955 conn(0x7ff09006f1f0 msgr2=0x7ff0900ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:44.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 -- 172.21.15.19:0/2740562955 shutdown_connections 2024-04-25T10:26:44.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.262+0000 7ff094a00640 1 -- 172.21.15.19:0/2740562955 wait complete. 2024-04-25T10:26:44.290 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:26:44.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.562+0000 7efd56a00640 1 Processor -- start 2024-04-25T10:26:44.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.562+0000 7efd56a00640 1 -- start start 2024-04-25T10:26:44.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.565+0000 7efd56a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efd500c74c0 0x7efd50153450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.565+0000 7efd56a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd500c2640 0x7efd501590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.565+0000 7efd56a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd500c9730 con 0x7efd500c2a50 2024-04-25T10:26:44.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.565+0000 7efd56a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7efd500703c0 con 0x7efd500c2640 2024-04-25T10:26:44.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.565+0000 7efd56a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efd500c2fe0 con 0x7efd500c74c0 2024-04-25T10:26:44.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.565+0000 7efd56000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efd500c2a50 0x7efd50074120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:54994/0 (socket says 172.21.15.19:54994) 2024-04-25T10:26:44.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.565+0000 7efd56000640 1 -- 172.21.15.19:0/631452030 learned_addr learned my addr 172.21.15.19:0/631452030 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:44.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.565+0000 7efd55600640 1 --2- 172.21.15.19:0/631452030 >> v2:172.21.15.112:3300/0 conn(0x7efd500c74c0 0x7efd50153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.565+0000 7efd54c00640 1 --2- 172.21.15.19:0/631452030 >> v2:172.21.15.19:3300/0 conn(0x7efd500c2640 0x7efd501590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.566+0000 7efd4fe00640 1 -- 172.21.15.19:0/631452030 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3390844365 0 0) 0x7efd500c9730 con 0x7efd500c2a50 2024-04-25T10:26:44.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.566+0000 7efd4fe00640 1 -- 172.21.15.19:0/631452030 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd38003520 con 0x7efd500c2a50 2024-04-25T10:26:44.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.566+0000 7efd54c00640 1 -- 172.21.15.19:0/631452030 >> v2:172.21.15.112:3300/0 conn(0x7efd500c74c0 msgr2=0x7efd50153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:44.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.566+0000 7efd54c00640 1 --2- 172.21.15.19:0/631452030 >> v2:172.21.15.112:3300/0 conn(0x7efd500c74c0 0x7efd50153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.566+0000 7efd54c00640 1 -- 172.21.15.19:0/631452030 >> v1:172.21.15.112:6789/0 conn(0x7efd500c2a50 legacy=0x7efd50074120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.566+0000 7efd54c00640 1 -- 172.21.15.19:0/631452030 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd500c99d0 con 0x7efd500c2640 2024-04-25T10:26:44.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.566+0000 7efd55600640 1 --2- 172.21.15.19:0/631452030 >> v2:172.21.15.112:3300/0 conn(0x7efd500c74c0 0x7efd50153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:44.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.567+0000 7efd54c00640 1 --2- 172.21.15.19:0/631452030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd500c2640 0x7efd501590b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd50074c20 tx=0x7efd3c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587765dc2ba4a895 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:44.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.567+0000 7efd4fe00640 1 -- 172.21.15.19:0/631452030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c037070 con 0x7efd500c2640 2024-04-25T10:26:44.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.567+0000 7efd4fe00640 1 -- 172.21.15.19:0/631452030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3c032440 con 0x7efd500c2640 2024-04-25T10:26:44.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.567+0000 7efd4fe00640 1 -- 172.21.15.19:0/631452030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0327f0 con 0x7efd500c2640 2024-04-25T10:26:44.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.568+0000 7efd56a00640 1 -- 172.21.15.19:0/631452030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd500c2640 msgr2=0x7efd501590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.568+0000 7efd56a00640 1 --2- 172.21.15.19:0/631452030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd500c2640 0x7efd501590b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd50074c20 tx=0x7efd3c02a230 comp rx=0 tx=0).stop 2024-04-25T10:26:44.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.568+0000 7efd56a00640 1 -- 172.21.15.19:0/631452030 shutdown_connections 2024-04-25T10:26:44.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.568+0000 7efd56a00640 1 --2- 172.21.15.19:0/631452030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd500c2640 0x7efd501590b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.568+0000 7efd56a00640 1 --2- 172.21.15.19:0/631452030 >> v2:172.21.15.112:3300/0 conn(0x7efd500c74c0 0x7efd50153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.569+0000 7efd56a00640 1 -- 172.21.15.19:0/631452030 >> 172.21.15.19:0/631452030 conn(0x7efd500ca120 msgr2=0x7efd500ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:44.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.569+0000 7efd56a00640 1 -- 172.21.15.19:0/631452030 shutdown_connections 2024-04-25T10:26:44.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.569+0000 7efd56a00640 1 -- 172.21.15.19:0/631452030 wait complete. 2024-04-25T10:26:44.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.571+0000 7efd56a00640 1 Processor -- start 2024-04-25T10:26:44.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.571+0000 7efd56a00640 1 -- start start 2024-04-25T10:26:44.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd56a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd500c2a50 0x7efd501f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd56a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd500c74c0 0x7efd501ebee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd56a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd50148df0 0x7efd50149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd56a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd500c3580 con 0x7efd500c74c0 2024-04-25T10:26:44.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd56a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efd500c32a0 con 0x7efd500c2a50 2024-04-25T10:26:44.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd56a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efd500c3aa0 con 0x7efd50148df0 2024-04-25T10:26:44.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd54c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd500c74c0 0x7efd501ebee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd55600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd500c2a50 0x7efd501f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd55600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd500c2a50 0x7efd501f2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:52018/0 (socket says 172.21.15.19:52018) 2024-04-25T10:26:44.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd54c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd500c74c0 0x7efd501ebee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54020/0 (socket says 172.21.15.19:54020) 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd55600640 1 -- 172.21.15.19:0/3915404864 learned_addr learned my addr 172.21.15.19:0/3915404864 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd56000640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd50148df0 0x7efd50149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd55600640 1 -- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd50148df0 msgr2=0x7efd50149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd55600640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd50148df0 0x7efd50149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd55600640 1 -- 172.21.15.19:0/3915404864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd500c74c0 msgr2=0x7efd501ebee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd55600640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd500c74c0 0x7efd501ebee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd55600640 1 -- 172.21.15.19:0/3915404864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd501ec420 con 0x7efd500c2a50 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.573+0000 7efd54c00640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd500c74c0 0x7efd501ebee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.574+0000 7efd55600640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd500c2a50 0x7efd501f2c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efd4400e9c0 tx=0x7efd4400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.574+0000 7efd4d600640 1 -- 172.21.15.19:0/3915404864 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44017070 con 0x7efd500c2a50 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.574+0000 7efd4d600640 1 -- 172.21.15.19:0/3915404864 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd4400ca60 con 0x7efd500c2a50 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.574+0000 7efd4d600640 1 -- 172.21.15.19:0/3915404864 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4400ce30 con 0x7efd500c2a50 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.574+0000 7efd56a00640 1 -- 172.21.15.19:0/3915404864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5015a5b0 con 0x7efd500c2a50 2024-04-25T10:26:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.574+0000 7efd56a00640 1 -- 172.21.15.19:0/3915404864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5015ab70 con 0x7efd500c2a50 2024-04-25T10:26:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.576+0000 7efd56a00640 1 -- 172.21.15.19:0/3915404864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd50076520 con 0x7efd500c2a50 2024-04-25T10:26:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.577+0000 7efd4d600640 1 -- 172.21.15.19:0/3915404864 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efd4401a070 con 0x7efd500c2a50 2024-04-25T10:26:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.578+0000 7efd4d600640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efd300744e0 0x7efd300769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.578+0000 7efd4d600640 1 -- 172.21.15.19:0/3915404864 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7efd44095430 con 0x7efd500c2a50 2024-04-25T10:26:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.578+0000 7efd54c00640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efd300744e0 0x7efd300769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.579+0000 7efd54c00640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efd300744e0 0x7efd300769f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efd3c034000 tx=0x7efd3c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:44.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.583+0000 7efd4d600640 1 -- 172.21.15.19:0/3915404864 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efd4405f1f0 con 0x7efd500c2a50 2024-04-25T10:26:44.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.789+0000 7efd56a00640 1 -- 172.21.15.19:0/3915404864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7efd500c8af0 con 0x7efd500c2a50 2024-04-25T10:26:44.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.790+0000 7efd4d600640 1 -- 172.21.15.19:0/3915404864 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7efd440634f0 con 0x7efd500c2a50 2024-04-25T10:26:44.792 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:26:44.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 -- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efd300744e0 msgr2=0x7efd300769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efd300744e0 0x7efd300769f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efd3c034000 tx=0x7efd3c02e000 comp rx=0 tx=0).stop 2024-04-25T10:26:44.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 -- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd500c2a50 msgr2=0x7efd501f2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:44.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd500c2a50 0x7efd501f2c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efd4400e9c0 tx=0x7efd4400ee80 comp rx=0 tx=0).stop 2024-04-25T10:26:44.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 -- 172.21.15.19:0/3915404864 shutdown_connections 2024-04-25T10:26:44.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7efd300744e0 0x7efd300769f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd50148df0 0x7efd50149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd500c74c0 0x7efd501ebee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 --2- 172.21.15.19:0/3915404864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd500c2a50 0x7efd501f2c90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:44.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 -- 172.21.15.19:0/3915404864 >> 172.21.15.19:0/3915404864 conn(0x7efd500ca120 msgr2=0x7efd50072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:44.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 -- 172.21.15.19:0/3915404864 shutdown_connections 2024-04-25T10:26:44.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:44.794+0000 7efd56a00640 1 -- 172.21.15.19:0/3915404864 wait complete. 2024-04-25T10:26:44.824 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:26:45.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.101+0000 7fd5b5a00640 1 Processor -- start 2024-04-25T10:26:45.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.101+0000 7fd5b5a00640 1 -- start start 2024-04-25T10:26:45.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.104+0000 7fd5b5a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5b00ce660 0x7fd5b01567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.104+0000 7fd5b5a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b015c5f0 con 0x7fd5b00b4090 2024-04-25T10:26:45.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.104+0000 7fd5b5a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b015c8d0 con 0x7fd5b00b50e0 2024-04-25T10:26:45.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.104+0000 7fd5b5a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b015cbb0 con 0x7fd5b00ce660 2024-04-25T10:26:45.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.104+0000 7fd5afe00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd5b00b4090 0x7fd5b00b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39658/0 (socket says 172.21.15.19:39658) 2024-04-25T10:26:45.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.104+0000 7fd5afe00640 1 -- 172.21.15.19:0/3790250170 learned_addr learned my addr 172.21.15.19:0/3790250170 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:26:45.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.104+0000 7fd5b5000640 1 --2- 172.21.15.19:0/3790250170 >> v2:172.21.15.19:3300/0 conn(0x7fd5b00ce660 0x7fd5b01567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.105+0000 7fd5b5000640 1 -- 172.21.15.19:0/3790250170 >> v1:172.21.15.112:6789/0 conn(0x7fd5b00b50e0 legacy=0x7fd5b00cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.105+0000 7fd5b5000640 1 -- 172.21.15.19:0/3790250170 >> v1:172.21.15.19:6789/0 conn(0x7fd5b00b4090 legacy=0x7fd5b00b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.105+0000 7fd5af400640 1 -- 172.21.15.19:0/3790250170 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1238518189 0 0) 0x7fd5b015c8d0 con 0x7fd5b00b50e0 2024-04-25T10:26:45.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.105+0000 7fd5b5000640 1 -- 172.21.15.19:0/3790250170 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b015ce90 con 0x7fd5b00ce660 2024-04-25T10:26:45.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.106+0000 7fd5b5000640 1 --2- 172.21.15.19:0/3790250170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b00ce660 0x7fd5b01567a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009d90 tx=0x7fd5a802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efaa875b0a927947 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:45.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.106+0000 7fd5af400640 1 -- 172.21.15.19:0/3790250170 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8007740 con 0x7fd5b00ce660 2024-04-25T10:26:45.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.106+0000 7fd5af400640 1 -- 172.21.15.19:0/3790250170 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a80078e0 con 0x7fd5b00ce660 2024-04-25T10:26:45.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.106+0000 7fd5af400640 1 -- 172.21.15.19:0/3790250170 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8007cb0 con 0x7fd5b00ce660 2024-04-25T10:26:45.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.107+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3790250170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b00ce660 msgr2=0x7fd5b01567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.107+0000 7fd5b5a00640 1 --2- 172.21.15.19:0/3790250170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b00ce660 0x7fd5b01567a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009d90 tx=0x7fd5a802a5f0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.107+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3790250170 shutdown_connections 2024-04-25T10:26:45.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.107+0000 7fd5b5a00640 1 --2- 172.21.15.19:0/3790250170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b00ce660 0x7fd5b01567a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.107+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3790250170 >> 172.21.15.19:0/3790250170 conn(0x7fd5b008d940 msgr2=0x7fd5b008dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:45.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.107+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3790250170 shutdown_connections 2024-04-25T10:26:45.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.107+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3790250170 wait complete. 2024-04-25T10:26:45.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.110+0000 7fd5b5a00640 1 Processor -- start 2024-04-25T10:26:45.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.110+0000 7fd5b5a00640 1 -- start start 2024-04-25T10:26:45.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.111+0000 7fd5b5a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b00b4090 0x7fd5b01603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.111+0000 7fd5b5a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b00b50e0 0x7fd5b00cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.111+0000 7fd5b5a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5b00ce660 0x7fd5b014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.111+0000 7fd5b5a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b00b4e70 con 0x7fd5b00b50e0 2024-04-25T10:26:45.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.111+0000 7fd5b5a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b00b4cf0 con 0x7fd5b00b4090 2024-04-25T10:26:45.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.111+0000 7fd5b5a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b00ccdc0 con 0x7fd5b00ce660 2024-04-25T10:26:45.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5afe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b00b4090 0x7fd5b01603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5afe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b00b4090 0x7fd5b01603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:52032/0 (socket says 172.21.15.19:52032) 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5afe00640 1 -- 172.21.15.19:0/3538256229 learned_addr learned my addr 172.21.15.19:0/3538256229 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5b5000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5b00ce660 0x7fd5b014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5a7e00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b00b50e0 0x7fd5b00cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5afe00640 1 -- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5b00ce660 msgr2=0x7fd5b014fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5afe00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5b00ce660 0x7fd5b014fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5afe00640 1 -- 172.21.15.19:0/3538256229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b00b50e0 msgr2=0x7fd5b00cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5afe00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b00b50e0 0x7fd5b00cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5afe00640 1 -- 172.21.15.19:0/3538256229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b015d900 con 0x7fd5b00b4090 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5b5000640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5b00ce660 0x7fd5b014fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.112+0000 7fd5afe00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b00b4090 0x7fd5b01603b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000c4e0 tx=0x7fd5a000c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.113+0000 7fd5acc00640 1 -- 172.21.15.19:0/3538256229 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0018070 con 0x7fd5b00b4090 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.113+0000 7fd5acc00640 1 -- 172.21.15.19:0/3538256229 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a00074e0 con 0x7fd5b00b4090 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.113+0000 7fd5acc00640 1 -- 172.21.15.19:0/3538256229 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0004a20 con 0x7fd5b00b4090 2024-04-25T10:26:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.113+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3538256229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b015dbe0 con 0x7fd5b00b4090 2024-04-25T10:26:45.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.113+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3538256229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b015fe90 con 0x7fd5b00b4090 2024-04-25T10:26:45.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.114+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3538256229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b0050740 con 0x7fd5b00b4090 2024-04-25T10:26:45.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.115+0000 7fd5acc00640 1 -- 172.21.15.19:0/3538256229 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd5a001b070 con 0x7fd5b00b4090 2024-04-25T10:26:45.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.116+0000 7fd5acc00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd58c0744b0 0x7fd58c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.116+0000 7fd5acc00640 1 -- 172.21.15.19:0/3538256229 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fd5a00948b0 con 0x7fd5b00b4090 2024-04-25T10:26:45.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.117+0000 7fd5a7e00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd58c0744b0 0x7fd58c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.117+0000 7fd5a7e00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd58c0744b0 0x7fd58c0769c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd598000f60 tx=0x7fd598009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:45.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.121+0000 7fd5acc00640 1 -- 172.21.15.19:0/3538256229 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd5a005e670 con 0x7fd5b00b4090 2024-04-25T10:26:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.368+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3538256229 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5b006a240 con 0x7fd5b00b4090 2024-04-25T10:26:45.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.369+0000 7fd5acc00640 1 -- 172.21.15.19:0/3538256229 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7fd5a0062970 con 0x7fd5b00b4090 2024-04-25T10:26:45.371 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:45.371 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:26:45.371 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd58c0744b0 msgr2=0x7fd58c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd58c0744b0 0x7fd58c0769c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd598000f60 tx=0x7fd598009040 comp rx=0 tx=0).stop 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b00b4090 msgr2=0x7fd5b01603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b00b4090 0x7fd5b01603b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000c4e0 tx=0x7fd5a000c9a0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3538256229 shutdown_connections 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd58c0744b0 0x7fd58c0769c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5b00ce660 0x7fd5b014fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b00b50e0 0x7fd5b00cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 --2- 172.21.15.19:0/3538256229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5b00b4090 0x7fd5b01603b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3538256229 >> 172.21.15.19:0/3538256229 conn(0x7fd5b008d940 msgr2=0x7fd5b00b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3538256229 shutdown_connections 2024-04-25T10:26:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.372+0000 7fd5b5a00640 1 -- 172.21.15.19:0/3538256229 wait complete. 2024-04-25T10:26:45.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:26:45.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.662+0000 7f45b9c00640 1 Processor -- start 2024-04-25T10:26:45.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.662+0000 7f45b9c00640 1 -- start start 2024-04-25T10:26:45.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45b9c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f45b415a370 0x7f45b4070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45b9c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45b40c7f90 0x7f45b4073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45b9c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f45b40cac80 0x7f45b4073b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45b9c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f45b4072ea0 con 0x7f45b415a370 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45b9c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f45b4073180 con 0x7f45b40c7f90 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45b9c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f45b415a8b0 con 0x7f45b40cac80 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45b3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f45b415a370 0x7f45b4070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45abe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45b40c7f90 0x7f45b4073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45b9200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f45b40cac80 0x7f45b4073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45abe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45b40c7f90 0x7f45b4073610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:52040/0 (socket says 172.21.15.19:52040) 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45abe00640 1 -- 172.21.15.19:0/4131429682 learned_addr learned my addr 172.21.15.19:0/4131429682 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.665+0000 7f45b3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f45b415a370 0x7f45b4070860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54028/0 (socket says 172.21.15.19:54028) 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.666+0000 7f45abe00640 1 -- 172.21.15.19:0/4131429682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f45b40cac80 msgr2=0x7f45b4073b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.666+0000 7f45abe00640 1 --2- 172.21.15.19:0/4131429682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f45b40cac80 0x7f45b4073b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.666+0000 7f45abe00640 1 -- 172.21.15.19:0/4131429682 >> v2:172.21.15.19:3300/0 conn(0x7f45b415a370 msgr2=0x7f45b4070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:26:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.666+0000 7f45abe00640 1 --2- 172.21.15.19:0/4131429682 >> v2:172.21.15.19:3300/0 conn(0x7f45b415a370 0x7f45b4070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.666+0000 7f45abe00640 1 -- 172.21.15.19:0/4131429682 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b415ab70 con 0x7f45b40c7f90 2024-04-25T10:26:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.666+0000 7f45b9200640 1 --2- 172.21.15.19:0/4131429682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f45b40cac80 0x7f45b4073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:26:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.667+0000 7f45abe00640 1 --2- 172.21.15.19:0/4131429682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40c7f90 0x7f45b4073610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f45b40ce650 tx=0x7f459c02a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77fde14519ab3045 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.667+0000 7f45b3400640 1 -- 172.21.15.19:0/4131429682 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c037070 con 0x7f45b40c7f90 2024-04-25T10:26:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.667+0000 7f45b3400640 1 -- 172.21.15.19:0/4131429682 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c032440 con 0x7f45b40c7f90 2024-04-25T10:26:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.667+0000 7f45b3400640 1 -- 172.21.15.19:0/4131429682 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c032810 con 0x7f45b40c7f90 2024-04-25T10:26:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.668+0000 7f45b9c00640 1 -- 172.21.15.19:0/4131429682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40c7f90 msgr2=0x7f45b4073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.668+0000 7f45b9c00640 1 --2- 172.21.15.19:0/4131429682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40c7f90 0x7f45b4073610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f45b40ce650 tx=0x7f459c02a140 comp rx=0 tx=0).stop 2024-04-25T10:26:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.668+0000 7f45b9c00640 1 -- 172.21.15.19:0/4131429682 shutdown_connections 2024-04-25T10:26:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.668+0000 7f45b9c00640 1 --2- 172.21.15.19:0/4131429682 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f45b40cac80 0x7f45b4073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.668+0000 7f45b9c00640 1 --2- 172.21.15.19:0/4131429682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40c7f90 0x7f45b4073610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.668+0000 7f45b9c00640 1 --2- 172.21.15.19:0/4131429682 >> v2:172.21.15.19:3300/0 conn(0x7f45b415a370 0x7f45b4070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.668+0000 7f45b9c00640 1 -- 172.21.15.19:0/4131429682 >> 172.21.15.19:0/4131429682 conn(0x7f45b40cdbc0 msgr2=0x7f45b40ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:45.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.668+0000 7f45b9c00640 1 -- 172.21.15.19:0/4131429682 shutdown_connections 2024-04-25T10:26:45.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.668+0000 7f45b9c00640 1 -- 172.21.15.19:0/4131429682 wait complete. 2024-04-25T10:26:45.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.670+0000 7f45b9c00640 1 Processor -- start 2024-04-25T10:26:45.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.670+0000 7f45b9c00640 1 -- start start 2024-04-25T10:26:45.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.672+0000 7f45b9c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40c7f90 0x7f45b414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.672+0000 7f45b9c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40cac80 0x7f45b40c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.672+0000 7f45b9c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f45b415a370 0x7f45b4150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.672+0000 7f45b9c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f45b40c4b20 con 0x7f45b40c7f90 2024-04-25T10:26:45.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.672+0000 7f45b9c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f45b415b130 con 0x7f45b40cac80 2024-04-25T10:26:45.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.672+0000 7f45b9c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f45b4070da0 con 0x7f45b415a370 2024-04-25T10:26:45.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.672+0000 7f45b3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40c7f90 0x7f45b414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.672+0000 7f45b3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40c7f90 0x7f45b414eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54044/0 (socket says 172.21.15.19:54044) 2024-04-25T10:26:45.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.672+0000 7f45b3e00640 1 -- 172.21.15.19:0/4251242152 learned_addr learned my addr 172.21.15.19:0/4251242152 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:26:45.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.672+0000 7f45abe00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40cac80 0x7f45b40c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.672+0000 7f45b9200640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f45b415a370 0x7f45b4150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.673+0000 7f45b3e00640 1 -- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f45b415a370 msgr2=0x7f45b4150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.673+0000 7f45b3e00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f45b415a370 0x7f45b4150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.673+0000 7f45b3e00640 1 -- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40cac80 msgr2=0x7f45b40c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.673+0000 7f45b3e00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40cac80 0x7f45b40c3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.673+0000 7f45b3e00640 1 -- 172.21.15.19:0/4251242152 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b414f420 con 0x7f45b40c7f90 2024-04-25T10:26:45.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.673+0000 7f45b3e00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40c7f90 0x7f45b414eee0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f45a400e8a0 tx=0x7f45a400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:45.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.673+0000 7f45b0c00640 1 -- 172.21.15.19:0/4251242152 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4017070 con 0x7f45b40c7f90 2024-04-25T10:26:45.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.674+0000 7f45b0c00640 1 -- 172.21.15.19:0/4251242152 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a400ee90 con 0x7f45b40c7f90 2024-04-25T10:26:45.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.674+0000 7f45b9c00640 1 -- 172.21.15.19:0/4251242152 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b41f6ba0 con 0x7f45b40c7f90 2024-04-25T10:26:45.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.674+0000 7f45b0c00640 1 -- 172.21.15.19:0/4251242152 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a400cb80 con 0x7f45b40c7f90 2024-04-25T10:26:45.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.674+0000 7f45b9c00640 1 -- 172.21.15.19:0/4251242152 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b41f7160 con 0x7f45b40c7f90 2024-04-25T10:26:45.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.675+0000 7f45b9c00640 1 -- 172.21.15.19:0/4251242152 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b4050740 con 0x7f45b40c7f90 2024-04-25T10:26:45.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.676+0000 7f45b0c00640 1 -- 172.21.15.19:0/4251242152 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f45a401a070 con 0x7f45b40c7f90 2024-04-25T10:26:45.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.677+0000 7f45b0c00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f45900744e0 0x7f45900769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:26:45.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.677+0000 7f45b0c00640 1 -- 172.21.15.19:0/4251242152 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f45a4095330 con 0x7f45b40c7f90 2024-04-25T10:26:45.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.677+0000 7f45abe00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f45900744e0 0x7f45900769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:26:45.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.678+0000 7f45abe00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f45900744e0 0x7f45900769f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f459c034000 tx=0x7f459c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:26:45.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.682+0000 7f45b0c00640 1 -- 172.21.15.19:0/4251242152 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45a405f060 con 0x7f45b40c7f90 2024-04-25T10:26:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.886+0000 7f45b9c00640 1 -- 172.21.15.19:0/4251242152 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45b40c59e0 con 0x7f45b40c7f90 2024-04-25T10:26:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.888+0000 7f45b0c00640 1 -- 172.21.15.19:0/4251242152 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f45a4063360 con 0x7f45b40c7f90 2024-04-25T10:26:45.891 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:26:45.891 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:26:18.399567+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:26:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.891+0000 7f45b9c00640 1 -- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f45900744e0 msgr2=0x7f45900769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.891+0000 7f45b9c00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f45900744e0 0x7f45900769f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f459c034000 tx=0x7f459c02e000 comp rx=0 tx=0).stop 2024-04-25T10:26:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.891+0000 7f45b9c00640 1 -- 172.21.15.19:0/4251242152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40c7f90 msgr2=0x7f45b414eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:26:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.891+0000 7f45b9c00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40c7f90 0x7f45b414eee0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f45a400e8a0 tx=0x7f45a400eca0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.891+0000 7f45b9c00640 1 -- 172.21.15.19:0/4251242152 shutdown_connections 2024-04-25T10:26:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.891+0000 7f45b9c00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f45900744e0 0x7f45900769f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.891+0000 7f45b9c00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f45b415a370 0x7f45b4150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.891+0000 7f45b9c00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45b40cac80 0x7f45b40c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.891+0000 7f45b9c00640 1 --2- 172.21.15.19:0/4251242152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b40c7f90 0x7f45b414eee0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:26:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.891+0000 7f45b9c00640 1 -- 172.21.15.19:0/4251242152 >> 172.21.15.19:0/4251242152 conn(0x7f45b40cdbc0 msgr2=0x7f45b40c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:26:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.892+0000 7f45b9c00640 1 -- 172.21.15.19:0/4251242152 shutdown_connections 2024-04-25T10:26:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:26:45.892+0000 7f45b9c00640 1 -- 172.21.15.19:0/4251242152 wait complete. 2024-04-25T10:26:45.923 DEBUG:tasks.mds_thrash:Yielding 2024-04-25T10:26:45.923 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T10:26:45.935 INFO:tasks.workunit:Pulling workunits from ref 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:26:45.936 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T10:26:45.936 INFO:tasks.workunit:timeout=3h 2024-04-25T10:26:45.936 INFO:tasks.workunit:cleanup=True 2024-04-25T10:26:45.936 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T10:26:45.937 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2024-04-25T10:26:45.937 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 39 secs before thrashing 2024-04-25T10:26:45.991 INFO:teuthology.orchestra.run.smithi019.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T10:26:45.991 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-25T10:26:45.991 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 28h/40d Inode: 1 Links: 2 2024-04-25T10:26:45.992 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:26:45.992 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-25T10:26:45.992 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T10:26:45.992 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-04-25 10:25:42.155827295 +0000 2024-04-25T10:26:45.992 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-04-25 10:25:53.084604146 +0000 2024-04-25T10:26:45.992 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-04-25 10:25:42.155827295 +0000 2024-04-25T10:26:45.992 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T10:26:45.992 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T10:26:46.090 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:26:46.152 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T10:26:59.726 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:26:59.737 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:27:24.938 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:25.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.233+0000 7fb2c9800640 1 Processor -- start 2024-04-25T10:27:25.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.233+0000 7fb2c9800640 1 -- start start 2024-04-25T10:27:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.235+0000 7fb2c9800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb2c41616c0 0x7fb2c4073160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.235+0000 7fb2c9800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c40c3670 con 0x7fb2c40cdde0 2024-04-25T10:27:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.235+0000 7fb2c9800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c406d4c0 con 0x7fb2c40747d0 2024-04-25T10:27:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.235+0000 7fb2c9800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c40736a0 con 0x7fb2c41616c0 2024-04-25T10:27:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.236+0000 7fb2c2000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb2c41616c0 0x7fb2c4073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:25.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.236+0000 7fb2c2a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb2c40747d0 0x7fb2c41648b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:39970/0 (socket says 172.21.15.19:39970) 2024-04-25T10:27:25.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.236+0000 7fb2c2a00640 1 -- 172.21.15.19:0/3406805014 learned_addr learned my addr 172.21.15.19:0/3406805014 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:25.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.236+0000 7fb2c1600640 1 -- 172.21.15.19:0/3406805014 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406064274 0 0) 0x7fb2c406d4c0 con 0x7fb2c40747d0 2024-04-25T10:27:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.236+0000 7fb2c1600640 1 -- 172.21.15.19:0/3406805014 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a8003520 con 0x7fb2c40747d0 2024-04-25T10:27:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.236+0000 7fb2c2000640 1 -- 172.21.15.19:0/3406805014 >> v1:172.21.15.112:6789/0 conn(0x7fb2c40747d0 legacy=0x7fb2c41648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.236+0000 7fb2c2000640 1 -- 172.21.15.19:0/3406805014 >> v1:172.21.15.19:6789/0 conn(0x7fb2c40cdde0 legacy=0x7fb2c416b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:25.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.236+0000 7fb2c2000640 1 -- 172.21.15.19:0/3406805014 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c40c38e0 con 0x7fb2c41616c0 2024-04-25T10:27:25.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.238+0000 7fb2c2000640 1 --2- 172.21.15.19:0/3406805014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c41616c0 0x7fb2c4073160 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00097a0 tx=0x7fb2b002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1067d6a1e0d9434f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:25.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.238+0000 7fb2c1600640 1 -- 172.21.15.19:0/3406805014 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0037070 con 0x7fb2c41616c0 2024-04-25T10:27:25.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.238+0000 7fb2c1600640 1 -- 172.21.15.19:0/3406805014 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b0032440 con 0x7fb2c41616c0 2024-04-25T10:27:25.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.238+0000 7fb2c1600640 1 -- 172.21.15.19:0/3406805014 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0032810 con 0x7fb2c41616c0 2024-04-25T10:27:25.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.239+0000 7fb2c9800640 1 -- 172.21.15.19:0/3406805014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c41616c0 msgr2=0x7fb2c4073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:25.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.239+0000 7fb2c9800640 1 --2- 172.21.15.19:0/3406805014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c41616c0 0x7fb2c4073160 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00097a0 tx=0x7fb2b002a230 comp rx=0 tx=0).stop 2024-04-25T10:27:25.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.239+0000 7fb2c9800640 1 -- 172.21.15.19:0/3406805014 shutdown_connections 2024-04-25T10:27:25.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.239+0000 7fb2c9800640 1 --2- 172.21.15.19:0/3406805014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c41616c0 0x7fb2c4073160 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.239+0000 7fb2c9800640 1 -- 172.21.15.19:0/3406805014 >> 172.21.15.19:0/3406805014 conn(0x7fb2c406f1f0 msgr2=0x7fb2c406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:25.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.239+0000 7fb2c9800640 1 -- 172.21.15.19:0/3406805014 shutdown_connections 2024-04-25T10:27:25.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.239+0000 7fb2c9800640 1 -- 172.21.15.19:0/3406805014 wait complete. 2024-04-25T10:27:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.242+0000 7fb2c9800640 1 Processor -- start 2024-04-25T10:27:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.242+0000 7fb2c9800640 1 -- start start 2024-04-25T10:27:25.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.244+0000 7fb2c9800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c40747d0 0x7fb2c41eb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.244+0000 7fb2c9800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c40cdde0 0x7fb2c40ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.244+0000 7fb2c9800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2c41616c0 0x7fb2c415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.244+0000 7fb2c9800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c4164420 con 0x7fb2c40747d0 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.244+0000 7fb2c9800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c4164140 con 0x7fb2c40cdde0 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.244+0000 7fb2c9800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c40c3ea0 con 0x7fb2c41616c0 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.244+0000 7fb2c2a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c40747d0 0x7fb2c41eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.244+0000 7fb2c2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c40cdde0 0x7fb2c40ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.244+0000 7fb2c2a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c40747d0 0x7fb2c41eb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47066/0 (socket says 172.21.15.19:47066) 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.244+0000 7fb2c2a00640 1 -- 172.21.15.19:0/2511352277 learned_addr learned my addr 172.21.15.19:0/2511352277 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.244+0000 7fb2c3400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2c41616c0 0x7fb2c415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.245+0000 7fb2c2000640 1 -- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2c41616c0 msgr2=0x7fb2c415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:25.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.245+0000 7fb2c2000640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2c41616c0 0x7fb2c415bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.245+0000 7fb2c2000640 1 -- 172.21.15.19:0/2511352277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c40747d0 msgr2=0x7fb2c41eb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.245+0000 7fb2c2000640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c40747d0 0x7fb2c41eb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.245+0000 7fb2c2000640 1 -- 172.21.15.19:0/2511352277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c40b0830 con 0x7fb2c40cdde0 2024-04-25T10:27:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.245+0000 7fb2c2a00640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c40747d0 0x7fb2c41eb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:27:25.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.245+0000 7fb2c2000640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c40cdde0 0x7fb2c40ca4f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0031000 tx=0x7fb2b00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.245+0000 7fb2baa00640 1 -- 172.21.15.19:0/2511352277 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0041030 con 0x7fb2c40cdde0 2024-04-25T10:27:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.246+0000 7fb2baa00640 1 -- 172.21.15.19:0/2511352277 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b0030500 con 0x7fb2c40cdde0 2024-04-25T10:27:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.246+0000 7fb2c9800640 1 -- 172.21.15.19:0/2511352277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c40b0b10 con 0x7fb2c40cdde0 2024-04-25T10:27:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.246+0000 7fb2baa00640 1 -- 172.21.15.19:0/2511352277 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0037040 con 0x7fb2c40cdde0 2024-04-25T10:27:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.246+0000 7fb2c9800640 1 -- 172.21.15.19:0/2511352277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c41f6f00 con 0x7fb2c40cdde0 2024-04-25T10:27:25.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.247+0000 7fb2c9800640 1 -- 172.21.15.19:0/2511352277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c4076520 con 0x7fb2c40cdde0 2024-04-25T10:27:25.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.249+0000 7fb2baa00640 1 -- 172.21.15.19:0/2511352277 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb2b0044070 con 0x7fb2c40cdde0 2024-04-25T10:27:25.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.250+0000 7fb2baa00640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744b0 0x7fb2a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:25.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.250+0000 7fb2baa00640 1 -- 172.21.15.19:0/2511352277 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fb2b00b5c00 con 0x7fb2c40cdde0 2024-04-25T10:27:25.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.251+0000 7fb2c2a00640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744b0 0x7fb2a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:25.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.251+0000 7fb2c2a00640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744b0 0x7fb2a40769c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4001560 tx=0x7fb2b4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:25.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.256+0000 7fb2baa00640 1 -- 172.21.15.19:0/2511352277 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2b007f930 con 0x7fb2c40cdde0 2024-04-25T10:27:25.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.504+0000 7fb2c9800640 1 -- 172.21.15.19:0/2511352277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2c4073a70 con 0x7fb2c40cdde0 2024-04-25T10:27:25.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.505+0000 7fb2baa00640 1 -- 172.21.15.19:0/2511352277 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7fb2b0083c30 con 0x7fb2c40cdde0 2024-04-25T10:27:25.507 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:25.507 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:27:25.507 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:27:25.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 -- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744b0 msgr2=0x7fb2a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:25.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744b0 0x7fb2a40769c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4001560 tx=0x7fb2b4009040 comp rx=0 tx=0).stop 2024-04-25T10:27:25.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 -- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c40cdde0 msgr2=0x7fb2c40ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:25.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c40cdde0 0x7fb2c40ca4f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0031000 tx=0x7fb2b00046c0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 -- 172.21.15.19:0/2511352277 shutdown_connections 2024-04-25T10:27:25.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744b0 0x7fb2a40769c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2c41616c0 0x7fb2c415bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c40cdde0 0x7fb2c40ca4f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 --2- 172.21.15.19:0/2511352277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c40747d0 0x7fb2c41eb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 -- 172.21.15.19:0/2511352277 >> 172.21.15.19:0/2511352277 conn(0x7fb2c406f1f0 msgr2=0x7fb2c415dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:25.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 -- 172.21.15.19:0/2511352277 shutdown_connections 2024-04-25T10:27:25.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.508+0000 7fb2c9800640 1 -- 172.21.15.19:0/2511352277 wait complete. 2024-04-25T10:27:25.541 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.d (rank=2) 2024-04-25T10:27:25.541 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:27:25.541 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:27:25.553 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:27:25.554 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:25.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.844+0000 7feb93800640 1 Processor -- start 2024-04-25T10:27:25.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.844+0000 7feb93800640 1 -- start start 2024-04-25T10:27:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.847+0000 7feb93800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c073160 0x7feb8c0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.847+0000 7feb93800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feb8c0cdde0 0x7feb8c0ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.847+0000 7feb93800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8c158010 con 0x7feb8c15b2c0 2024-04-25T10:27:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.847+0000 7feb93800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7feb8c074970 con 0x7feb8c0cdde0 2024-04-25T10:27:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.847+0000 7feb93800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c0c8600 con 0x7feb8c073160 2024-04-25T10:27:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.847+0000 7feb8be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c073160 0x7feb8c0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.847+0000 7feb91800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feb8c0cdde0 0x7feb8c0ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.847+0000 7feb90e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7feb8c15b2c0 0x7feb8c15e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:39984/0 (socket says 172.21.15.19:39984) 2024-04-25T10:27:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.847+0000 7feb90e00640 1 -- 172.21.15.19:0/2351608022 learned_addr learned my addr 172.21.15.19:0/2351608022 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.847+0000 7feb8be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c073160 0x7feb8c0c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:36178/0 (socket says 172.21.15.19:36178) 2024-04-25T10:27:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.848+0000 7feb8b400640 1 -- 172.21.15.19:0/2351608022 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096379470 0 0) 0x7feb8c158010 con 0x7feb8c15b2c0 2024-04-25T10:27:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.848+0000 7feb8be00640 1 -- 172.21.15.19:0/2351608022 >> v2:172.21.15.112:3300/0 conn(0x7feb8c0cdde0 msgr2=0x7feb8c0ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:27:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.848+0000 7feb8be00640 1 --2- 172.21.15.19:0/2351608022 >> v2:172.21.15.112:3300/0 conn(0x7feb8c0cdde0 0x7feb8c0ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.848+0000 7feb8be00640 1 -- 172.21.15.19:0/2351608022 >> v1:172.21.15.112:6789/0 conn(0x7feb8c15b2c0 legacy=0x7feb8c15e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:25.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.848+0000 7feb8be00640 1 -- 172.21.15.19:0/2351608022 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c0c88e0 con 0x7feb8c073160 2024-04-25T10:27:25.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.848+0000 7feb91800640 1 --2- 172.21.15.19:0/2351608022 >> v2:172.21.15.112:3300/0 conn(0x7feb8c0cdde0 0x7feb8c0ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:27:25.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.849+0000 7feb8be00640 1 --2- 172.21.15.19:0/2351608022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c073160 0x7feb8c0c9810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009d90 tx=0x7feb7c02a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8710e0dcae2567e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:25.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.849+0000 7feb8b400640 1 -- 172.21.15.19:0/2351608022 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c007740 con 0x7feb8c073160 2024-04-25T10:27:25.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.849+0000 7feb8b400640 1 -- 172.21.15.19:0/2351608022 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c0078e0 con 0x7feb8c073160 2024-04-25T10:27:25.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.849+0000 7feb8b400640 1 -- 172.21.15.19:0/2351608022 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c007cb0 con 0x7feb8c073160 2024-04-25T10:27:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.850+0000 7feb93800640 1 -- 172.21.15.19:0/2351608022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c073160 msgr2=0x7feb8c0c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.850+0000 7feb93800640 1 --2- 172.21.15.19:0/2351608022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c073160 0x7feb8c0c9810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009d90 tx=0x7feb7c02a6f0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.850+0000 7feb93800640 1 -- 172.21.15.19:0/2351608022 shutdown_connections 2024-04-25T10:27:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.850+0000 7feb93800640 1 --2- 172.21.15.19:0/2351608022 >> v2:172.21.15.112:3300/0 conn(0x7feb8c0cdde0 0x7feb8c0ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.850+0000 7feb93800640 1 --2- 172.21.15.19:0/2351608022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c073160 0x7feb8c0c9810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.850+0000 7feb93800640 1 -- 172.21.15.19:0/2351608022 >> 172.21.15.19:0/2351608022 conn(0x7feb8c06f1f0 msgr2=0x7feb8c06f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.850+0000 7feb93800640 1 -- 172.21.15.19:0/2351608022 shutdown_connections 2024-04-25T10:27:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.850+0000 7feb93800640 1 -- 172.21.15.19:0/2351608022 wait complete. 2024-04-25T10:27:25.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.852+0000 7feb93800640 1 Processor -- start 2024-04-25T10:27:25.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.852+0000 7feb93800640 1 -- start start 2024-04-25T10:27:25.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.854+0000 7feb93800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8c073160 0x7feb8c1f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:25.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.854+0000 7feb93800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c0cdde0 0x7feb8c15cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:25.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.854+0000 7feb93800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb8c14f670 0x7feb8c14fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:25.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.854+0000 7feb93800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c06d4c0 con 0x7feb8c14f670 2024-04-25T10:27:25.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.854+0000 7feb93800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c15a580 con 0x7feb8c073160 2024-04-25T10:27:25.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.854+0000 7feb93800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c15e930 con 0x7feb8c0cdde0 2024-04-25T10:27:25.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.854+0000 7feb91800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb8c14f670 0x7feb8c14fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:25.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.854+0000 7feb8be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c0cdde0 0x7feb8c15cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:25.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.854+0000 7feb91800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb8c14f670 0x7feb8c14fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47074/0 (socket says 172.21.15.19:47074) 2024-04-25T10:27:25.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.854+0000 7feb91800640 1 -- 172.21.15.19:0/63486677 learned_addr learned my addr 172.21.15.19:0/63486677 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:25.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.854+0000 7feb90e00640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8c073160 0x7feb8c1f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:25.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.855+0000 7feb8be00640 1 -- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8c073160 msgr2=0x7feb8c1f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:25.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.855+0000 7feb8be00640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8c073160 0x7feb8c1f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.855+0000 7feb8be00640 1 -- 172.21.15.19:0/63486677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb8c14f670 msgr2=0x7feb8c14fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:25.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.855+0000 7feb8be00640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb8c14f670 0x7feb8c14fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:25.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.855+0000 7feb8be00640 1 -- 172.21.15.19:0/63486677 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c1f6a10 con 0x7feb8c0cdde0 2024-04-25T10:27:25.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.855+0000 7feb91800640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb8c14f670 0x7feb8c14fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:27:25.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.855+0000 7feb8be00640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c0cdde0 0x7feb8c15cd10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb7c031000 tx=0x7feb7c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:25.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.855+0000 7feb88c00640 1 -- 172.21.15.19:0/63486677 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c040070 con 0x7feb8c0cdde0 2024-04-25T10:27:25.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.855+0000 7feb88c00640 1 -- 172.21.15.19:0/63486677 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c031c40 con 0x7feb8c0cdde0 2024-04-25T10:27:25.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.855+0000 7feb93800640 1 -- 172.21.15.19:0/63486677 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c0c5390 con 0x7feb8c0cdde0 2024-04-25T10:27:25.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.856+0000 7feb88c00640 1 -- 172.21.15.19:0/63486677 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c009450 con 0x7feb8c0cdde0 2024-04-25T10:27:25.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.856+0000 7feb93800640 1 -- 172.21.15.19:0/63486677 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c0c5950 con 0x7feb8c0cdde0 2024-04-25T10:27:25.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.857+0000 7feb93800640 1 -- 172.21.15.19:0/63486677 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8c158bb0 con 0x7feb8c0cdde0 2024-04-25T10:27:25.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.858+0000 7feb88c00640 1 -- 172.21.15.19:0/63486677 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feb7c039040 con 0x7feb8c0cdde0 2024-04-25T10:27:25.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.859+0000 7feb88c00640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb6c0744b0 0x7feb6c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:25.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.859+0000 7feb88c00640 1 -- 172.21.15.19:0/63486677 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7feb7c0b6d00 con 0x7feb8c0cdde0 2024-04-25T10:27:25.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.859+0000 7feb90e00640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb6c0744b0 0x7feb6c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:25.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.860+0000 7feb90e00640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb6c0744b0 0x7feb6c0769c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feb78007fd0 tx=0x7feb78007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:25.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:25.864+0000 7feb88c00640 1 -- 172.21.15.19:0/63486677 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb8c158bb0 con 0x7feb8c0cdde0 2024-04-25T10:27:26.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.112+0000 7feb93800640 1 -- 172.21.15.19:0/63486677 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb8c076520 con 0x7feb8c0cdde0 2024-04-25T10:27:26.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.113+0000 7feb88c00640 1 -- 172.21.15.19:0/63486677 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7feb7c080ac0 con 0x7feb8c0cdde0 2024-04-25T10:27:26.115 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:26.115 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:27:26.115 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:27:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.115+0000 7feb93800640 1 -- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb6c0744b0 msgr2=0x7feb6c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.115+0000 7feb93800640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb6c0744b0 0x7feb6c0769c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feb78007fd0 tx=0x7feb78007de0 comp rx=0 tx=0).stop 2024-04-25T10:27:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.116+0000 7feb93800640 1 -- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c0cdde0 msgr2=0x7feb8c15cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.116+0000 7feb93800640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c0cdde0 0x7feb8c15cd10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb7c031000 tx=0x7feb7c004a40 comp rx=0 tx=0).stop 2024-04-25T10:27:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.116+0000 7feb93800640 1 -- 172.21.15.19:0/63486677 shutdown_connections 2024-04-25T10:27:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.116+0000 7feb93800640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb8c14f670 0x7feb8c14fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.116+0000 7feb93800640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7feb6c0744b0 0x7feb6c0769c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.116+0000 7feb93800640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb8c0cdde0 0x7feb8c15cd10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.116+0000 7feb93800640 1 --2- 172.21.15.19:0/63486677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8c073160 0x7feb8c1f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.116+0000 7feb93800640 1 -- 172.21.15.19:0/63486677 >> 172.21.15.19:0/63486677 conn(0x7feb8c06f1f0 msgr2=0x7feb8c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.116+0000 7feb93800640 1 -- 172.21.15.19:0/63486677 shutdown_connections 2024-04-25T10:27:26.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:26.116+0000 7feb93800640 1 -- 172.21.15.19:0/63486677 wait complete. 2024-04-25T10:27:26.145 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T10:27:28.146 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:28.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.445+0000 7f6eaca00640 1 Processor -- start 2024-04-25T10:27:28.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.445+0000 7f6eaca00640 1 -- start start 2024-04-25T10:27:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.447+0000 7f6eaca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea80c5c10 0x7f6ea81546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.447+0000 7f6eaca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ea8071000 0x7f6ea80c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.447+0000 7f6eaca00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea8070500 con 0x7f6ea80c78f0 2024-04-25T10:27:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.447+0000 7f6eaca00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6ea8154bf0 con 0x7f6ea8071000 2024-04-25T10:27:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.447+0000 7f6eaca00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea8070b90 con 0x7f6ea80c5c10 2024-04-25T10:27:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.448+0000 7f6ea6800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea80c5c10 0x7f6ea81546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.448+0000 7f6ea7200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6ea80c78f0 0x7f6ea815a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53166/0 (socket says 172.21.15.19:53166) 2024-04-25T10:27:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.448+0000 7f6ea7200640 1 -- 172.21.15.19:0/280446472 learned_addr learned my addr 172.21.15.19:0/280446472 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.448+0000 7f6ea5e00640 1 --2- 172.21.15.19:0/280446472 >> v2:172.21.15.112:3300/0 conn(0x7f6ea8071000 0x7f6ea80c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.448+0000 7f6ea6800640 1 -- 172.21.15.19:0/280446472 >> v2:172.21.15.112:3300/0 conn(0x7f6ea8071000 msgr2=0x7f6ea80c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:27:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.448+0000 7f6ea6800640 1 --2- 172.21.15.19:0/280446472 >> v2:172.21.15.112:3300/0 conn(0x7f6ea8071000 0x7f6ea80c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.448+0000 7f6ea6800640 1 -- 172.21.15.19:0/280446472 >> v1:172.21.15.19:6789/0 conn(0x7f6ea80c78f0 legacy=0x7f6ea815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.448+0000 7f6ea6800640 1 -- 172.21.15.19:0/280446472 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea80c8220 con 0x7f6ea80c5c10 2024-04-25T10:27:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.448+0000 7f6ea5400640 1 -- 172.21.15.19:0/280446472 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3114730082 0 0) 0x7f6ea8070500 con 0x7f6ea80c78f0 2024-04-25T10:27:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.449+0000 7f6ea6800640 1 --2- 172.21.15.19:0/280446472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea80c5c10 0x7f6ea81546b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009d90 tx=0x7f6e9802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633ee6ede05bf74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.450+0000 7f6ea5400640 1 -- 172.21.15.19:0/280446472 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98007740 con 0x7f6ea80c5c10 2024-04-25T10:27:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.450+0000 7f6ea5400640 1 -- 172.21.15.19:0/280446472 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e980078e0 con 0x7f6ea80c5c10 2024-04-25T10:27:28.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.450+0000 7f6ea5400640 1 -- 172.21.15.19:0/280446472 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98007cb0 con 0x7f6ea80c5c10 2024-04-25T10:27:28.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.450+0000 7f6eaca00640 1 -- 172.21.15.19:0/280446472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea80c5c10 msgr2=0x7f6ea81546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.450+0000 7f6eaca00640 1 --2- 172.21.15.19:0/280446472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea80c5c10 0x7f6ea81546b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009d90 tx=0x7f6e9802a6f0 comp rx=0 tx=0).stop 2024-04-25T10:27:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.451+0000 7f6eaca00640 1 -- 172.21.15.19:0/280446472 shutdown_connections 2024-04-25T10:27:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.451+0000 7f6eaca00640 1 --2- 172.21.15.19:0/280446472 >> v2:172.21.15.112:3300/0 conn(0x7f6ea8071000 0x7f6ea80c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.451+0000 7f6eaca00640 1 --2- 172.21.15.19:0/280446472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea80c5c10 0x7f6ea81546b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.451+0000 7f6eaca00640 1 -- 172.21.15.19:0/280446472 >> 172.21.15.19:0/280446472 conn(0x7f6ea80ce710 msgr2=0x7f6ea80ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.451+0000 7f6eaca00640 1 -- 172.21.15.19:0/280446472 shutdown_connections 2024-04-25T10:27:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.451+0000 7f6eaca00640 1 -- 172.21.15.19:0/280446472 wait complete. 2024-04-25T10:27:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.453+0000 7f6eaca00640 1 Processor -- start 2024-04-25T10:27:28.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.453+0000 7f6eaca00640 1 -- start start 2024-04-25T10:27:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.455+0000 7f6eaca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea8071000 0x7f6ea81e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.455+0000 7f6eaca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea80c5c10 0x7f6ea80ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.455+0000 7f6eaca00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea80c78f0 0x7f6ea80ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.455+0000 7f6eaca00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea80c87c0 con 0x7f6ea80c78f0 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.455+0000 7f6eaca00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea80c84e0 con 0x7f6ea80c5c10 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.455+0000 7f6eaca00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea80c8aa0 con 0x7f6ea8071000 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.455+0000 7f6ea7200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea80c78f0 0x7f6ea80ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.455+0000 7f6ea7200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea80c78f0 0x7f6ea80ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44190/0 (socket says 172.21.15.19:44190) 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.455+0000 7f6ea7200640 1 -- 172.21.15.19:0/23946978 learned_addr learned my addr 172.21.15.19:0/23946978 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.455+0000 7f6ea6800640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea8071000 0x7f6ea81e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.455+0000 7f6ea5e00640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea80c5c10 0x7f6ea80ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.456+0000 7f6ea7200640 1 -- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea8071000 msgr2=0x7f6ea81e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.456+0000 7f6ea7200640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea8071000 0x7f6ea81e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.456+0000 7f6ea7200640 1 -- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea80c5c10 msgr2=0x7f6ea80ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.456+0000 7f6ea7200640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea80c5c10 0x7f6ea80ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.456+0000 7f6ea7200640 1 -- 172.21.15.19:0/23946978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea80cdae0 con 0x7f6ea80c78f0 2024-04-25T10:27:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.456+0000 7f6ea7200640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea80c78f0 0x7f6ea80ca6f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000c3e0 tx=0x7f6ea000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.456+0000 7f6e9ea00640 1 -- 172.21.15.19:0/23946978 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea00074e0 con 0x7f6ea80c78f0 2024-04-25T10:27:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.456+0000 7f6e9ea00640 1 -- 172.21.15.19:0/23946978 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea00047e0 con 0x7f6ea80c78f0 2024-04-25T10:27:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.456+0000 7f6e9ea00640 1 -- 172.21.15.19:0/23946978 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0004bd0 con 0x7f6ea80c78f0 2024-04-25T10:27:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.456+0000 7f6eaca00640 1 -- 172.21.15.19:0/23946978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea81e7740 con 0x7f6ea80c78f0 2024-04-25T10:27:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.457+0000 7f6eaca00640 1 -- 172.21.15.19:0/23946978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea8150820 con 0x7f6ea80c78f0 2024-04-25T10:27:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.458+0000 7f6eaca00640 1 -- 172.21.15.19:0/23946978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea8050740 con 0x7f6ea80c78f0 2024-04-25T10:27:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.459+0000 7f6e9ea00640 1 -- 172.21.15.19:0/23946978 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6ea0011070 con 0x7f6ea80c78f0 2024-04-25T10:27:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.460+0000 7f6e9ea00640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6e840744b0 0x7f6e840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.460+0000 7f6e9ea00640 1 -- 172.21.15.19:0/23946978 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f6ea0094ff0 con 0x7f6ea80c78f0 2024-04-25T10:27:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.461+0000 7f6ea6800640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6e840744b0 0x7f6e840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.461+0000 7f6ea6800640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6e840744b0 0x7f6e840769c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009d90 tx=0x7f6e9802f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:28.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.465+0000 7f6e9ea00640 1 -- 172.21.15.19:0/23946978 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6ea005edd0 con 0x7f6ea80c78f0 2024-04-25T10:27:28.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.714+0000 7f6eaca00640 1 -- 172.21.15.19:0/23946978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ea8070d50 con 0x7f6ea80c78f0 2024-04-25T10:27:28.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.715+0000 7f6e9ea00640 1 -- 172.21.15.19:0/23946978 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f6ea00630d0 con 0x7f6ea80c78f0 2024-04-25T10:27:28.717 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:28.717 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:27:28.717 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:27:28.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 -- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6e840744b0 msgr2=0x7f6e840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:28.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6e840744b0 0x7f6e840769c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009d90 tx=0x7f6e9802f000 comp rx=0 tx=0).stop 2024-04-25T10:27:28.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 -- 172.21.15.19:0/23946978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea80c78f0 msgr2=0x7f6ea80ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:28.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea80c78f0 0x7f6ea80ca6f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000c3e0 tx=0x7f6ea000c8a0 comp rx=0 tx=0).stop 2024-04-25T10:27:28.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 -- 172.21.15.19:0/23946978 shutdown_connections 2024-04-25T10:27:28.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ea80c78f0 0x7f6ea80ca6f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:28.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea80c5c10 0x7f6ea80ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:28.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6e840744b0 0x7f6e840769c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:28.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 --2- 172.21.15.19:0/23946978 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ea8071000 0x7f6ea81e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:28.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 -- 172.21.15.19:0/23946978 >> 172.21.15.19:0/23946978 conn(0x7f6ea80ce710 msgr2=0x7f6ea8158270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:28.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 -- 172.21.15.19:0/23946978 shutdown_connections 2024-04-25T10:27:28.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:28.718+0000 7f6eaca00640 1 -- 172.21.15.19:0/23946978 wait complete. 2024-04-25T10:27:28.750 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T10:27:29.873 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:27:29.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:27:30.751 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:31.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.047+0000 7fa763e00640 1 Processor -- start 2024-04-25T10:27:31.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.047+0000 7fa763e00640 1 -- start start 2024-04-25T10:27:31.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.049+0000 7fa763e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa764073d20 0x7fa764154060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:31.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.049+0000 7fa763e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76415a8b0 con 0x7fa76415a370 2024-04-25T10:27:31.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.049+0000 7fa763e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76415ab70 con 0x7fa7640c7f90 2024-04-25T10:27:31.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.049+0000 7fa763e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa764070f70 con 0x7fa764073d20 2024-04-25T10:27:31.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.050+0000 7fa762a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa76415a370 0x7fa764070860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53170/0 (socket says 172.21.15.19:53170) 2024-04-25T10:27:31.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.050+0000 7fa762a00640 1 -- 172.21.15.19:0/3794221009 learned_addr learned my addr 172.21.15.19:0/3794221009 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:31.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.050+0000 7fa763400640 1 --2- 172.21.15.19:0/3794221009 >> v2:172.21.15.112:3300/0 conn(0x7fa764073d20 0x7fa764154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:31.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.050+0000 7fa761600640 1 -- 172.21.15.19:0/3794221009 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024019465 0 0) 0x7fa76415a8b0 con 0x7fa76415a370 2024-04-25T10:27:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.050+0000 7fa761600640 1 -- 172.21.15.19:0/3794221009 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa748003520 con 0x7fa76415a370 2024-04-25T10:27:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.050+0000 7fa761600640 1 -- 172.21.15.19:0/3794221009 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044179996 0 0) 0x7fa76415ab70 con 0x7fa7640c7f90 2024-04-25T10:27:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.050+0000 7fa763400640 1 -- 172.21.15.19:0/3794221009 >> v1:172.21.15.112:6789/0 conn(0x7fa7640c7f90 legacy=0x7fa764073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.050+0000 7fa763400640 1 -- 172.21.15.19:0/3794221009 >> v1:172.21.15.19:6789/0 conn(0x7fa76415a370 legacy=0x7fa764070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.050+0000 7fa763400640 1 -- 172.21.15.19:0/3794221009 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76415ae50 con 0x7fa764073d20 2024-04-25T10:27:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.052+0000 7fa763400640 1 --2- 172.21.15.19:0/3794221009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa764073d20 0x7fa764154060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0097a0 tx=0x7fa75c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa927b8c63946f46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:31.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.052+0000 7fa761600640 1 -- 172.21.15.19:0/3794221009 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c037070 con 0x7fa764073d20 2024-04-25T10:27:31.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.052+0000 7fa761600640 1 -- 172.21.15.19:0/3794221009 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75c032440 con 0x7fa764073d20 2024-04-25T10:27:31.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.052+0000 7fa761600640 1 -- 172.21.15.19:0/3794221009 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c032810 con 0x7fa764073d20 2024-04-25T10:27:31.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.053+0000 7fa763e00640 1 -- 172.21.15.19:0/3794221009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa764073d20 msgr2=0x7fa764154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:31.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.053+0000 7fa763e00640 1 --2- 172.21.15.19:0/3794221009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa764073d20 0x7fa764154060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0097a0 tx=0x7fa75c02a1a0 comp rx=0 tx=0).stop 2024-04-25T10:27:31.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.053+0000 7fa763e00640 1 -- 172.21.15.19:0/3794221009 shutdown_connections 2024-04-25T10:27:31.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.053+0000 7fa763e00640 1 --2- 172.21.15.19:0/3794221009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa764073d20 0x7fa764154060 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:31.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.053+0000 7fa763e00640 1 -- 172.21.15.19:0/3794221009 >> 172.21.15.19:0/3794221009 conn(0x7fa7640cdbc0 msgr2=0x7fa7640ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:31.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.053+0000 7fa763e00640 1 -- 172.21.15.19:0/3794221009 shutdown_connections 2024-04-25T10:27:31.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.053+0000 7fa763e00640 1 -- 172.21.15.19:0/3794221009 wait complete. 2024-04-25T10:27:31.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.055+0000 7fa763e00640 1 Processor -- start 2024-04-25T10:27:31.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.055+0000 7fa763e00640 1 -- start start 2024-04-25T10:27:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa763e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640c7f90 0x7fa76406c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa763e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76415a370 0x7fa76406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa763e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7640c41a0 0x7fa764149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa763e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa764073180 con 0x7fa76415a370 2024-04-25T10:27:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa763e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa764072ea0 con 0x7fa7640c7f90 2024-04-25T10:27:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa763e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa7640c4b20 con 0x7fa7640c41a0 2024-04-25T10:27:31.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa762000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76415a370 0x7fa76406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa763400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7640c41a0 0x7fa764149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa762a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640c7f90 0x7fa76406c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa762000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76415a370 0x7fa76406cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44200/0 (socket says 172.21.15.19:44200) 2024-04-25T10:27:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa763400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7640c41a0 0x7fa764149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:55022/0 (socket says 172.21.15.19:55022) 2024-04-25T10:27:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.057+0000 7fa762000640 1 -- 172.21.15.19:0/3515022540 learned_addr learned my addr 172.21.15.19:0/3515022540 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.058+0000 7fa763400640 1 -- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640c7f90 msgr2=0x7fa76406c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.058+0000 7fa763400640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640c7f90 0x7fa76406c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.058+0000 7fa763400640 1 -- 172.21.15.19:0/3515022540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76415a370 msgr2=0x7fa76406cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.058+0000 7fa763400640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76415a370 0x7fa76406cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.058+0000 7fa763400640 1 -- 172.21.15.19:0/3515022540 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7640c39e0 con 0x7fa7640c41a0 2024-04-25T10:27:31.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.058+0000 7fa762000640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76415a370 0x7fa76406cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:27:31.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.058+0000 7fa763400640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7640c41a0 0x7fa764149790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa75c031000 tx=0x7fa75c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:31.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.058+0000 7fa75aa00640 1 -- 172.21.15.19:0/3515022540 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c037040 con 0x7fa7640c41a0 2024-04-25T10:27:31.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.058+0000 7fa75aa00640 1 -- 172.21.15.19:0/3515022540 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75c004230 con 0x7fa7640c41a0 2024-04-25T10:27:31.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.058+0000 7fa763e00640 1 -- 172.21.15.19:0/3515022540 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa764153830 con 0x7fa7640c41a0 2024-04-25T10:27:31.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.058+0000 7fa75aa00640 1 -- 172.21.15.19:0/3515022540 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c003610 con 0x7fa7640c41a0 2024-04-25T10:27:31.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.059+0000 7fa763e00640 1 -- 172.21.15.19:0/3515022540 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa764153ad0 con 0x7fa7640c41a0 2024-04-25T10:27:31.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.060+0000 7fa763e00640 1 -- 172.21.15.19:0/3515022540 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa764050740 con 0x7fa7640c41a0 2024-04-25T10:27:31.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.061+0000 7fa75aa00640 1 -- 172.21.15.19:0/3515022540 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa75c0037b0 con 0x7fa7640c41a0 2024-04-25T10:27:31.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.062+0000 7fa75aa00640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7440744e0 0x7fa7440769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.062+0000 7fa75aa00640 1 -- 172.21.15.19:0/3515022540 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fa75c0b6000 con 0x7fa7640c41a0 2024-04-25T10:27:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.062+0000 7fa762a00640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7440744e0 0x7fa7440769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:31.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.063+0000 7fa762a00640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7440744e0 0x7fa7440769f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa754005c00 tx=0x7fa754009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:31.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.067+0000 7fa75aa00640 1 -- 172.21.15.19:0/3515022540 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa75c04b070 con 0x7fa7640c41a0 2024-04-25T10:27:31.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.312+0000 7fa763e00640 1 -- 172.21.15.19:0/3515022540 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa764145da0 con 0x7fa7640c41a0 2024-04-25T10:27:31.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.314+0000 7fa75aa00640 1 -- 172.21.15.19:0/3515022540 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7fa75c07fd30 con 0x7fa7640c41a0 2024-04-25T10:27:31.316 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:31.316 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:27:31.316 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:27:31.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.316+0000 7fa763e00640 1 -- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7440744e0 msgr2=0x7fa7440769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:31.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.316+0000 7fa763e00640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7440744e0 0x7fa7440769f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa754005c00 tx=0x7fa754009040 comp rx=0 tx=0).stop 2024-04-25T10:27:31.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.316+0000 7fa763e00640 1 -- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7640c41a0 msgr2=0x7fa764149790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:31.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.316+0000 7fa763e00640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7640c41a0 0x7fa764149790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa75c031000 tx=0x7fa75c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:27:31.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.316+0000 7fa763e00640 1 -- 172.21.15.19:0/3515022540 shutdown_connections 2024-04-25T10:27:31.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.316+0000 7fa763e00640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa7440744e0 0x7fa7440769f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:31.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.316+0000 7fa763e00640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa7640c41a0 0x7fa764149790 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:31.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.316+0000 7fa763e00640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76415a370 0x7fa76406cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:31.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.316+0000 7fa763e00640 1 --2- 172.21.15.19:0/3515022540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640c7f90 0x7fa76406c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:31.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.316+0000 7fa763e00640 1 -- 172.21.15.19:0/3515022540 >> 172.21.15.19:0/3515022540 conn(0x7fa7640cdbc0 msgr2=0x7fa764159c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:31.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.317+0000 7fa763e00640 1 -- 172.21.15.19:0/3515022540 shutdown_connections 2024-04-25T10:27:31.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:31.317+0000 7fa763e00640 1 -- 172.21.15.19:0/3515022540 wait complete. 2024-04-25T10:27:31.346 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T10:27:33.347 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:33.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.635+0000 7f37d0c00640 1 Processor -- start 2024-04-25T10:27:33.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.636+0000 7f37d0c00640 1 -- start start 2024-04-25T10:27:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.638+0000 7f37d0c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f37cc15a370 0x7f37cc070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.638+0000 7f37d0c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37cc15a8b0 con 0x7f37cc073d20 2024-04-25T10:27:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.638+0000 7f37d0c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37cc15ab70 con 0x7f37cc0c7f90 2024-04-25T10:27:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.638+0000 7f37d0c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f37cc072ea0 con 0x7f37cc15a370 2024-04-25T10:27:33.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.639+0000 7f37cb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f37cc15a370 0x7f37cc070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:33.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.639+0000 7f37cbe00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f37cc073d20 0x7f37cc154060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53172/0 (socket says 172.21.15.19:53172) 2024-04-25T10:27:33.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.639+0000 7f37c3e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f37cc0c7f90 0x7f37cc073610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:57956/0 (socket says 172.21.15.19:57956) 2024-04-25T10:27:33.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.639+0000 7f37cbe00640 1 -- 172.21.15.19:0/1269417149 learned_addr learned my addr 172.21.15.19:0/1269417149 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:33.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.639+0000 7f37cb400640 1 -- 172.21.15.19:0/1269417149 >> v1:172.21.15.112:6789/0 conn(0x7f37cc0c7f90 legacy=0x7f37cc073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:33.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.639+0000 7f37cb400640 1 -- 172.21.15.19:0/1269417149 >> v1:172.21.15.19:6789/0 conn(0x7f37cc073d20 legacy=0x7f37cc154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:33.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.639+0000 7f37cb400640 1 -- 172.21.15.19:0/1269417149 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37cc15ae50 con 0x7f37cc15a370 2024-04-25T10:27:33.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.640+0000 7f37cb400640 1 --2- 172.21.15.19:0/1269417149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37cc15a370 0x7f37cc070860 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0097a0 tx=0x7f37bc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bd7d1a3fca9e39e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:33.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.640+0000 7f37caa00640 1 -- 172.21.15.19:0/1269417149 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc037070 con 0x7f37cc15a370 2024-04-25T10:27:33.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.641+0000 7f37caa00640 1 -- 172.21.15.19:0/1269417149 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37bc032440 con 0x7f37cc15a370 2024-04-25T10:27:33.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.641+0000 7f37caa00640 1 -- 172.21.15.19:0/1269417149 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc032810 con 0x7f37cc15a370 2024-04-25T10:27:33.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.641+0000 7f37d0c00640 1 -- 172.21.15.19:0/1269417149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37cc15a370 msgr2=0x7f37cc070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.641+0000 7f37d0c00640 1 --2- 172.21.15.19:0/1269417149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37cc15a370 0x7f37cc070860 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0097a0 tx=0x7f37bc02a1a0 comp rx=0 tx=0).stop 2024-04-25T10:27:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.641+0000 7f37d0c00640 1 -- 172.21.15.19:0/1269417149 shutdown_connections 2024-04-25T10:27:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.641+0000 7f37d0c00640 1 --2- 172.21.15.19:0/1269417149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37cc15a370 0x7f37cc070860 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.641+0000 7f37d0c00640 1 -- 172.21.15.19:0/1269417149 >> 172.21.15.19:0/1269417149 conn(0x7f37cc0cdbc0 msgr2=0x7f37cc0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.641+0000 7f37d0c00640 1 -- 172.21.15.19:0/1269417149 shutdown_connections 2024-04-25T10:27:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.642+0000 7f37d0c00640 1 -- 172.21.15.19:0/1269417149 wait complete. 2024-04-25T10:27:33.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.644+0000 7f37d0c00640 1 Processor -- start 2024-04-25T10:27:33.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.644+0000 7f37d0c00640 1 -- start start 2024-04-25T10:27:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.645+0000 7f37d0c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37cc0c7f90 0x7f37cc1f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.645+0000 7f37d0c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37cc15a370 0x7f37cc155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37d0c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37cc1e5a70 0x7f37cc14e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37d0c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc0c4b20 con 0x7f37cc1e5a70 2024-04-25T10:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37d0c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc073180 con 0x7f37cc15a370 2024-04-25T10:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37d0c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f37cc070da0 con 0x7f37cc0c7f90 2024-04-25T10:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37cbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37cc1e5a70 0x7f37cc14e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37cbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37cc1e5a70 0x7f37cc14e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44204/0 (socket says 172.21.15.19:44204) 2024-04-25T10:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37cbe00640 1 -- 172.21.15.19:0/149459712 learned_addr learned my addr 172.21.15.19:0/149459712 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37cb400640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37cc0c7f90 0x7f37cc1f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37c3e00640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37cc15a370 0x7f37cc155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37cbe00640 1 -- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37cc0c7f90 msgr2=0x7f37cc1f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37cbe00640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37cc0c7f90 0x7f37cc1f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37cbe00640 1 -- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37cc15a370 msgr2=0x7f37cc155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37cbe00640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37cc15a370 0x7f37cc155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.646+0000 7f37cbe00640 1 -- 172.21.15.19:0/149459712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37cc1e72e0 con 0x7f37cc1e5a70 2024-04-25T10:27:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.647+0000 7f37cbe00640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37cc1e5a70 0x7f37cc14e5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37c400ca20 tx=0x7f37c400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:33.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.647+0000 7f37c3400640 1 -- 172.21.15.19:0/149459712 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4017070 con 0x7f37cc1e5a70 2024-04-25T10:27:33.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.647+0000 7f37c3400640 1 -- 172.21.15.19:0/149459712 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c400ab70 con 0x7f37cc1e5a70 2024-04-25T10:27:33.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.647+0000 7f37c3400640 1 -- 172.21.15.19:0/149459712 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4012400 con 0x7f37cc1e5a70 2024-04-25T10:27:33.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.647+0000 7f37d0c00640 1 -- 172.21.15.19:0/149459712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37cc0c4390 con 0x7f37cc1e5a70 2024-04-25T10:27:33.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.647+0000 7f37d0c00640 1 -- 172.21.15.19:0/149459712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37cc1e4800 con 0x7f37cc1e5a70 2024-04-25T10:27:33.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.649+0000 7f37d0c00640 1 -- 172.21.15.19:0/149459712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37cc050740 con 0x7f37cc1e5a70 2024-04-25T10:27:33.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.650+0000 7f37c3400640 1 -- 172.21.15.19:0/149459712 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f37c401a070 con 0x7f37cc1e5a70 2024-04-25T10:27:33.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.651+0000 7f37c3400640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37a80744b0 0x7f37a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:33.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.651+0000 7f37c3400640 1 -- 172.21.15.19:0/149459712 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f37c4095150 con 0x7f37cc1e5a70 2024-04-25T10:27:33.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.651+0000 7f37cb400640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37a80744b0 0x7f37a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:33.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.652+0000 7f37cb400640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37a80744b0 0x7f37a80769c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f37bc034000 tx=0x7f37bc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:33.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.656+0000 7f37c3400640 1 -- 172.21.15.19:0/149459712 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f37c405ef10 con 0x7f37cc1e5a70 2024-04-25T10:27:33.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.902+0000 7f37d0c00640 1 -- 172.21.15.19:0/149459712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37cc0c59e0 con 0x7f37cc1e5a70 2024-04-25T10:27:33.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.903+0000 7f37c3400640 1 -- 172.21.15.19:0/149459712 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f37c4063210 con 0x7f37cc1e5a70 2024-04-25T10:27:33.906 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:33.906 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:27:33.906 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:27:33.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 -- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37a80744b0 msgr2=0x7f37a80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:33.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37a80744b0 0x7f37a80769c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f37bc034000 tx=0x7f37bc02e000 comp rx=0 tx=0).stop 2024-04-25T10:27:33.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 -- 172.21.15.19:0/149459712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37cc1e5a70 msgr2=0x7f37cc14e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:33.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37cc1e5a70 0x7f37cc14e5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37c400ca20 tx=0x7f37c400cee0 comp rx=0 tx=0).stop 2024-04-25T10:27:33.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 -- 172.21.15.19:0/149459712 shutdown_connections 2024-04-25T10:27:33.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37cc1e5a70 0x7f37cc14e5a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:33.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37cc15a370 0x7f37cc155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:33.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37a80744b0 0x7f37a80769c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:33.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 --2- 172.21.15.19:0/149459712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37cc0c7f90 0x7f37cc1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:33.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 -- 172.21.15.19:0/149459712 >> 172.21.15.19:0/149459712 conn(0x7f37cc0cdbc0 msgr2=0x7f37cc0c62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:33.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 -- 172.21.15.19:0/149459712 shutdown_connections 2024-04-25T10:27:33.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:33.906+0000 7f37d0c00640 1 -- 172.21.15.19:0/149459712 wait complete. 2024-04-25T10:27:33.939 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T10:27:35.940 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:36.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.237+0000 7fbe0bc00640 1 Processor -- start 2024-04-25T10:27:36.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.237+0000 7fbe0bc00640 1 -- start start 2024-04-25T10:27:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.240+0000 7fbe0bc00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe04156850 0x7fbe0415d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.240+0000 7fbe0bc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbe040cdde0 0x7fbe040ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.240+0000 7fbe0bc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe040af780 con 0x7fbe04073d50 2024-04-25T10:27:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.240+0000 7fbe0bc00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0415d540 con 0x7fbe04156850 2024-04-25T10:27:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.240+0000 7fbe0bc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbe04156c60 con 0x7fbe040cdde0 2024-04-25T10:27:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.240+0000 7fbe09200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe04156850 0x7fbe0415d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.240+0000 7fbe03e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbe040cdde0 0x7fbe040ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.240+0000 7fbe09200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe04156850 0x7fbe0415d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44206/0 (socket says 172.21.15.19:44206) 2024-04-25T10:27:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.240+0000 7fbe09200640 1 -- 172.21.15.19:0/977324893 learned_addr learned my addr 172.21.15.19:0/977324893 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.240+0000 7fbe09c00640 1 --1- 172.21.15.19:0/977324893 >> v1:172.21.15.112:6789/0 conn(0x7fbe04073d50 0x7fbe04074160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:57962/0 (socket says 172.21.15.19:57962) 2024-04-25T10:27:36.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.241+0000 7fbe03400640 1 -- 172.21.15.19:0/977324893 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018785899 0 0) 0x7fbe040af780 con 0x7fbe04073d50 2024-04-25T10:27:36.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.241+0000 7fbe03400640 1 -- 172.21.15.19:0/977324893 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdec003520 con 0x7fbe04073d50 2024-04-25T10:27:36.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.241+0000 7fbe03e00640 1 -- 172.21.15.19:0/977324893 >> v2:172.21.15.19:3300/0 conn(0x7fbe04156850 msgr2=0x7fbe0415d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:27:36.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.241+0000 7fbe03e00640 1 --2- 172.21.15.19:0/977324893 >> v2:172.21.15.19:3300/0 conn(0x7fbe04156850 0x7fbe0415d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:36.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.241+0000 7fbe03e00640 1 -- 172.21.15.19:0/977324893 >> v1:172.21.15.112:6789/0 conn(0x7fbe04073d50 legacy=0x7fbe04074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:36.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.241+0000 7fbe03e00640 1 -- 172.21.15.19:0/977324893 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe040af1c0 con 0x7fbe040cdde0 2024-04-25T10:27:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.242+0000 7fbe03e00640 1 --2- 172.21.15.19:0/977324893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe040cdde0 0x7fbe040ce1f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe040c9270 tx=0x7fbdf002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8422712f51e217aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.242+0000 7fbe03400640 1 -- 172.21.15.19:0/977324893 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0037070 con 0x7fbe040cdde0 2024-04-25T10:27:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.242+0000 7fbe03400640 1 -- 172.21.15.19:0/977324893 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf0032440 con 0x7fbe040cdde0 2024-04-25T10:27:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.242+0000 7fbe03400640 1 -- 172.21.15.19:0/977324893 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0032810 con 0x7fbe040cdde0 2024-04-25T10:27:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.243+0000 7fbe0bc00640 1 -- 172.21.15.19:0/977324893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe040cdde0 msgr2=0x7fbe040ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.243+0000 7fbe0bc00640 1 --2- 172.21.15.19:0/977324893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe040cdde0 0x7fbe040ce1f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe040c9270 tx=0x7fbdf002a230 comp rx=0 tx=0).stop 2024-04-25T10:27:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.243+0000 7fbe0bc00640 1 -- 172.21.15.19:0/977324893 shutdown_connections 2024-04-25T10:27:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.243+0000 7fbe0bc00640 1 --2- 172.21.15.19:0/977324893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe040cdde0 0x7fbe040ce1f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.243+0000 7fbe0bc00640 1 --2- 172.21.15.19:0/977324893 >> v2:172.21.15.19:3300/0 conn(0x7fbe04156850 0x7fbe0415d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.243+0000 7fbe0bc00640 1 -- 172.21.15.19:0/977324893 >> 172.21.15.19:0/977324893 conn(0x7fbe0406f1f0 msgr2=0x7fbe0406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:36.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.243+0000 7fbe0bc00640 1 -- 172.21.15.19:0/977324893 shutdown_connections 2024-04-25T10:27:36.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.243+0000 7fbe0bc00640 1 -- 172.21.15.19:0/977324893 wait complete. 2024-04-25T10:27:36.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.246+0000 7fbe0bc00640 1 Processor -- start 2024-04-25T10:27:36.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.246+0000 7fbe0bc00640 1 -- start start 2024-04-25T10:27:36.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.247+0000 7fbe0bc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe04073d50 0x7fbe040b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:36.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.247+0000 7fbe0bc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe040cdde0 0x7fbe040ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.247+0000 7fbe0bc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe04156850 0x7fbe041f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.247+0000 7fbe0bc00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbe04073550 con 0x7fbe04073d50 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.247+0000 7fbe0bc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe04073270 con 0x7fbe040cdde0 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.247+0000 7fbe0bc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbe04073830 con 0x7fbe04156850 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.248+0000 7fbe09200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe04073d50 0x7fbe040b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.248+0000 7fbe03e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe040cdde0 0x7fbe040ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.248+0000 7fbe09200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe04073d50 0x7fbe040b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44208/0 (socket says 172.21.15.19:44208) 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.248+0000 7fbe09200640 1 -- 172.21.15.19:0/1855519234 learned_addr learned my addr 172.21.15.19:0/1855519234 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.248+0000 7fbe09c00640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe04156850 0x7fbe041f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.248+0000 7fbe03e00640 1 -- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe04156850 msgr2=0x7fbe041f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.248+0000 7fbe03e00640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe04156850 0x7fbe041f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.248+0000 7fbe03e00640 1 -- 172.21.15.19:0/1855519234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe04073d50 msgr2=0x7fbe040b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.248+0000 7fbe03e00640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe04073d50 0x7fbe040b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.248+0000 7fbe03e00640 1 -- 172.21.15.19:0/1855519234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe040b11b0 con 0x7fbe040cdde0 2024-04-25T10:27:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.248+0000 7fbe09200640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe04073d50 0x7fbe040b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:27:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.249+0000 7fbe03e00640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe040cdde0 0x7fbe040ca370 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0031000 tx=0x7fbdf00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:36.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.249+0000 7fbe00c00640 1 -- 172.21.15.19:0/1855519234 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0041030 con 0x7fbe040cdde0 2024-04-25T10:27:36.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.249+0000 7fbe00c00640 1 -- 172.21.15.19:0/1855519234 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf003d4e0 con 0x7fbe040cdde0 2024-04-25T10:27:36.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.249+0000 7fbe00c00640 1 -- 172.21.15.19:0/1855519234 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0037040 con 0x7fbe040cdde0 2024-04-25T10:27:36.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.249+0000 7fbe0bc00640 1 -- 172.21.15.19:0/1855519234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe041559f0 con 0x7fbe040cdde0 2024-04-25T10:27:36.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.249+0000 7fbe0bc00640 1 -- 172.21.15.19:0/1855519234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe04154630 con 0x7fbe040cdde0 2024-04-25T10:27:36.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.250+0000 7fbe0bc00640 1 -- 172.21.15.19:0/1855519234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe04076520 con 0x7fbe040cdde0 2024-04-25T10:27:36.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.252+0000 7fbe00c00640 1 -- 172.21.15.19:0/1855519234 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbdf003d8b0 con 0x7fbe040cdde0 2024-04-25T10:27:36.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.252+0000 7fbe00c00640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbde40744b0 0x7fbde40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:36.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.253+0000 7fbe00c00640 1 -- 172.21.15.19:0/1855519234 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fbdf00b5520 con 0x7fbe040cdde0 2024-04-25T10:27:36.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.253+0000 7fbe09200640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbde40744b0 0x7fbde40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:36.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.254+0000 7fbe09200640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbde40744b0 0x7fbde40769c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8006f40 tx=0x7fbdf8009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:36.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.258+0000 7fbe00c00640 1 -- 172.21.15.19:0/1855519234 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbdf007f370 con 0x7fbe040cdde0 2024-04-25T10:27:36.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.505+0000 7fbe0bc00640 1 -- 172.21.15.19:0/1855519234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe040b01f0 con 0x7fbe040cdde0 2024-04-25T10:27:36.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.506+0000 7fbe00c00640 1 -- 172.21.15.19:0/1855519234 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7fbdf0083670 con 0x7fbe040cdde0 2024-04-25T10:27:36.509 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:36.509 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:27:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:27:36.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 -- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbde40744b0 msgr2=0x7fbde40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:36.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbde40744b0 0x7fbde40769c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8006f40 tx=0x7fbdf8009240 comp rx=0 tx=0).stop 2024-04-25T10:27:36.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 -- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe040cdde0 msgr2=0x7fbe040ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:36.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe040cdde0 0x7fbe040ca370 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0031000 tx=0x7fbdf00046c0 comp rx=0 tx=0).stop 2024-04-25T10:27:36.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 -- 172.21.15.19:0/1855519234 shutdown_connections 2024-04-25T10:27:36.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbde40744b0 0x7fbde40769c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:36.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe04156850 0x7fbe041f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:36.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe040cdde0 0x7fbe040ca370 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:36.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 --2- 172.21.15.19:0/1855519234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe04073d50 0x7fbe040b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:36.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 -- 172.21.15.19:0/1855519234 >> 172.21.15.19:0/1855519234 conn(0x7fbe0406f1f0 msgr2=0x7fbe0414c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:36.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 -- 172.21.15.19:0/1855519234 shutdown_connections 2024-04-25T10:27:36.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:36.509+0000 7fbe0bc00640 1 -- 172.21.15.19:0/1855519234 wait complete. 2024-04-25T10:27:36.540 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T10:27:38.541 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:38.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.832+0000 7f6b29000640 1 Processor -- start 2024-04-25T10:27:38.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.833+0000 7f6b29000640 1 -- start start 2024-04-25T10:27:38.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.835+0000 7f6b29000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b240c2640 0x7f6b240c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:38.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.835+0000 7f6b29000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6b240c2a50 0x7f6b240c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:38.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.835+0000 7f6b29000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b240c8340 con 0x7f6b241532c0 2024-04-25T10:27:38.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.835+0000 7f6b29000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6b240c9dc0 con 0x7f6b240c2a50 2024-04-25T10:27:38.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.835+0000 7f6b29000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2415c680 con 0x7f6b240c2640 2024-04-25T10:27:38.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.835+0000 7f6b23400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6b241532c0 0x7f6b24072ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47680/0 (socket says 172.21.15.19:47680) 2024-04-25T10:27:38.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.835+0000 7f6b23400640 1 -- 172.21.15.19:0/2876217022 learned_addr learned my addr 172.21.15.19:0/2876217022 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:38.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.835+0000 7f6b23e00640 1 --2- 172.21.15.19:0/2876217022 >> v2:172.21.15.112:3300/0 conn(0x7f6b240c2a50 0x7f6b240c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:38.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.835+0000 7f6b22a00640 1 --2- 172.21.15.19:0/2876217022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b240c2640 0x7f6b240c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.836+0000 7f6b22000640 1 -- 172.21.15.19:0/2876217022 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2501590590 0 0) 0x7f6b240c8340 con 0x7f6b241532c0 2024-04-25T10:27:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.836+0000 7f6b22000640 1 -- 172.21.15.19:0/2876217022 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b08003520 con 0x7f6b241532c0 2024-04-25T10:27:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.836+0000 7f6b23e00640 1 -- 172.21.15.19:0/2876217022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b240c2640 msgr2=0x7f6b240c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:27:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.836+0000 7f6b23e00640 1 --2- 172.21.15.19:0/2876217022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b240c2640 0x7f6b240c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.836+0000 7f6b23e00640 1 -- 172.21.15.19:0/2876217022 >> v1:172.21.15.19:6789/0 conn(0x7f6b241532c0 legacy=0x7f6b24072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.836+0000 7f6b23e00640 1 -- 172.21.15.19:0/2876217022 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2415c960 con 0x7f6b240c2a50 2024-04-25T10:27:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.836+0000 7f6b22a00640 1 --2- 172.21.15.19:0/2876217022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b240c2640 0x7f6b240c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:27:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.837+0000 7f6b23e00640 1 --2- 172.21.15.19:0/2876217022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b240c2a50 0x7f6b240c3520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00bfa0 tx=0x7f6b1c02c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44170d27fa669201 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.838+0000 7f6b22000640 1 -- 172.21.15.19:0/2876217022 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c039070 con 0x7f6b240c2a50 2024-04-25T10:27:38.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.838+0000 7f6b22000640 1 -- 172.21.15.19:0/2876217022 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b1c009540 con 0x7f6b240c2a50 2024-04-25T10:27:38.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.838+0000 7f6b22000640 1 -- 172.21.15.19:0/2876217022 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c009910 con 0x7f6b240c2a50 2024-04-25T10:27:38.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.839+0000 7f6b29000640 1 -- 172.21.15.19:0/2876217022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b240c2a50 msgr2=0x7f6b240c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:38.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.839+0000 7f6b29000640 1 --2- 172.21.15.19:0/2876217022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b240c2a50 0x7f6b240c3520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00bfa0 tx=0x7f6b1c02c870 comp rx=0 tx=0).stop 2024-04-25T10:27:38.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.839+0000 7f6b29000640 1 -- 172.21.15.19:0/2876217022 shutdown_connections 2024-04-25T10:27:38.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.839+0000 7f6b29000640 1 --2- 172.21.15.19:0/2876217022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b240c2a50 0x7f6b240c3520 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:38.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.839+0000 7f6b29000640 1 --2- 172.21.15.19:0/2876217022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b240c2640 0x7f6b240c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:38.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.839+0000 7f6b29000640 1 -- 172.21.15.19:0/2876217022 >> 172.21.15.19:0/2876217022 conn(0x7f6b240cdbc0 msgr2=0x7f6b240ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:38.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.839+0000 7f6b29000640 1 -- 172.21.15.19:0/2876217022 shutdown_connections 2024-04-25T10:27:38.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.839+0000 7f6b29000640 1 -- 172.21.15.19:0/2876217022 wait complete. 2024-04-25T10:27:38.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.842+0000 7f6b29000640 1 Processor -- start 2024-04-25T10:27:38.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.842+0000 7f6b29000640 1 -- start start 2024-04-25T10:27:38.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.844+0000 7f6b29000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b240c2640 0x7f6b241f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:38.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.844+0000 7f6b29000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b240c2a50 0x7f6b2415b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:38.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.844+0000 7f6b29000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b241532c0 0x7f6b240c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:38.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.844+0000 7f6b29000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2415d440 con 0x7f6b240c2a50 2024-04-25T10:27:38.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.844+0000 7f6b29000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2415cf20 con 0x7f6b240c2640 2024-04-25T10:27:38.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.844+0000 7f6b29000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6b240c8620 con 0x7f6b241532c0 2024-04-25T10:27:38.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.845+0000 7f6b22a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b240c2a50 0x7f6b2415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:38.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.845+0000 7f6b23e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b241532c0 0x7f6b240c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:38.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.845+0000 7f6b23400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b240c2640 0x7f6b241f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:38.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.845+0000 7f6b23e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b241532c0 0x7f6b240c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:34218/0 (socket says 172.21.15.19:34218) 2024-04-25T10:27:38.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.845+0000 7f6b23e00640 1 -- 172.21.15.19:0/2217651521 learned_addr learned my addr 172.21.15.19:0/2217651521 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:38.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.845+0000 7f6b22a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b240c2a50 0x7f6b2415b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38928/0 (socket says 172.21.15.19:38928) 2024-04-25T10:27:38.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.845+0000 7f6b23e00640 1 -- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b240c2640 msgr2=0x7f6b241f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:38.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.845+0000 7f6b23e00640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b240c2640 0x7f6b241f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:38.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.845+0000 7f6b23e00640 1 -- 172.21.15.19:0/2217651521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b240c2a50 msgr2=0x7f6b2415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:38.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.845+0000 7f6b23e00640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b240c2a50 0x7f6b2415b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:38.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.845+0000 7f6b23e00640 1 -- 172.21.15.19:0/2217651521 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b241f24e0 con 0x7f6b241532c0 2024-04-25T10:27:38.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.846+0000 7f6b23e00640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b241532c0 0x7f6b240c50e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00d110 tx=0x7f6b1c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:38.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.846+0000 7f6b1b400640 1 -- 172.21.15.19:0/2217651521 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c039040 con 0x7f6b241532c0 2024-04-25T10:27:38.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.846+0000 7f6b1b400640 1 -- 172.21.15.19:0/2217651521 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b1c034460 con 0x7f6b241532c0 2024-04-25T10:27:38.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.846+0000 7f6b29000640 1 -- 172.21.15.19:0/2217651521 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b24153b80 con 0x7f6b241532c0 2024-04-25T10:27:38.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.846+0000 7f6b1b400640 1 -- 172.21.15.19:0/2217651521 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c034850 con 0x7f6b241532c0 2024-04-25T10:27:38.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.846+0000 7f6b29000640 1 -- 172.21.15.19:0/2217651521 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b241577e0 con 0x7f6b241532c0 2024-04-25T10:27:38.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.847+0000 7f6b29000640 1 -- 172.21.15.19:0/2217651521 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b240c7f90 con 0x7f6b241532c0 2024-04-25T10:27:38.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.849+0000 7f6b1b400640 1 -- 172.21.15.19:0/2217651521 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6b1c032070 con 0x7f6b241532c0 2024-04-25T10:27:38.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.850+0000 7f6b1b400640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b040744e0 0x7f6b040769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:38.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.850+0000 7f6b1b400640 1 -- 172.21.15.19:0/2217651521 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f6b1c0b5be0 con 0x7f6b241532c0 2024-04-25T10:27:38.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.850+0000 7f6b23400640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b040744e0 0x7f6b040769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.851+0000 7f6b23400640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b040744e0 0x7f6b040769f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6b14005880 tx=0x7f6b14009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:38.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:38.855+0000 7f6b1b400640 1 -- 172.21.15.19:0/2217651521 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b240c7f90 con 0x7f6b241532c0 2024-04-25T10:27:39.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.099+0000 7f6b29000640 1 -- 172.21.15.19:0/2217651521 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b240c8f80 con 0x7f6b241532c0 2024-04-25T10:27:39.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.100+0000 7f6b1b400640 1 -- 172.21.15.19:0/2217651521 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f6b1c04d060 con 0x7f6b241532c0 2024-04-25T10:27:39.103 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:39.103 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:27:39.104 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:27:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 -- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b040744e0 msgr2=0x7f6b040769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b040744e0 0x7f6b040769f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6b14005880 tx=0x7f6b14009040 comp rx=0 tx=0).stop 2024-04-25T10:27:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 -- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b241532c0 msgr2=0x7f6b240c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b241532c0 0x7f6b240c50e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00d110 tx=0x7f6b1c004a40 comp rx=0 tx=0).stop 2024-04-25T10:27:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 -- 172.21.15.19:0/2217651521 shutdown_connections 2024-04-25T10:27:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6b040744e0 0x7f6b040769f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b241532c0 0x7f6b240c50e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b240c2a50 0x7f6b2415b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 --2- 172.21.15.19:0/2217651521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b240c2640 0x7f6b241f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 -- 172.21.15.19:0/2217651521 >> 172.21.15.19:0/2217651521 conn(0x7f6b240cdbc0 msgr2=0x7f6b24150fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 -- 172.21.15.19:0/2217651521 shutdown_connections 2024-04-25T10:27:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:39.103+0000 7f6b29000640 1 -- 172.21.15.19:0/2217651521 wait complete. 2024-04-25T10:27:39.133 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T10:27:41.134 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:41.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.424+0000 7f22aa200640 1 Processor -- start 2024-04-25T10:27:41.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.424+0000 7f22aa200640 1 -- start start 2024-04-25T10:27:41.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.426+0000 7f22aa200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22a40c2640 0x7f22a40c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:41.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.426+0000 7f22aa200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22a40c2a50 0x7f22a40c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:41.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.426+0000 7f22aa200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a40c8340 con 0x7f22a41532c0 2024-04-25T10:27:41.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.426+0000 7f22aa200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f22a40c9dc0 con 0x7f22a40c2a50 2024-04-25T10:27:41.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.426+0000 7f22aa200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f22a415c680 con 0x7f22a40c2640 2024-04-25T10:27:41.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.427+0000 7f22a9800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22a40c2a50 0x7f22a40c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:41.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.427+0000 7f22a8e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22a41532c0 0x7f22a4072ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47694/0 (socket says 172.21.15.19:47694) 2024-04-25T10:27:41.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.427+0000 7f22a8e00640 1 -- 172.21.15.19:0/2418292761 learned_addr learned my addr 172.21.15.19:0/2418292761 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:41.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.427+0000 7f22a3e00640 1 --2- 172.21.15.19:0/2418292761 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22a40c2640 0x7f22a40c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:41.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.427+0000 7f22a9800640 1 -- 172.21.15.19:0/2418292761 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22a40c2640 msgr2=0x7f22a40c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:27:41.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.427+0000 7f22a9800640 1 --2- 172.21.15.19:0/2418292761 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22a40c2640 0x7f22a40c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:41.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.427+0000 7f22a9800640 1 -- 172.21.15.19:0/2418292761 >> v1:172.21.15.19:6789/0 conn(0x7f22a41532c0 legacy=0x7f22a4072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:41.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.428+0000 7f22a3400640 1 -- 172.21.15.19:0/2418292761 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490669634 0 0) 0x7f22a40c8340 con 0x7f22a41532c0 2024-04-25T10:27:41.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.428+0000 7f22a9800640 1 -- 172.21.15.19:0/2418292761 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a415c960 con 0x7f22a40c2a50 2024-04-25T10:27:41.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.428+0000 7f22a3e00640 1 --2- 172.21.15.19:0/2418292761 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22a40c2640 0x7f22a40c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:27:41.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.429+0000 7f22a9800640 1 --2- 172.21.15.19:0/2418292761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22a40c2a50 0x7f22a40c3520 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f229c009d90 tx=0x7f229c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa7d3f3a7f99311 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:41.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.429+0000 7f22a3400640 1 -- 172.21.15.19:0/2418292761 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c007740 con 0x7f22a40c2a50 2024-04-25T10:27:41.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.429+0000 7f22a3400640 1 -- 172.21.15.19:0/2418292761 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229c0078e0 con 0x7f22a40c2a50 2024-04-25T10:27:41.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.429+0000 7f22a3400640 1 -- 172.21.15.19:0/2418292761 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c007cb0 con 0x7f22a40c2a50 2024-04-25T10:27:41.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.430+0000 7f22aa200640 1 -- 172.21.15.19:0/2418292761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22a40c2a50 msgr2=0x7f22a40c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:41.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.430+0000 7f22aa200640 1 --2- 172.21.15.19:0/2418292761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22a40c2a50 0x7f22a40c3520 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f229c009d90 tx=0x7f229c02a660 comp rx=0 tx=0).stop 2024-04-25T10:27:41.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.430+0000 7f22aa200640 1 -- 172.21.15.19:0/2418292761 shutdown_connections 2024-04-25T10:27:41.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.430+0000 7f22aa200640 1 --2- 172.21.15.19:0/2418292761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22a40c2a50 0x7f22a40c3520 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:41.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.430+0000 7f22aa200640 1 --2- 172.21.15.19:0/2418292761 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22a40c2640 0x7f22a40c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:41.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.430+0000 7f22aa200640 1 -- 172.21.15.19:0/2418292761 >> 172.21.15.19:0/2418292761 conn(0x7f22a40cdbc0 msgr2=0x7f22a40ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:41.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.430+0000 7f22aa200640 1 -- 172.21.15.19:0/2418292761 shutdown_connections 2024-04-25T10:27:41.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.430+0000 7f22aa200640 1 -- 172.21.15.19:0/2418292761 wait complete. 2024-04-25T10:27:41.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.433+0000 7f22aa200640 1 Processor -- start 2024-04-25T10:27:41.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.433+0000 7f22aa200640 1 -- start start 2024-04-25T10:27:41.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.434+0000 7f22aa200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22a40c2640 0x7f22a41f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:41.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.434+0000 7f22aa200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22a40c2a50 0x7f22a41f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:41.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.434+0000 7f22aa200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22a41532c0 0x7f22a40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:41.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.434+0000 7f22aa200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f22a415d440 con 0x7f22a40c2640 2024-04-25T10:27:41.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.434+0000 7f22aa200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f22a415cf20 con 0x7f22a40c2a50 2024-04-25T10:27:41.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.434+0000 7f22aa200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f22a40c8620 con 0x7f22a41532c0 2024-04-25T10:27:41.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.435+0000 7f22a8e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22a40c2640 0x7f22a41f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:41.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.435+0000 7f22a8e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22a40c2640 0x7f22a41f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38940/0 (socket says 172.21.15.19:38940) 2024-04-25T10:27:41.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.435+0000 7f22a8e00640 1 -- 172.21.15.19:0/2799651997 learned_addr learned my addr 172.21.15.19:0/2799651997 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:41.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.435+0000 7f22a3e00640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22a40c2a50 0x7f22a41f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:41.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.435+0000 7f22a9800640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22a41532c0 0x7f22a40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:41.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.435+0000 7f22a8e00640 1 -- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22a41532c0 msgr2=0x7f22a40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:41.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.435+0000 7f22a8e00640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22a41532c0 0x7f22a40c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:41.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.435+0000 7f22a8e00640 1 -- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22a40c2a50 msgr2=0x7f22a41f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:41.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.435+0000 7f22a8e00640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22a40c2a50 0x7f22a41f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:41.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.435+0000 7f22a8e00640 1 -- 172.21.15.19:0/2799651997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a41f3540 con 0x7f22a40c2640 2024-04-25T10:27:41.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.436+0000 7f22a8e00640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22a40c2640 0x7f22a41f6650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f229000c460 tx=0x7f229000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:41.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.436+0000 7f22a0c00640 1 -- 172.21.15.19:0/2799651997 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290018070 con 0x7f22a40c2640 2024-04-25T10:27:41.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.436+0000 7f22a0c00640 1 -- 172.21.15.19:0/2799651997 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2290007500 con 0x7f22a40c2640 2024-04-25T10:27:41.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.436+0000 7f22a0c00640 1 -- 172.21.15.19:0/2799651997 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290004a20 con 0x7f22a40c2640 2024-04-25T10:27:41.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.436+0000 7f22aa200640 1 -- 172.21.15.19:0/2799651997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a415bf40 con 0x7f22a40c2640 2024-04-25T10:27:41.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.436+0000 7f22aa200640 1 -- 172.21.15.19:0/2799651997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a41f5b70 con 0x7f22a40c2640 2024-04-25T10:27:41.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.437+0000 7f22aa200640 1 -- 172.21.15.19:0/2799651997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a40c8340 con 0x7f22a40c2640 2024-04-25T10:27:41.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.439+0000 7f22a0c00640 1 -- 172.21.15.19:0/2799651997 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f229001b070 con 0x7f22a40c2640 2024-04-25T10:27:41.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.440+0000 7f22a0c00640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f22840744b0 0x7f22840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:41.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.440+0000 7f22a0c00640 1 -- 172.21.15.19:0/2799651997 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7f2290094820 con 0x7f22a40c2640 2024-04-25T10:27:41.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.440+0000 7f22a3e00640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f22840744b0 0x7f22840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:41.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.441+0000 7f22a3e00640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f22840744b0 0x7f22840769c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f22a4072f80 tx=0x7f2298009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.445+0000 7f22a0c00640 1 -- 172.21.15.19:0/2799651997 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22a40c8340 con 0x7f22a40c2640 2024-04-25T10:27:41.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.691+0000 7f22aa200640 1 -- 172.21.15.19:0/2799651997 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22a4074a10 con 0x7f22a40c2640 2024-04-25T10:27:41.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.692+0000 7f22a0c00640 1 -- 172.21.15.19:0/2799651997 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f22a4074a10 con 0x7f22a40c2640 2024-04-25T10:27:41.695 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:41.696 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:26:19.423318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":14,"addr":"172.21.15.112:6837/3008138931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3008138931},{"type":"v1","addr":"172.21.15.112:6837","nonce":3008138931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4285,4288,4309]},"id":1}]} 2024-04-25T10:27:41.696 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-04-25T10:27:41.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.695+0000 7f22aa200640 1 -- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f22840744b0 msgr2=0x7f22840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:41.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.695+0000 7f22aa200640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f22840744b0 0x7f22840769c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f22a4072f80 tx=0x7f2298009190 comp rx=0 tx=0).stop 2024-04-25T10:27:41.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.695+0000 7f22aa200640 1 -- 172.21.15.19:0/2799651997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22a40c2640 msgr2=0x7f22a41f6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:41.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.695+0000 7f22aa200640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22a40c2640 0x7f22a41f6650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f229000c460 tx=0x7f229000c920 comp rx=0 tx=0).stop 2024-04-25T10:27:41.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.695+0000 7f22aa200640 1 -- 172.21.15.19:0/2799651997 shutdown_connections 2024-04-25T10:27:41.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.695+0000 7f22aa200640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f22840744b0 0x7f22840769c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.695+0000 7f22aa200640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22a41532c0 0x7f22a40c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.695+0000 7f22aa200640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22a40c2a50 0x7f22a41f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.695+0000 7f22aa200640 1 --2- 172.21.15.19:0/2799651997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22a40c2640 0x7f22a41f6650 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.695+0000 7f22aa200640 1 -- 172.21.15.19:0/2799651997 >> 172.21.15.19:0/2799651997 conn(0x7f22a40cdbc0 msgr2=0x7f22a4150b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.695+0000 7f22aa200640 1 -- 172.21.15.19:0/2799651997 shutdown_connections 2024-04-25T10:27:41.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:41.696+0000 7f22aa200640 1 -- 172.21.15.19:0/2799651997 wait complete. 2024-04-25T10:27:41.727 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T10:27:43.728 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.018+0000 7f5bb9a00640 1 Processor -- start 2024-04-25T10:27:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.018+0000 7f5bb9a00640 1 -- start start 2024-04-25T10:27:44.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.020+0000 7f5bb9a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5bb4160580 0x7f5bb40c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.021+0000 7f5bb9a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5bb4071130 0x7f5bb406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.021+0000 7f5bb9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5bb406e620 0x7f5bb415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.021+0000 7f5bb9a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb40ca850 con 0x7f5bb4160580 2024-04-25T10:27:44.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.021+0000 7f5bb9a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb41600f0 con 0x7f5bb4071130 2024-04-25T10:27:44.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.021+0000 7f5bb9a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb4156ba0 con 0x7f5bb406e620 2024-04-25T10:27:44.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.021+0000 7f5bb3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5bb4160580 0x7f5bb40c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.021+0000 7f5bb3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5bb4160580 0x7f5bb40c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38946/0 (socket says 172.21.15.19:38946) 2024-04-25T10:27:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.021+0000 7f5bb3e00640 1 -- 172.21.15.19:0/372126565 learned_addr learned my addr 172.21.15.19:0/372126565 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.021+0000 7f5bb9000640 1 --2- 172.21.15.19:0/372126565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5bb406e620 0x7f5bb415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.021+0000 7f5babe00640 1 --2- 172.21.15.19:0/372126565 >> v2:172.21.15.112:3300/0 conn(0x7f5bb4071130 0x7f5bb406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.022+0000 7f5bb3e00640 1 -- 172.21.15.19:0/372126565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5bb406e620 msgr2=0x7f5bb415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:27:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.022+0000 7f5bb3e00640 1 --2- 172.21.15.19:0/372126565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5bb406e620 0x7f5bb415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.022+0000 7f5bb3e00640 1 -- 172.21.15.19:0/372126565 >> v2:172.21.15.112:3300/0 conn(0x7f5bb4071130 msgr2=0x7f5bb406e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:27:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.022+0000 7f5bb3e00640 1 --2- 172.21.15.19:0/372126565 >> v2:172.21.15.112:3300/0 conn(0x7f5bb4071130 0x7f5bb406e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.022+0000 7f5bb3e00640 1 -- 172.21.15.19:0/372126565 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb408d760 con 0x7f5bb4160580 2024-04-25T10:27:44.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.023+0000 7f5bb3e00640 1 --2- 172.21.15.19:0/372126565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4160580 0x7f5bb40c4f90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4073a10 tx=0x7f5ba402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8ed03b15d7651e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:44.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.023+0000 7f5bb3400640 1 -- 172.21.15.19:0/372126565 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4037070 con 0x7f5bb4160580 2024-04-25T10:27:44.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.023+0000 7f5bb3400640 1 -- 172.21.15.19:0/372126565 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4032440 con 0x7f5bb4160580 2024-04-25T10:27:44.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.023+0000 7f5bb3400640 1 -- 172.21.15.19:0/372126565 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4032810 con 0x7f5bb4160580 2024-04-25T10:27:44.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.024+0000 7f5bb9a00640 1 -- 172.21.15.19:0/372126565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4160580 msgr2=0x7f5bb40c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.024+0000 7f5bb9a00640 1 --2- 172.21.15.19:0/372126565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4160580 0x7f5bb40c4f90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4073a10 tx=0x7f5ba402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.024+0000 7f5bb9a00640 1 -- 172.21.15.19:0/372126565 shutdown_connections 2024-04-25T10:27:44.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.024+0000 7f5bb9a00640 1 --2- 172.21.15.19:0/372126565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5bb406e620 0x7f5bb415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.024+0000 7f5bb9a00640 1 --2- 172.21.15.19:0/372126565 >> v2:172.21.15.112:3300/0 conn(0x7f5bb4071130 0x7f5bb406e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.024+0000 7f5bb9a00640 1 --2- 172.21.15.19:0/372126565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4160580 0x7f5bb40c4f90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.024+0000 7f5bb9a00640 1 -- 172.21.15.19:0/372126565 >> 172.21.15.19:0/372126565 conn(0x7f5bb4068fc0 msgr2=0x7f5bb4072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:44.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.024+0000 7f5bb9a00640 1 -- 172.21.15.19:0/372126565 shutdown_connections 2024-04-25T10:27:44.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.024+0000 7f5bb9a00640 1 -- 172.21.15.19:0/372126565 wait complete. 2024-04-25T10:27:44.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.027+0000 7f5bb9a00640 1 Processor -- start 2024-04-25T10:27:44.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.027+0000 7f5bb9a00640 1 -- start start 2024-04-25T10:27:44.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.028+0000 7f5bb9a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb406e620 0x7f5bb41f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.028+0000 7f5bb9a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4071130 0x7f5bb41f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.028+0000 7f5bb9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5bb4160580 0x7f5bb415bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.028+0000 7f5bb9a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb415faa0 con 0x7f5bb4071130 2024-04-25T10:27:44.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.028+0000 7f5bb9a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb40ca570 con 0x7f5bb406e620 2024-04-25T10:27:44.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.028+0000 7f5bb9a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb415fd80 con 0x7f5bb4160580 2024-04-25T10:27:44.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5babe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4071130 0x7f5bb41f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5bb3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb406e620 0x7f5bb41f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5babe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4071130 0x7f5bb41f2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38956/0 (socket says 172.21.15.19:38956) 2024-04-25T10:27:44.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5babe00640 1 -- 172.21.15.19:0/1096342034 learned_addr learned my addr 172.21.15.19:0/1096342034 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:44.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5bb9000640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5bb4160580 0x7f5bb415bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5babe00640 1 -- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5bb4160580 msgr2=0x7f5bb415bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5babe00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5bb4160580 0x7f5bb415bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5babe00640 1 -- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb406e620 msgr2=0x7f5bb41f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5babe00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb406e620 0x7f5bb41f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5babe00640 1 -- 172.21.15.19:0/1096342034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb40c6e70 con 0x7f5bb4071130 2024-04-25T10:27:44.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5bb3e00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb406e620 0x7f5bb41f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:27:44.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.029+0000 7f5bb9000640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5bb4160580 0x7f5bb415bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:27:44.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.030+0000 7f5babe00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4071130 0x7f5bb41f2bc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00e8a0 tx=0x7f5b9c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:44.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.030+0000 7f5bb0c00640 1 -- 172.21.15.19:0/1096342034 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c017070 con 0x7f5bb4071130 2024-04-25T10:27:44.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.030+0000 7f5bb0c00640 1 -- 172.21.15.19:0/1096342034 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c00c940 con 0x7f5bb4071130 2024-04-25T10:27:44.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.030+0000 7f5bb0c00640 1 -- 172.21.15.19:0/1096342034 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c00cd30 con 0x7f5bb4071130 2024-04-25T10:27:44.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.030+0000 7f5bb9a00640 1 -- 172.21.15.19:0/1096342034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb41f3100 con 0x7f5bb4071130 2024-04-25T10:27:44.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.030+0000 7f5bb9a00640 1 -- 172.21.15.19:0/1096342034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb40c68b0 con 0x7f5bb4071130 2024-04-25T10:27:44.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.031+0000 7f5bb9a00640 1 -- 172.21.15.19:0/1096342034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb4050740 con 0x7f5bb4071130 2024-04-25T10:27:44.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.033+0000 7f5bb0c00640 1 -- 172.21.15.19:0/1096342034 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5b9c01a070 con 0x7f5bb4071130 2024-04-25T10:27:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.034+0000 7f5bb0c00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5b900744e0 0x7f5b900769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.034+0000 7f5bb0c00640 1 -- 172.21.15.19:0/1096342034 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f5b9c095330 con 0x7f5bb4071130 2024-04-25T10:27:44.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.034+0000 7f5bb3e00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5b900744e0 0x7f5b900769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.035+0000 7f5bb3e00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5b900744e0 0x7f5b900769f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4034000 tx=0x7f5ba402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:44.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.039+0000 7f5bb0c00640 1 -- 172.21.15.19:0/1096342034 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5b9c05f120 con 0x7f5bb4071130 2024-04-25T10:27:44.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.285+0000 7f5bb9a00640 1 -- 172.21.15.19:0/1096342034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bb406da00 con 0x7f5bb4071130 2024-04-25T10:27:44.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.287+0000 7f5bb0c00640 1 -- 172.21.15.19:0/1096342034 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6046 (secure 0 0 0) 0x7f5b9c063420 con 0x7f5bb4071130 2024-04-25T10:27:44.290 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:44.290 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:27:42.417891+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:replay","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4288,4309]},"id":1}]} 2024-04-25T10:27:44.290 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 15 2024-04-25T10:27:44.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.289+0000 7f5bb9a00640 1 -- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5b900744e0 msgr2=0x7f5b900769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.289+0000 7f5bb9a00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5b900744e0 0x7f5b900769f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4034000 tx=0x7f5ba402e000 comp rx=0 tx=0).stop 2024-04-25T10:27:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.289+0000 7f5bb9a00640 1 -- 172.21.15.19:0/1096342034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4071130 msgr2=0x7f5bb41f2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.289+0000 7f5bb9a00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4071130 0x7f5bb41f2bc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00e8a0 tx=0x7f5b9c00ed60 comp rx=0 tx=0).stop 2024-04-25T10:27:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.290+0000 7f5bb9a00640 1 -- 172.21.15.19:0/1096342034 shutdown_connections 2024-04-25T10:27:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.290+0000 7f5bb9a00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5b900744e0 0x7f5b900769f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.290+0000 7f5bb9a00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5bb4160580 0x7f5bb415bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.290+0000 7f5bb9a00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4071130 0x7f5bb41f2bc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.290+0000 7f5bb9a00640 1 --2- 172.21.15.19:0/1096342034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb406e620 0x7f5bb41f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.290+0000 7f5bb9a00640 1 -- 172.21.15.19:0/1096342034 >> 172.21.15.19:0/1096342034 conn(0x7f5bb4068fc0 msgr2=0x7f5bb41e77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.290+0000 7f5bb9a00640 1 -- 172.21.15.19:0/1096342034 shutdown_connections 2024-04-25T10:27:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.290+0000 7f5bb9a00640 1 -- 172.21.15.19:0/1096342034 wait complete. 2024-04-25T10:27:44.319 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d down, removed from mdsmap 2024-04-25T10:27:44.319 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-04-25T10:27:44.319 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:44.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.587+0000 7f70f7e00640 1 Processor -- start 2024-04-25T10:27:44.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.588+0000 7f70f7e00640 1 -- start start 2024-04-25T10:27:44.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.590+0000 7f70f7e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f70f815a370 0x7f70f8070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.590+0000 7f70f7e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70f815a8b0 con 0x7f70f80c7f90 2024-04-25T10:27:44.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.590+0000 7f70f7e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70f815ab70 con 0x7f70f8073d20 2024-04-25T10:27:44.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.590+0000 7f70f7e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f70f8072ea0 con 0x7f70f815a370 2024-04-25T10:27:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.590+0000 7f70f6a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f70f815a370 0x7f70f8070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.591+0000 7f70f6000640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f70f80c7f90 0x7f70f8073610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47708/0 (socket says 172.21.15.19:47708) 2024-04-25T10:27:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.591+0000 7f70f6000640 1 -- 172.21.15.19:0/256177755 learned_addr learned my addr 172.21.15.19:0/256177755 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.591+0000 7f70f6a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f70f815a370 0x7f70f8070860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38962/0 (socket says 172.21.15.19:38962) 2024-04-25T10:27:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.591+0000 7f70f6a00640 1 -- 172.21.15.19:0/256177755 >> v1:172.21.15.112:6789/0 conn(0x7f70f8073d20 legacy=0x7f70f8154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.591+0000 7f70f6a00640 1 -- 172.21.15.19:0/256177755 >> v1:172.21.15.19:6789/0 conn(0x7f70f80c7f90 legacy=0x7f70f8073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.591+0000 7f70f6a00640 1 -- 172.21.15.19:0/256177755 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f815ae50 con 0x7f70f815a370 2024-04-25T10:27:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.592+0000 7f70f6a00640 1 --2- 172.21.15.19:0/256177755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70f815a370 0x7f70f8070860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f70e80097a0 tx=0x7f70e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fb3eb157b75725 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:44.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.592+0000 7f70f5600640 1 -- 172.21.15.19:0/256177755 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8037070 con 0x7f70f815a370 2024-04-25T10:27:44.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.593+0000 7f70f5600640 1 -- 172.21.15.19:0/256177755 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8032440 con 0x7f70f815a370 2024-04-25T10:27:44.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.593+0000 7f70f5600640 1 -- 172.21.15.19:0/256177755 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8032810 con 0x7f70f815a370 2024-04-25T10:27:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.593+0000 7f70f7e00640 1 -- 172.21.15.19:0/256177755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70f815a370 msgr2=0x7f70f8070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.593+0000 7f70f7e00640 1 --2- 172.21.15.19:0/256177755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70f815a370 0x7f70f8070860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f70e80097a0 tx=0x7f70e802a1a0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.593+0000 7f70f7e00640 1 -- 172.21.15.19:0/256177755 shutdown_connections 2024-04-25T10:27:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.593+0000 7f70f7e00640 1 --2- 172.21.15.19:0/256177755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70f815a370 0x7f70f8070860 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.593+0000 7f70f7e00640 1 -- 172.21.15.19:0/256177755 >> 172.21.15.19:0/256177755 conn(0x7f70f80cdbc0 msgr2=0x7f70f80ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.593+0000 7f70f7e00640 1 -- 172.21.15.19:0/256177755 shutdown_connections 2024-04-25T10:27:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.593+0000 7f70f7e00640 1 -- 172.21.15.19:0/256177755 wait complete. 2024-04-25T10:27:44.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.596+0000 7f70f7e00640 1 Processor -- start 2024-04-25T10:27:44.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.596+0000 7f70f7e00640 1 -- start start 2024-04-25T10:27:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.597+0000 7f70f7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70f80c7f90 0x7f70f81f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.597+0000 7f70f7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f70f815a370 0x7f70f80ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.597+0000 7f70f7e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70f80c8bb0 0x7f70f81e7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.597+0000 7f70f7e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f70f80c4b20 con 0x7f70f80c8bb0 2024-04-25T10:27:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.597+0000 7f70f7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8073180 con 0x7f70f80c7f90 2024-04-25T10:27:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.597+0000 7f70f7e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f70f8070da0 con 0x7f70f815a370 2024-04-25T10:27:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.597+0000 7f70f7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70f80c8bb0 0x7f70f81e7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.597+0000 7f70f7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70f80c8bb0 0x7f70f81e7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38976/0 (socket says 172.21.15.19:38976) 2024-04-25T10:27:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.597+0000 7f70f7400640 1 -- 172.21.15.19:0/2899897418 learned_addr learned my addr 172.21.15.19:0/2899897418 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.598+0000 7f70f6000640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f70f815a370 0x7f70f80ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.598+0000 7f70f6a00640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70f80c7f90 0x7f70f81f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.598+0000 7f70f7400640 1 -- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f70f815a370 msgr2=0x7f70f80ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.598+0000 7f70f7400640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f70f815a370 0x7f70f80ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.598+0000 7f70f7400640 1 -- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70f80c7f90 msgr2=0x7f70f81f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.598+0000 7f70f7400640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70f80c7f90 0x7f70f81f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.598+0000 7f70f7400640 1 -- 172.21.15.19:0/2899897418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f81f2ea0 con 0x7f70f80c8bb0 2024-04-25T10:27:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.598+0000 7f70f7400640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70f80c8bb0 0x7f70f81e7d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c3c0 tx=0x7f70f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.598+0000 7f70ef400640 1 -- 172.21.15.19:0/2899897418 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0005220 con 0x7f70f80c8bb0 2024-04-25T10:27:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.599+0000 7f70ef400640 1 -- 172.21.15.19:0/2899897418 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f00053c0 con 0x7f70f80c8bb0 2024-04-25T10:27:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.599+0000 7f70ef400640 1 -- 172.21.15.19:0/2899897418 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0007270 con 0x7f70f80c8bb0 2024-04-25T10:27:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.599+0000 7f70f7e00640 1 -- 172.21.15.19:0/2899897418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f81f5eb0 con 0x7f70f80c8bb0 2024-04-25T10:27:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.599+0000 7f70f7e00640 1 -- 172.21.15.19:0/2899897418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f81f6470 con 0x7f70f80c8bb0 2024-04-25T10:27:44.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.600+0000 7f70f7e00640 1 -- 172.21.15.19:0/2899897418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f8050740 con 0x7f70f80c8bb0 2024-04-25T10:27:44.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.601+0000 7f70ef400640 1 -- 172.21.15.19:0/2899897418 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f70f0019020 con 0x7f70f80c8bb0 2024-04-25T10:27:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.602+0000 7f70ef400640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f70d80744e0 0x7f70d80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.602+0000 7f70ef400640 1 -- 172.21.15.19:0/2899897418 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f70f00946e0 con 0x7f70f80c8bb0 2024-04-25T10:27:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.603+0000 7f70f6a00640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f70d80744e0 0x7f70d80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:44.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.603+0000 7f70f6a00640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f70d80744e0 0x7f70d80769f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f70e8034000 tx=0x7f70e802e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.607+0000 7f70ef400640 1 -- 172.21.15.19:0/2899897418 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f70f005e440 con 0x7f70f80c8bb0 2024-04-25T10:27:44.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.847+0000 7f70f7e00640 1 -- 172.21.15.19:0/2899897418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70f80c59e0 con 0x7f70f80c8bb0 2024-04-25T10:27:44.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.849+0000 7f70ef400640 1 -- 172.21.15.19:0/2899897418 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6046 (secure 0 0 0) 0x7f70f0062740 con 0x7f70f80c8bb0 2024-04-25T10:27:44.851 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:44.852 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:27:42.417891+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:replay","state_seq":1,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4288,4309]},"id":1}]} 2024-04-25T10:27:44.852 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 15 2024-04-25T10:27:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.851+0000 7f70f7e00640 1 -- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f70d80744e0 msgr2=0x7f70d80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.851+0000 7f70f7e00640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f70d80744e0 0x7f70d80769f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f70e8034000 tx=0x7f70e802e000 comp rx=0 tx=0).stop 2024-04-25T10:27:44.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.851+0000 7f70f7e00640 1 -- 172.21.15.19:0/2899897418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70f80c8bb0 msgr2=0x7f70f81e7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:44.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.851+0000 7f70f7e00640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70f80c8bb0 0x7f70f81e7d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c3c0 tx=0x7f70f000c880 comp rx=0 tx=0).stop 2024-04-25T10:27:44.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.851+0000 7f70f7e00640 1 -- 172.21.15.19:0/2899897418 shutdown_connections 2024-04-25T10:27:44.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.851+0000 7f70f7e00640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70f80c8bb0 0x7f70f81e7d10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.851+0000 7f70f7e00640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f70d80744e0 0x7f70d80769f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.851+0000 7f70f7e00640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f70f815a370 0x7f70f80ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.851+0000 7f70f7e00640 1 --2- 172.21.15.19:0/2899897418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70f80c7f90 0x7f70f81f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.851+0000 7f70f7e00640 1 -- 172.21.15.19:0/2899897418 >> 172.21.15.19:0/2899897418 conn(0x7f70f80cdbc0 msgr2=0x7f70f81589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.852+0000 7f70f7e00640 1 -- 172.21.15.19:0/2899897418 shutdown_connections 2024-04-25T10:27:44.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:44.852+0000 7f70f7e00640 1 -- 172.21.15.19:0/2899897418 wait complete. 2024-04-25T10:27:44.881 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 15, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T10:25:36.724799+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 15, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4282": { "addr": "172.21.15.112:6835/3446267878", "addrs": { "addrvec": [ { "addr": "172.21.15.112:6834", "nonce": 3446267878, "type": "v2" }, { "addr": "172.21.15.112:6835", "nonce": 3446267878, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4282, "incarnation": 15, "join_fscid": -1, "name": "b", "rank": 2, "state": "up:replay", "state_seq": 1 }, "gid_4288": { "addr": "172.21.15.112:6839/3638094761", "addrs": { "addrvec": [ { "addr": "172.21.15.112:6838", "nonce": 3638094761, "type": "v2" }, { "addr": "172.21.15.112:6839", "nonce": 3638094761, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4288, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 12 }, "gid_4309": { "addr": "172.21.15.19:6835/1037719859", "addrs": { "addrvec": [ { "addr": "172.21.15.19:6834", "nonce": 1037719859, "type": "v2" }, { "addr": "172.21.15.19:6835", "nonce": 1037719859, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4309, "incarnation": 4, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 27, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T10:27:42.417891+0000", "qdb_cluster": [ 4288, 4309 ], "qdb_leader": 4309, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4309, "mds_1": 4288, "mds_2": 4282 } } } ], "standbys": [ { "addr": "172.21.15.19:6837/1773190450", "addrs": { "addrvec": [ { "addr": "172.21.15.19:6836", "nonce": 1773190450, "type": "v2" }, { "addr": "172.21.15.19:6837", "nonce": 1773190450, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4203, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.19:6833/2830282623", "addrs": { "addrvec": [ { "addr": "172.21.15.19:6832", "nonce": 2830282623, "type": "v2" }, { "addr": "172.21.15.19:6833", "nonce": 2830282623, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4250, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T10:27:46.882 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:47.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.175+0000 7f6093200640 1 Processor -- start 2024-04-25T10:27:47.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.176+0000 7f6093200640 1 -- start start 2024-04-25T10:27:47.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.178+0000 7f6093200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6094153200 0x7f6094167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:47.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.178+0000 7f6093200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609406d900 con 0x7f609406d410 2024-04-25T10:27:47.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.178+0000 7f6093200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60940ca350 con 0x7f60940c36c0 2024-04-25T10:27:47.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.178+0000 7f6093200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f609406daf0 con 0x7f6094153200 2024-04-25T10:27:47.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.178+0000 7f6091e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f609406d410 0x7f609415c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47712/0 (socket says 172.21.15.19:47712) 2024-04-25T10:27:47.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.178+0000 7f6091e00640 1 -- 172.21.15.19:0/2972290902 learned_addr learned my addr 172.21.15.19:0/2972290902 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:47.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.179+0000 7f6092800640 1 --2- 172.21.15.19:0/2972290902 >> v2:172.21.15.19:3300/0 conn(0x7f6094153200 0x7f6094167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:47.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.179+0000 7f6090a00640 1 -- 172.21.15.19:0/2972290902 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674016236 0 0) 0x7f609406d900 con 0x7f609406d410 2024-04-25T10:27:47.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.179+0000 7f6090a00640 1 -- 172.21.15.19:0/2972290902 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6078003520 con 0x7f609406d410 2024-04-25T10:27:47.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.179+0000 7f6090a00640 1 -- 172.21.15.19:0/2972290902 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599601955 0 0) 0x7f60940ca350 con 0x7f60940c36c0 2024-04-25T10:27:47.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.179+0000 7f6090a00640 1 -- 172.21.15.19:0/2972290902 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f609406d900 con 0x7f60940c36c0 2024-04-25T10:27:47.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.179+0000 7f6092800640 1 -- 172.21.15.19:0/2972290902 >> v1:172.21.15.112:6789/0 conn(0x7f60940c36c0 legacy=0x7f609406fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:47.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.179+0000 7f6092800640 1 -- 172.21.15.19:0/2972290902 >> v1:172.21.15.19:6789/0 conn(0x7f609406d410 legacy=0x7f609415c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:47.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.179+0000 7f6090a00640 1 -- 172.21.15.19:0/2972290902 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2748387873 0 0) 0x7f6078003520 con 0x7f609406d410 2024-04-25T10:27:47.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.179+0000 7f6092800640 1 -- 172.21.15.19:0/2972290902 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60940ca630 con 0x7f6094153200 2024-04-25T10:27:47.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.180+0000 7f6092800640 1 --2- 172.21.15.19:0/2972290902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6094153200 0x7f6094167dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f608c0097a0 tx=0x7f608c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48ce1f2a85c242b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:47.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.181+0000 7f6090a00640 1 -- 172.21.15.19:0/2972290902 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c037070 con 0x7f6094153200 2024-04-25T10:27:47.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.181+0000 7f6090a00640 1 -- 172.21.15.19:0/2972290902 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f608c02ac50 con 0x7f6094153200 2024-04-25T10:27:47.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.181+0000 7f6090a00640 1 -- 172.21.15.19:0/2972290902 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60840019f0 con 0x7f6094153200 2024-04-25T10:27:47.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.181+0000 7f6093200640 1 -- 172.21.15.19:0/2972290902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6094153200 msgr2=0x7f6094167dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:47.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.181+0000 7f6093200640 1 --2- 172.21.15.19:0/2972290902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6094153200 0x7f6094167dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f608c0097a0 tx=0x7f608c02a1c0 comp rx=0 tx=0).stop 2024-04-25T10:27:47.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.181+0000 7f6093200640 1 -- 172.21.15.19:0/2972290902 shutdown_connections 2024-04-25T10:27:47.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.181+0000 7f6093200640 1 --2- 172.21.15.19:0/2972290902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6094153200 0x7f6094167dd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:47.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.181+0000 7f6093200640 1 -- 172.21.15.19:0/2972290902 >> 172.21.15.19:0/2972290902 conn(0x7f60940cb1a0 msgr2=0x7f60940cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:47.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.182+0000 7f6093200640 1 -- 172.21.15.19:0/2972290902 shutdown_connections 2024-04-25T10:27:47.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.182+0000 7f6093200640 1 -- 172.21.15.19:0/2972290902 wait complete. 2024-04-25T10:27:47.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.184+0000 7f6093200640 1 Processor -- start 2024-04-25T10:27:47.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.184+0000 7f6093200640 1 -- start start 2024-04-25T10:27:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.185+0000 7f6093200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609406d410 0x7f60941f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6093200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60940c36c0 0x7f60941601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6093200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094153200 0x7f6094071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6093200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6094153610 con 0x7f609406d410 2024-04-25T10:27:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6093200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f609406e0b0 con 0x7f6094153200 2024-04-25T10:27:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6093200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f60940caa70 con 0x7f60940c36c0 2024-04-25T10:27:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6091e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609406d410 0x7f60941f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6091e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609406d410 0x7f60941f67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38994/0 (socket says 172.21.15.19:38994) 2024-04-25T10:27:47.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6091e00640 1 -- 172.21.15.19:0/706513750 learned_addr learned my addr 172.21.15.19:0/706513750 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:47.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6092800640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094153200 0x7f6094071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:47.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6091400640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60940c36c0 0x7f60941601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:47.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6091e00640 1 -- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60940c36c0 msgr2=0x7f60941601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:47.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6091e00640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60940c36c0 0x7f60941601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:47.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6091e00640 1 -- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094153200 msgr2=0x7f6094071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:47.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6091e00640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094153200 0x7f6094071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:47.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.186+0000 7f6091e00640 1 -- 172.21.15.19:0/706513750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60940c5d80 con 0x7f609406d410 2024-04-25T10:27:47.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.187+0000 7f6091e00640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609406d410 0x7f60941f67b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6084002230 tx=0x7f608400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.187+0000 7f608a000640 1 -- 172.21.15.19:0/706513750 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608400ce10 con 0x7f609406d410 2024-04-25T10:27:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.187+0000 7f608a000640 1 -- 172.21.15.19:0/706513750 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6084012400 con 0x7f609406d410 2024-04-25T10:27:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.187+0000 7f6093200640 1 -- 172.21.15.19:0/706513750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60940c6060 con 0x7f609406d410 2024-04-25T10:27:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.187+0000 7f608a000640 1 -- 172.21.15.19:0/706513750 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60840127f0 con 0x7f609406d410 2024-04-25T10:27:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.187+0000 7f6093200640 1 -- 172.21.15.19:0/706513750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6094160720 con 0x7f609406d410 2024-04-25T10:27:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.188+0000 7f6093200640 1 -- 172.21.15.19:0/706513750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6094050740 con 0x7f609406d410 2024-04-25T10:27:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.190+0000 7f608a000640 1 -- 172.21.15.19:0/706513750 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6084012990 con 0x7f609406d410 2024-04-25T10:27:47.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.191+0000 7f608a000640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f60700744b0 0x7f60700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:47.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.192+0000 7f608a000640 1 -- 172.21.15.19:0/706513750 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f6084095d50 con 0x7f609406d410 2024-04-25T10:27:47.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.192+0000 7f6091400640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f60700744b0 0x7f60700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:47.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.193+0000 7f6091400640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f60700744b0 0x7f60700769c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f607c007fd0 tx=0x7f607c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:47.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.197+0000 7f608a000640 1 -- 172.21.15.19:0/706513750 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f608405fc00 con 0x7f609406d410 2024-04-25T10:27:47.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.448+0000 7f6093200640 1 -- 172.21.15.19:0/706513750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60940cad80 con 0x7f609406d410 2024-04-25T10:27:47.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.454+0000 7f608a000640 1 -- 172.21.15.19:0/706513750 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6048 (secure 0 0 0) 0x7f6084068240 con 0x7f609406d410 2024-04-25T10:27:47.457 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:47.457 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:27:47.432153+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:resolve","state_seq":36,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309,4288]},"id":1}]} 2024-04-25T10:27:47.457 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 16 2024-04-25T10:27:47.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 -- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f60700744b0 msgr2=0x7f60700769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:47.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f60700744b0 0x7f60700769c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f607c007fd0 tx=0x7f607c009040 comp rx=0 tx=0).stop 2024-04-25T10:27:47.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 -- 172.21.15.19:0/706513750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609406d410 msgr2=0x7f60941f67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:47.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609406d410 0x7f60941f67b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6084002230 tx=0x7f608400a430 comp rx=0 tx=0).stop 2024-04-25T10:27:47.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 -- 172.21.15.19:0/706513750 shutdown_connections 2024-04-25T10:27:47.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6094153200 0x7f6094071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:47.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f60700744b0 0x7f60700769c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:47.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60940c36c0 0x7f60941601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:47.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 --2- 172.21.15.19:0/706513750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609406d410 0x7f60941f67b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:47.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 -- 172.21.15.19:0/706513750 >> 172.21.15.19:0/706513750 conn(0x7f60940cb1a0 msgr2=0x7f60940cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:47.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 -- 172.21.15.19:0/706513750 shutdown_connections 2024-04-25T10:27:47.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:47.457+0000 7f6093200640 1 -- 172.21.15.19:0/706513750 wait complete. 2024-04-25T10:27:47.486 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-25T10:27:49.487 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:49.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.779+0000 7f10d1800640 1 Processor -- start 2024-04-25T10:27:49.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.779+0000 7f10d1800640 1 -- start start 2024-04-25T10:27:49.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.781+0000 7f10d1800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10cc0b4090 0x7f10cc0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:49.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.781+0000 7f10d1800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f10cc1567a0 0x7f10cc0ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:49.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.781+0000 7f10d1800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10cc15c5f0 con 0x7f10cc0b45e0 2024-04-25T10:27:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.781+0000 7f10d1800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f10cc15c8d0 con 0x7f10cc1567a0 2024-04-25T10:27:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.781+0000 7f10d1800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f10cc15cbb0 con 0x7f10cc0b4090 2024-04-25T10:27:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.782+0000 7f10cb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f10cc1567a0 0x7f10cc0ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.782+0000 7f10cb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f10cc1567a0 0x7f10cc0ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:57002/0 (socket says 172.21.15.19:57002) 2024-04-25T10:27:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.782+0000 7f10cb400640 1 -- 172.21.15.19:0/372582409 learned_addr learned my addr 172.21.15.19:0/372582409 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.782+0000 7f10cbe00640 1 --2- 172.21.15.19:0/372582409 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10cc0b4090 0x7f10cc0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.782+0000 7f10cb400640 1 -- 172.21.15.19:0/372582409 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10cc0b4090 msgr2=0x7f10cc0b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:27:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.782+0000 7f10cb400640 1 --2- 172.21.15.19:0/372582409 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10cc0b4090 0x7f10cc0b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.782+0000 7f10cb400640 1 -- 172.21.15.19:0/372582409 >> v1:172.21.15.19:6789/0 conn(0x7f10cc0b45e0 legacy=0x7f10cc0cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.782+0000 7f10cb400640 1 -- 172.21.15.19:0/372582409 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10cc15ce90 con 0x7f10cc1567a0 2024-04-25T10:27:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.783+0000 7f10cb400640 1 --2- 172.21.15.19:0/372582409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10cc1567a0 0x7f10cc0ccdc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009870 tx=0x7f10b402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caeb99ad37c153a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.784+0000 7f10caa00640 1 -- 172.21.15.19:0/372582409 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4037070 con 0x7f10cc1567a0 2024-04-25T10:27:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.784+0000 7f10caa00640 1 -- 172.21.15.19:0/372582409 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b4032440 con 0x7f10cc1567a0 2024-04-25T10:27:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.784+0000 7f10caa00640 1 -- 172.21.15.19:0/372582409 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4032810 con 0x7f10cc1567a0 2024-04-25T10:27:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.784+0000 7f10d1800640 1 -- 172.21.15.19:0/372582409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10cc1567a0 msgr2=0x7f10cc0ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.784+0000 7f10d1800640 1 --2- 172.21.15.19:0/372582409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10cc1567a0 0x7f10cc0ccdc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009870 tx=0x7f10b402a250 comp rx=0 tx=0).stop 2024-04-25T10:27:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.785+0000 7f10d1800640 1 -- 172.21.15.19:0/372582409 shutdown_connections 2024-04-25T10:27:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.785+0000 7f10d1800640 1 --2- 172.21.15.19:0/372582409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10cc1567a0 0x7f10cc0ccdc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.785+0000 7f10d1800640 1 --2- 172.21.15.19:0/372582409 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10cc0b4090 0x7f10cc0b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.785+0000 7f10d1800640 1 -- 172.21.15.19:0/372582409 >> 172.21.15.19:0/372582409 conn(0x7f10cc08d940 msgr2=0x7f10cc08dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.785+0000 7f10d1800640 1 -- 172.21.15.19:0/372582409 shutdown_connections 2024-04-25T10:27:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.785+0000 7f10d1800640 1 -- 172.21.15.19:0/372582409 wait complete. 2024-04-25T10:27:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.787+0000 7f10d1800640 1 Processor -- start 2024-04-25T10:27:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.787+0000 7f10d1800640 1 -- start start 2024-04-25T10:27:49.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.789+0000 7f10d1800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc0b4090 0x7f10cc1e6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:49.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.789+0000 7f10d1800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10cc0b45e0 0x7f10cc14fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.789+0000 7f10d1800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10cc1567a0 0x7f10cc1f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.789+0000 7f10d1800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc0ce7e0 con 0x7f10cc0b4090 2024-04-25T10:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.789+0000 7f10d1800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc0ce660 con 0x7f10cc0b45e0 2024-04-25T10:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.789+0000 7f10d1800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f10cc14e310 con 0x7f10cc1567a0 2024-04-25T10:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.789+0000 7f10cbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc0b4090 0x7f10cc1e6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.789+0000 7f10cbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc0b4090 0x7f10cc1e6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48766/0 (socket says 172.21.15.19:48766) 2024-04-25T10:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.789+0000 7f10cbe00640 1 -- 172.21.15.19:0/1423813259 learned_addr learned my addr 172.21.15.19:0/1423813259 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.789+0000 7f10d0e00640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10cc1567a0 0x7f10cc1f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.789+0000 7f10cb400640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10cc0b45e0 0x7f10cc14fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.790+0000 7f10cbe00640 1 -- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10cc1567a0 msgr2=0x7f10cc1f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.790+0000 7f10cbe00640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10cc1567a0 0x7f10cc1f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:49.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.790+0000 7f10cbe00640 1 -- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10cc0b45e0 msgr2=0x7f10cc14fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:49.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.790+0000 7f10cbe00640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10cc0b45e0 0x7f10cc14fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:49.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.790+0000 7f10cbe00640 1 -- 172.21.15.19:0/1423813259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10cc1e6fd0 con 0x7f10cc0b4090 2024-04-25T10:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.790+0000 7f10cbe00640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc0b4090 0x7f10cc1e6a90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009d10 tx=0x7f10bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.791+0000 7f10c3e00640 1 -- 172.21.15.19:0/1423813259 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc018020 con 0x7f10cc0b4090 2024-04-25T10:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.791+0000 7f10c3e00640 1 -- 172.21.15.19:0/1423813259 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10bc014480 con 0x7f10cc0b4090 2024-04-25T10:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.791+0000 7f10c3e00640 1 -- 172.21.15.19:0/1423813259 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc014830 con 0x7f10cc0b4090 2024-04-25T10:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.791+0000 7f10d1800640 1 -- 172.21.15.19:0/1423813259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10cc14f1d0 con 0x7f10cc0b4090 2024-04-25T10:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.791+0000 7f10d1800640 1 -- 172.21.15.19:0/1423813259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10cc1e8380 con 0x7f10cc0b4090 2024-04-25T10:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.792+0000 7f10d1800640 1 -- 172.21.15.19:0/1423813259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10cc06f580 con 0x7f10cc0b4090 2024-04-25T10:27:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.793+0000 7f10c3e00640 1 -- 172.21.15.19:0/1423813259 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f10bc005d10 con 0x7f10cc0b4090 2024-04-25T10:27:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.794+0000 7f10c3e00640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f10a80744b0 0x7f10a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.794+0000 7f10c3e00640 1 -- 172.21.15.19:0/1423813259 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f10bc096330 con 0x7f10cc0b4090 2024-04-25T10:27:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.795+0000 7f10cb400640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f10a80744b0 0x7f10a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.795+0000 7f10cb400640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f10a80744b0 0x7f10a80769c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f10b4034000 tx=0x7f10b402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:49.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:49.800+0000 7f10c3e00640 1 -- 172.21.15.19:0/1423813259 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f10cc06f580 con 0x7f10cc0b4090 2024-04-25T10:27:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.047+0000 7f10d1800640 1 -- 172.21.15.19:0/1423813259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10cc050740 con 0x7f10cc0b4090 2024-04-25T10:27:50.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.048+0000 7f10c3e00640 1 -- 172.21.15.19:0/1423813259 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6048 (secure 0 0 0) 0x7f10bc022030 con 0x7f10cc0b4090 2024-04-25T10:27:50.051 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:50.051 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:27:47.432153+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:resolve","state_seq":36,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309,4288]},"id":1}]} 2024-04-25T10:27:50.052 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 16 2024-04-25T10:27:50.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.051+0000 7f10d1800640 1 -- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f10a80744b0 msgr2=0x7f10a80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.051+0000 7f10d1800640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f10a80744b0 0x7f10a80769c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f10b4034000 tx=0x7f10b402e000 comp rx=0 tx=0).stop 2024-04-25T10:27:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.051+0000 7f10d1800640 1 -- 172.21.15.19:0/1423813259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc0b4090 msgr2=0x7f10cc1e6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.051+0000 7f10d1800640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc0b4090 0x7f10cc1e6a90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009d10 tx=0x7f10bc00c490 comp rx=0 tx=0).stop 2024-04-25T10:27:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.051+0000 7f10d1800640 1 -- 172.21.15.19:0/1423813259 shutdown_connections 2024-04-25T10:27:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.051+0000 7f10d1800640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f10a80744b0 0x7f10a80769c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.051+0000 7f10d1800640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10cc1567a0 0x7f10cc1f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.051+0000 7f10d1800640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10cc0b45e0 0x7f10cc14fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.051+0000 7f10d1800640 1 --2- 172.21.15.19:0/1423813259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc0b4090 0x7f10cc1e6a90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.051+0000 7f10d1800640 1 -- 172.21.15.19:0/1423813259 >> 172.21.15.19:0/1423813259 conn(0x7f10cc08d940 msgr2=0x7f10cc155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.052+0000 7f10d1800640 1 -- 172.21.15.19:0/1423813259 shutdown_connections 2024-04-25T10:27:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:50.052+0000 7f10d1800640 1 -- 172.21.15.19:0/1423813259 wait complete. 2024-04-25T10:27:50.080 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-25T10:27:52.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:52.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.374+0000 7f6d13200640 1 Processor -- start 2024-04-25T10:27:52.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.374+0000 7f6d13200640 1 -- start start 2024-04-25T10:27:52.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.376+0000 7f6d13200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c9110 0x7f6d140710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.376+0000 7f6d13200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6d141566f0 0x7f6d14070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.376+0000 7f6d13200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d14156b00 con 0x7f6d140c3730 2024-04-25T10:27:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.376+0000 7f6d13200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6d140c9ed0 con 0x7f6d141566f0 2024-04-25T10:27:52.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.376+0000 7f6d13200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1415f9f0 con 0x7f6d140c9110 2024-04-25T10:27:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.376+0000 7f6d11e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c9110 0x7f6d140710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.376+0000 7f6d11400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6d140c3730 0x7f6d140ca700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:46680/0 (socket says 172.21.15.19:46680) 2024-04-25T10:27:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.377+0000 7f6d11400640 1 -- 172.21.15.19:0/364383727 learned_addr learned my addr 172.21.15.19:0/364383727 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:52.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.377+0000 7f6d12800640 1 --2- 172.21.15.19:0/364383727 >> v2:172.21.15.112:3300/0 conn(0x7f6d141566f0 0x7f6d14070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:52.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.377+0000 7f6d10a00640 1 -- 172.21.15.19:0/364383727 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4105274634 0 0) 0x7f6d14156b00 con 0x7f6d140c3730 2024-04-25T10:27:52.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.377+0000 7f6d10a00640 1 -- 172.21.15.19:0/364383727 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cf8003520 con 0x7f6d140c3730 2024-04-25T10:27:52.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.377+0000 7f6d11e00640 1 -- 172.21.15.19:0/364383727 >> v2:172.21.15.112:3300/0 conn(0x7f6d141566f0 msgr2=0x7f6d14070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:27:52.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.377+0000 7f6d11e00640 1 --2- 172.21.15.19:0/364383727 >> v2:172.21.15.112:3300/0 conn(0x7f6d141566f0 0x7f6d14070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:52.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.377+0000 7f6d11e00640 1 -- 172.21.15.19:0/364383727 >> v1:172.21.15.112:6789/0 conn(0x7f6d140c3730 legacy=0x7f6d140ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:52.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.377+0000 7f6d11e00640 1 -- 172.21.15.19:0/364383727 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d140c9650 con 0x7f6d140c9110 2024-04-25T10:27:52.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.379+0000 7f6d11e00640 1 --2- 172.21.15.19:0/364383727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c9110 0x7f6d140710e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6d040097a0 tx=0x7f6d0402a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65ab566c10c2b4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:52.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.379+0000 7f6d10a00640 1 -- 172.21.15.19:0/364383727 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04037070 con 0x7f6d140c9110 2024-04-25T10:27:52.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.379+0000 7f6d10a00640 1 -- 172.21.15.19:0/364383727 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0402ae40 con 0x7f6d140c9110 2024-04-25T10:27:52.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.379+0000 7f6d10a00640 1 -- 172.21.15.19:0/364383727 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04032660 con 0x7f6d140c9110 2024-04-25T10:27:52.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.380+0000 7f6d13200640 1 -- 172.21.15.19:0/364383727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c9110 msgr2=0x7f6d140710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:52.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.380+0000 7f6d13200640 1 --2- 172.21.15.19:0/364383727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c9110 0x7f6d140710e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6d040097a0 tx=0x7f6d0402a0f0 comp rx=0 tx=0).stop 2024-04-25T10:27:52.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.380+0000 7f6d13200640 1 -- 172.21.15.19:0/364383727 shutdown_connections 2024-04-25T10:27:52.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.380+0000 7f6d13200640 1 --2- 172.21.15.19:0/364383727 >> v2:172.21.15.112:3300/0 conn(0x7f6d141566f0 0x7f6d14070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:52.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.380+0000 7f6d13200640 1 --2- 172.21.15.19:0/364383727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c9110 0x7f6d140710e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:52.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.380+0000 7f6d13200640 1 -- 172.21.15.19:0/364383727 >> 172.21.15.19:0/364383727 conn(0x7f6d140ce710 msgr2=0x7f6d140ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:52.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.380+0000 7f6d13200640 1 -- 172.21.15.19:0/364383727 shutdown_connections 2024-04-25T10:27:52.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.380+0000 7f6d13200640 1 -- 172.21.15.19:0/364383727 wait complete. 2024-04-25T10:27:52.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.383+0000 7f6d13200640 1 Processor -- start 2024-04-25T10:27:52.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.383+0000 7f6d13200640 1 -- start start 2024-04-25T10:27:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.384+0000 7f6d13200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c3730 0x7f6d141e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.384+0000 7f6d13200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d140c9110 0x7f6d1414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.384+0000 7f6d13200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d141566f0 0x7f6d141f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.384+0000 7f6d13200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1406c5c0 con 0x7f6d140c9110 2024-04-25T10:27:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.384+0000 7f6d13200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1406caf0 con 0x7f6d141566f0 2024-04-25T10:27:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.384+0000 7f6d13200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1406cdd0 con 0x7f6d140c3730 2024-04-25T10:27:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.385+0000 7f6d11e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c3730 0x7f6d141e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.385+0000 7f6d11e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c3730 0x7f6d141e7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:34810/0 (socket says 172.21.15.19:34810) 2024-04-25T10:27:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.385+0000 7f6d11e00640 1 -- 172.21.15.19:0/4002882716 learned_addr learned my addr 172.21.15.19:0/4002882716 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.385+0000 7f6d12800640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d141566f0 0x7f6d141f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.385+0000 7f6d11400640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d140c9110 0x7f6d1414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.385+0000 7f6d11e00640 1 -- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d141566f0 msgr2=0x7f6d141f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.385+0000 7f6d11e00640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d141566f0 0x7f6d141f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.385+0000 7f6d11e00640 1 -- 172.21.15.19:0/4002882716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d140c9110 msgr2=0x7f6d1414d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.385+0000 7f6d11e00640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d140c9110 0x7f6d1414d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.385+0000 7f6d11e00640 1 -- 172.21.15.19:0/4002882716 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d141e8270 con 0x7f6d140c3730 2024-04-25T10:27:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.386+0000 7f6d11e00640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c3730 0x7f6d141e7d30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6d04035040 tx=0x7f6d040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:52.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.386+0000 7f6d0a000640 1 -- 172.21.15.19:0/4002882716 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04041070 con 0x7f6d140c3730 2024-04-25T10:27:52.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.386+0000 7f6d0a000640 1 -- 172.21.15.19:0/4002882716 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0403c460 con 0x7f6d140c3730 2024-04-25T10:27:52.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.386+0000 7f6d0a000640 1 -- 172.21.15.19:0/4002882716 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04037040 con 0x7f6d140c3730 2024-04-25T10:27:52.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.386+0000 7f6d13200640 1 -- 172.21.15.19:0/4002882716 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d140cde50 con 0x7f6d140c3730 2024-04-25T10:27:52.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.386+0000 7f6d13200640 1 -- 172.21.15.19:0/4002882716 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1414e0f0 con 0x7f6d140c3730 2024-04-25T10:27:52.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.388+0000 7f6d13200640 1 -- 172.21.15.19:0/4002882716 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d141e8440 con 0x7f6d140c3730 2024-04-25T10:27:52.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.389+0000 7f6d0a000640 1 -- 172.21.15.19:0/4002882716 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6d0403a070 con 0x7f6d140c3730 2024-04-25T10:27:52.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.390+0000 7f6d0a000640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6cf40744e0 0x7f6cf40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:52.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.390+0000 7f6d0a000640 1 -- 172.21.15.19:0/4002882716 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f6d040b53e0 con 0x7f6d140c3730 2024-04-25T10:27:52.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.390+0000 7f6d11400640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6cf40744e0 0x7f6cf40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:52.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.391+0000 7f6d11400640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6cf40744e0 0x7f6cf40769f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6d1414c1f0 tx=0x7f6d00009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.395+0000 7f6d0a000640 1 -- 172.21.15.19:0/4002882716 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d0407f140 con 0x7f6d140c3730 2024-04-25T10:27:52.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.655+0000 7f6d13200640 1 -- 172.21.15.19:0/4002882716 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d14050740 con 0x7f6d140c3730 2024-04-25T10:27:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.656+0000 7f6d0a000640 1 -- 172.21.15.19:0/4002882716 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6050 (secure 0 0 0) 0x7f6d04083440 con 0x7f6d140c3730 2024-04-25T10:27:52.659 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:52.659 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:27:52.452408+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:reconnect","state_seq":38,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4288,4309]},"id":1}]} 2024-04-25T10:27:52.660 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 17 2024-04-25T10:27:52.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.659+0000 7f6d13200640 1 -- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6cf40744e0 msgr2=0x7f6cf40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:52.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.659+0000 7f6d13200640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6cf40744e0 0x7f6cf40769f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6d1414c1f0 tx=0x7f6d00009040 comp rx=0 tx=0).stop 2024-04-25T10:27:52.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.659+0000 7f6d13200640 1 -- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c3730 msgr2=0x7f6d141e7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:52.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.659+0000 7f6d13200640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c3730 0x7f6d141e7d30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6d04035040 tx=0x7f6d040046c0 comp rx=0 tx=0).stop 2024-04-25T10:27:52.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.659+0000 7f6d13200640 1 -- 172.21.15.19:0/4002882716 shutdown_connections 2024-04-25T10:27:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.659+0000 7f6d13200640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d141566f0 0x7f6d141f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.659+0000 7f6d13200640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d140c9110 0x7f6d1414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.659+0000 7f6d13200640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f6cf40744e0 0x7f6cf40769f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.659+0000 7f6d13200640 1 --2- 172.21.15.19:0/4002882716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d140c3730 0x7f6d141e7d30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.659+0000 7f6d13200640 1 -- 172.21.15.19:0/4002882716 >> 172.21.15.19:0/4002882716 conn(0x7f6d140ce710 msgr2=0x7f6d141551d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.660+0000 7f6d13200640 1 -- 172.21.15.19:0/4002882716 shutdown_connections 2024-04-25T10:27:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:52.660+0000 7f6d13200640 1 -- 172.21.15.19:0/4002882716 wait complete. 2024-04-25T10:27:52.691 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-25T10:27:54.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.950+0000 7f995a400640 1 Processor -- start 2024-04-25T10:27:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.950+0000 7f995a400640 1 -- start start 2024-04-25T10:27:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.953+0000 7f995a400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f99540b50e0 0x7f99541567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.953+0000 7f995a400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995415c5f0 con 0x7f99540b4090 2024-04-25T10:27:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.953+0000 7f995a400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995415c8d0 con 0x7f99540ccdc0 2024-04-25T10:27:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.953+0000 7f995a400640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f99540cd1d0 con 0x7f99540b50e0 2024-04-25T10:27:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.953+0000 7f9959000640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f99540b4090 0x7f99540b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56496/0 (socket says 172.21.15.19:56496) 2024-04-25T10:27:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.953+0000 7f9959000640 1 -- 172.21.15.19:0/1471167740 learned_addr learned my addr 172.21.15.19:0/1471167740 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.953+0000 7f9953e00640 1 --2- 172.21.15.19:0/1471167740 >> v2:172.21.15.19:3300/0 conn(0x7f99540b50e0 0x7f99541567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.954+0000 7f9953400640 1 -- 172.21.15.19:0/1471167740 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 381073318 0 0) 0x7f995415c5f0 con 0x7f99540b4090 2024-04-25T10:27:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.954+0000 7f9953400640 1 -- 172.21.15.19:0/1471167740 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f993c003520 con 0x7f99540b4090 2024-04-25T10:27:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.954+0000 7f9953e00640 1 -- 172.21.15.19:0/1471167740 >> v1:172.21.15.112:6789/0 conn(0x7f99540ccdc0 legacy=0x7f99540cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.954+0000 7f9953e00640 1 -- 172.21.15.19:0/1471167740 >> v1:172.21.15.19:6789/0 conn(0x7f99540b4090 legacy=0x7f99540b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.954+0000 7f9953e00640 1 -- 172.21.15.19:0/1471167740 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995415cbb0 con 0x7f99540b50e0 2024-04-25T10:27:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.955+0000 7f9953e00640 1 --2- 172.21.15.19:0/1471167740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99540b50e0 0x7f99541567a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f99400097a0 tx=0x7f994002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c70a1fbdb7325ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.956+0000 7f9953400640 1 -- 172.21.15.19:0/1471167740 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940037070 con 0x7f99540b50e0 2024-04-25T10:27:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.956+0000 7f9953400640 1 -- 172.21.15.19:0/1471167740 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9940032440 con 0x7f99540b50e0 2024-04-25T10:27:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.956+0000 7f9953400640 1 -- 172.21.15.19:0/1471167740 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99400327f0 con 0x7f99540b50e0 2024-04-25T10:27:54.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.956+0000 7f995a400640 1 -- 172.21.15.19:0/1471167740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99540b50e0 msgr2=0x7f99541567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:54.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.956+0000 7f995a400640 1 --2- 172.21.15.19:0/1471167740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99540b50e0 0x7f99541567a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f99400097a0 tx=0x7f994002a230 comp rx=0 tx=0).stop 2024-04-25T10:27:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.956+0000 7f995a400640 1 -- 172.21.15.19:0/1471167740 shutdown_connections 2024-04-25T10:27:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.956+0000 7f995a400640 1 --2- 172.21.15.19:0/1471167740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99540b50e0 0x7f99541567a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.956+0000 7f995a400640 1 -- 172.21.15.19:0/1471167740 >> 172.21.15.19:0/1471167740 conn(0x7f995408d940 msgr2=0x7f995408dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.957+0000 7f995a400640 1 -- 172.21.15.19:0/1471167740 shutdown_connections 2024-04-25T10:27:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.957+0000 7f995a400640 1 -- 172.21.15.19:0/1471167740 wait complete. 2024-04-25T10:27:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.960+0000 7f995a400640 1 Processor -- start 2024-04-25T10:27:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.960+0000 7f995a400640 1 -- start start 2024-04-25T10:27:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.963+0000 7f995a400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99540b4090 0x7f995415d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.963+0000 7f995a400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99540b50e0 0x7f9954151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.963+0000 7f995a400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99540ccdc0 0x7f99541e84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.963+0000 7f995a400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f99540b4cf0 con 0x7f99540ccdc0 2024-04-25T10:27:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.963+0000 7f995a400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f995415d170 con 0x7f99540b4090 2024-04-25T10:27:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.963+0000 7f995a400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f99540b4e70 con 0x7f99540b50e0 2024-04-25T10:27:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.963+0000 7f9959a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99540ccdc0 0x7f99541e84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.963+0000 7f9959000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99540b4090 0x7f995415d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.963+0000 7f9953e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99540b50e0 0x7f9954151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:54.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.963+0000 7f9959a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99540ccdc0 0x7f99541e84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48792/0 (socket says 172.21.15.19:48792) 2024-04-25T10:27:54.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.963+0000 7f9959a00640 1 -- 172.21.15.19:0/779041973 learned_addr learned my addr 172.21.15.19:0/779041973 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:54.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.964+0000 7f9959a00640 1 -- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99540b50e0 msgr2=0x7f9954151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.964+0000 7f9959a00640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99540b50e0 0x7f9954151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.964+0000 7f9959a00640 1 -- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99540b4090 msgr2=0x7f995415d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.964+0000 7f9959a00640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99540b4090 0x7f995415d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.964+0000 7f9959a00640 1 -- 172.21.15.19:0/779041973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99541f2980 con 0x7f99540ccdc0 2024-04-25T10:27:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.964+0000 7f9959000640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99540b4090 0x7f995415d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:27:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.964+0000 7f9959a00640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99540ccdc0 0x7f99541e84e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c6b0 tx=0x7f994c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.964+0000 7f9950c00640 1 -- 172.21.15.19:0/779041973 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c003b70 con 0x7f99540ccdc0 2024-04-25T10:27:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.964+0000 7f9950c00640 1 -- 172.21.15.19:0/779041973 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c003d30 con 0x7f99540ccdc0 2024-04-25T10:27:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.964+0000 7f9950c00640 1 -- 172.21.15.19:0/779041973 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c005310 con 0x7f99540ccdc0 2024-04-25T10:27:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.964+0000 7f995a400640 1 -- 172.21.15.19:0/779041973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995415df10 con 0x7f99540ccdc0 2024-04-25T10:27:54.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.965+0000 7f995a400640 1 -- 172.21.15.19:0/779041973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9954152410 con 0x7f99540ccdc0 2024-04-25T10:27:54.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.966+0000 7f995a400640 1 -- 172.21.15.19:0/779041973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9954050740 con 0x7f99540ccdc0 2024-04-25T10:27:54.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.967+0000 7f9950c00640 1 -- 172.21.15.19:0/779041973 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f994c0054b0 con 0x7f99540ccdc0 2024-04-25T10:27:54.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.968+0000 7f9950c00640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f99340744b0 0x7f99340769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.968+0000 7f9950c00640 1 -- 172.21.15.19:0/779041973 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f994c0952a0 con 0x7f99540ccdc0 2024-04-25T10:27:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.968+0000 7f9959000640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f99340744b0 0x7f99340769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:54.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.969+0000 7f9959000640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f99340744b0 0x7f99340769c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f99480011e0 tx=0x7f9948007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:54.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:54.973+0000 7f9950c00640 1 -- 172.21.15.19:0/779041973 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f994c05f0a0 con 0x7f99540ccdc0 2024-04-25T10:27:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.224+0000 7f995a400640 1 -- 172.21.15.19:0/779041973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99540b68e0 con 0x7f99540ccdc0 2024-04-25T10:27:55.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.226+0000 7f9950c00640 1 -- 172.21.15.19:0/779041973 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6050 (secure 0 0 0) 0x7f994c0633a0 con 0x7f99540ccdc0 2024-04-25T10:27:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:55.229 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:27:52.452408+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:reconnect","state_seq":38,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4288,4309]},"id":1}]} 2024-04-25T10:27:55.229 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 17 2024-04-25T10:27:55.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 -- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f99340744b0 msgr2=0x7f99340769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:55.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f99340744b0 0x7f99340769c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f99480011e0 tx=0x7f9948007d30 comp rx=0 tx=0).stop 2024-04-25T10:27:55.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 -- 172.21.15.19:0/779041973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99540ccdc0 msgr2=0x7f99541e84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:55.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99540ccdc0 0x7f99541e84e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c6b0 tx=0x7f994c00cb70 comp rx=0 tx=0).stop 2024-04-25T10:27:55.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 -- 172.21.15.19:0/779041973 shutdown_connections 2024-04-25T10:27:55.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99540ccdc0 0x7f99541e84e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:55.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f99340744b0 0x7f99340769c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:55.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99540b50e0 0x7f9954151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:55.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 --2- 172.21.15.19:0/779041973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99540b4090 0x7f995415d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:55.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 -- 172.21.15.19:0/779041973 >> 172.21.15.19:0/779041973 conn(0x7f995408d940 msgr2=0x7f99540b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:55.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 -- 172.21.15.19:0/779041973 shutdown_connections 2024-04-25T10:27:55.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:55.228+0000 7f995a400640 1 -- 172.21.15.19:0/779041973 wait complete. 2024-04-25T10:27:55.258 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-25T10:27:57.259 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:27:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.529+0000 7fd044a00640 1 Processor -- start 2024-04-25T10:27:57.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.529+0000 7fd044a00640 1 -- start start 2024-04-25T10:27:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.531+0000 7fd044a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd04015a370 0x7fd040070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.531+0000 7fd044a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd040073d20 0x7fd040154060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.531+0000 7fd044a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04015a8b0 con 0x7fd0400c7f90 2024-04-25T10:27:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.531+0000 7fd044a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd040072ea0 con 0x7fd04015a370 2024-04-25T10:27:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.531+0000 7fd044a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd040073180 con 0x7fd040073d20 2024-04-25T10:27:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.531+0000 7fd03fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd040073d20 0x7fd040154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.531+0000 7fd03f400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd04015a370 0x7fd040070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.531+0000 7fd036a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd0400c7f90 0x7fd040073610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56502/0 (socket says 172.21.15.19:56502) 2024-04-25T10:27:57.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.531+0000 7fd036a00640 1 -- 172.21.15.19:0/1720436391 learned_addr learned my addr 172.21.15.19:0/1720436391 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:27:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.532+0000 7fd03f400640 1 -- 172.21.15.19:0/1720436391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd040073d20 msgr2=0x7fd040154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:27:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.532+0000 7fd03f400640 1 --2- 172.21.15.19:0/1720436391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd040073d20 0x7fd040154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.532+0000 7fd03f400640 1 -- 172.21.15.19:0/1720436391 >> v1:172.21.15.19:6789/0 conn(0x7fd0400c7f90 legacy=0x7fd040073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.532+0000 7fd03ea00640 1 -- 172.21.15.19:0/1720436391 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1221370698 0 0) 0x7fd04015a8b0 con 0x7fd0400c7f90 2024-04-25T10:27:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.532+0000 7fd03f400640 1 -- 172.21.15.19:0/1720436391 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04015ab70 con 0x7fd04015a370 2024-04-25T10:27:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.532+0000 7fd03fe00640 1 --2- 172.21.15.19:0/1720436391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd040073d20 0x7fd040154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:27:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.533+0000 7fd03f400640 1 --2- 172.21.15.19:0/1720436391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd04015a370 0x7fd040070860 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd0300097a0 tx=0x7fd03002a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ab382b2d3c726d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.533+0000 7fd03ea00640 1 -- 172.21.15.19:0/1720436391 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030037070 con 0x7fd04015a370 2024-04-25T10:27:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.533+0000 7fd03ea00640 1 -- 172.21.15.19:0/1720436391 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd03002ae40 con 0x7fd04015a370 2024-04-25T10:27:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.533+0000 7fd03ea00640 1 -- 172.21.15.19:0/1720436391 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030032660 con 0x7fd04015a370 2024-04-25T10:27:57.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.534+0000 7fd044a00640 1 -- 172.21.15.19:0/1720436391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd04015a370 msgr2=0x7fd040070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:57.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.534+0000 7fd044a00640 1 --2- 172.21.15.19:0/1720436391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd04015a370 0x7fd040070860 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd0300097a0 tx=0x7fd03002a0f0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.534+0000 7fd044a00640 1 -- 172.21.15.19:0/1720436391 shutdown_connections 2024-04-25T10:27:57.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.534+0000 7fd044a00640 1 --2- 172.21.15.19:0/1720436391 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd040073d20 0x7fd040154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.534+0000 7fd044a00640 1 --2- 172.21.15.19:0/1720436391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd04015a370 0x7fd040070860 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.534+0000 7fd044a00640 1 -- 172.21.15.19:0/1720436391 >> 172.21.15.19:0/1720436391 conn(0x7fd0400cdbc0 msgr2=0x7fd0400ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:57.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.534+0000 7fd044a00640 1 -- 172.21.15.19:0/1720436391 shutdown_connections 2024-04-25T10:27:57.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.534+0000 7fd044a00640 1 -- 172.21.15.19:0/1720436391 wait complete. 2024-04-25T10:27:57.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.538+0000 7fd044a00640 1 Processor -- start 2024-04-25T10:27:57.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.538+0000 7fd044a00640 1 -- start start 2024-04-25T10:27:57.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.540+0000 7fd044a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0400c7f90 0x7fd0401f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd044a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd04015a370 0x7fd0400c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd044a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd0400af040 0x7fd04014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd044a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd0400c4b20 con 0x7fd0400c7f90 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd044a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd04015b130 con 0x7fd04015a370 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd044a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd040070da0 con 0x7fd0400af040 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd03f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0400c7f90 0x7fd0401f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd03f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0400c7f90 0x7fd0401f5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48796/0 (socket says 172.21.15.19:48796) 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd03f400640 1 -- 172.21.15.19:0/56703279 learned_addr learned my addr 172.21.15.19:0/56703279 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd03fe00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd0400af040 0x7fd04014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd036a00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd04015a370 0x7fd0400c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd03f400640 1 -- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd0400af040 msgr2=0x7fd04014cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd03f400640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd0400af040 0x7fd04014cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd03f400640 1 -- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd04015a370 msgr2=0x7fd0400c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:57.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd03f400640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd04015a370 0x7fd0400c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd03f400640 1 -- 172.21.15.19:0/56703279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0401f5e80 con 0x7fd0400c7f90 2024-04-25T10:27:57.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd03fe00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd0400af040 0x7fd04014cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:27:57.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.541+0000 7fd036a00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd04015a370 0x7fd0400c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:27:57.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.542+0000 7fd03f400640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0400c7f90 0x7fd0401f5940 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd0300098c0 tx=0x7fd0300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:57.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.542+0000 7fd037e00640 1 -- 172.21.15.19:0/56703279 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030037040 con 0x7fd0400c7f90 2024-04-25T10:27:57.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.542+0000 7fd037e00640 1 -- 172.21.15.19:0/56703279 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd030004030 con 0x7fd0400c7f90 2024-04-25T10:27:57.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.542+0000 7fd044a00640 1 -- 172.21.15.19:0/56703279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0400b1b30 con 0x7fd0400c7f90 2024-04-25T10:27:57.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.542+0000 7fd037e00640 1 -- 172.21.15.19:0/56703279 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030004400 con 0x7fd0400c7f90 2024-04-25T10:27:57.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.542+0000 7fd044a00640 1 -- 172.21.15.19:0/56703279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04014e610 con 0x7fd0400c7f90 2024-04-25T10:27:57.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.544+0000 7fd044a00640 1 -- 172.21.15.19:0/56703279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd040050740 con 0x7fd0400c7f90 2024-04-25T10:27:57.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.545+0000 7fd037e00640 1 -- 172.21.15.19:0/56703279 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd030003610 con 0x7fd0400c7f90 2024-04-25T10:27:57.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.546+0000 7fd037e00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd01c0744e0 0x7fd01c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:27:57.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.547+0000 7fd037e00640 1 -- 172.21.15.19:0/56703279 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7fd0300b5a30 con 0x7fd0400c7f90 2024-04-25T10:27:57.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.547+0000 7fd036a00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd01c0744e0 0x7fd01c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:27:57.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.547+0000 7fd036a00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd01c0744e0 0x7fd01c0769f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd0400c9e60 tx=0x7fd028007cc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:27:57.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.553+0000 7fd037e00640 1 -- 172.21.15.19:0/56703279 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd030042020 con 0x7fd0400c7f90 2024-04-25T10:27:57.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.801+0000 7fd044a00640 1 -- 172.21.15.19:0/56703279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd040151780 con 0x7fd0400c7f90 2024-04-25T10:27:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.801+0000 7fd037e00640 1 -- 172.21.15.19:0/56703279 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6047 (secure 0 0 0) 0x7fd03007fde0 con 0x7fd0400c7f90 2024-04-25T10:27:57.804 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:27:57.805 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:27:57.474996+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:rejoin","state_seq":40,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309,4288]},"id":1}]} 2024-04-25T10:27:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 18 2024-04-25T10:27:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 -- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd01c0744e0 msgr2=0x7fd01c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd01c0744e0 0x7fd01c0769f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd0400c9e60 tx=0x7fd028007cc0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 -- 172.21.15.19:0/56703279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0400c7f90 msgr2=0x7fd0401f5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:27:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0400c7f90 0x7fd0401f5940 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd0300098c0 tx=0x7fd0300046c0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 -- 172.21.15.19:0/56703279 shutdown_connections 2024-04-25T10:27:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fd01c0744e0 0x7fd01c0769f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd0400af040 0x7fd04014cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd04015a370 0x7fd0400c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 --2- 172.21.15.19:0/56703279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0400c7f90 0x7fd0401f5940 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:27:57.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 -- 172.21.15.19:0/56703279 >> 172.21.15.19:0/56703279 conn(0x7fd0400cdbc0 msgr2=0x7fd0401523d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:27:57.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 -- 172.21.15.19:0/56703279 shutdown_connections 2024-04-25T10:27:57.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:27:57.804+0000 7fd044a00640 1 -- 172.21.15.19:0/56703279 wait complete. 2024-04-25T10:27:57.833 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 18, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T10:25:36.724799+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 18, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4282": { "addr": "172.21.15.112:6835/3446267878", "addrs": { "addrvec": [ { "addr": "172.21.15.112:6834", "nonce": 3446267878, "type": "v2" }, { "addr": "172.21.15.112:6835", "nonce": 3446267878, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4282, "incarnation": 15, "join_fscid": -1, "name": "b", "rank": 2, "state": "up:rejoin", "state_seq": 40 }, "gid_4288": { "addr": "172.21.15.112:6839/3638094761", "addrs": { "addrvec": [ { "addr": "172.21.15.112:6838", "nonce": 3638094761, "type": "v2" }, { "addr": "172.21.15.112:6839", "nonce": 3638094761, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4288, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 12 }, "gid_4309": { "addr": "172.21.15.19:6835/1037719859", "addrs": { "addrvec": [ { "addr": "172.21.15.19:6834", "nonce": 1037719859, "type": "v2" }, { "addr": "172.21.15.19:6835", "nonce": 1037719859, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4309, "incarnation": 4, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 27, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T10:27:57.474996+0000", "qdb_cluster": [ 4309, 4288 ], "qdb_leader": 4309, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4309, "mds_1": 4288, "mds_2": 4282 } } } ], "standbys": [ { "addr": "172.21.15.19:6837/1773190450", "addrs": { "addrvec": [ { "addr": "172.21.15.19:6836", "nonce": 1773190450, "type": "v2" }, { "addr": "172.21.15.19:6837", "nonce": 1773190450, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4203, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.19:6833/2830282623", "addrs": { "addrvec": [ { "addr": "172.21.15.19:6832", "nonce": 2830282623, "type": "v2" }, { "addr": "172.21.15.19:6833", "nonce": 2830282623, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4250, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T10:27:59.834 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:28:00.088 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:28:00.098 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:28:00.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.113+0000 7f9cac400640 1 Processor -- start 2024-04-25T10:28:00.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.113+0000 7f9cac400640 1 -- start start 2024-04-25T10:28:00.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.115+0000 7f9cac400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ca40c9810 0x7f9ca4165e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:00.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.115+0000 7f9cac400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca4158010 con 0x7f9ca4073160 2024-04-25T10:28:00.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.115+0000 7f9cac400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca4074970 con 0x7f9ca415b2c0 2024-04-25T10:28:00.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.115+0000 7f9cac400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca40c8600 con 0x7f9ca40c9810 2024-04-25T10:28:00.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.115+0000 7f9caa400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ca40c9810 0x7f9ca4165e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:00.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.115+0000 7f9ca9a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9ca415b2c0 0x7f9ca415e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:42228/0 (socket says 172.21.15.19:42228) 2024-04-25T10:28:00.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.115+0000 7f9ca9a00640 1 -- 172.21.15.19:0/3485208019 learned_addr learned my addr 172.21.15.19:0/3485208019 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.115+0000 7f9caa400640 1 -- 172.21.15.19:0/3485208019 >> v1:172.21.15.112:6789/0 conn(0x7f9ca415b2c0 legacy=0x7f9ca415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.116+0000 7f9caa400640 1 -- 172.21.15.19:0/3485208019 >> v1:172.21.15.19:6789/0 conn(0x7f9ca4073160 legacy=0x7f9ca40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.116+0000 7f9ca3e00640 1 -- 172.21.15.19:0/3485208019 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280477261 0 0) 0x7f9ca4074970 con 0x7f9ca415b2c0 2024-04-25T10:28:00.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.116+0000 7f9caa400640 1 -- 172.21.15.19:0/3485208019 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca40c88e0 con 0x7f9ca40c9810 2024-04-25T10:28:00.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.117+0000 7f9caa400640 1 --2- 172.21.15.19:0/3485208019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ca40c9810 0x7f9ca4165e30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009d90 tx=0x7f9c9c02a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e244d9b0234fb71b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:00.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.117+0000 7f9ca3e00640 1 -- 172.21.15.19:0/3485208019 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c037070 con 0x7f9ca40c9810 2024-04-25T10:28:00.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.117+0000 7f9ca3e00640 1 -- 172.21.15.19:0/3485208019 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c9c007740 con 0x7f9ca40c9810 2024-04-25T10:28:00.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.117+0000 7f9ca3e00640 1 -- 172.21.15.19:0/3485208019 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c007b10 con 0x7f9ca40c9810 2024-04-25T10:28:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.118+0000 7f9cac400640 1 -- 172.21.15.19:0/3485208019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ca40c9810 msgr2=0x7f9ca4165e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.118+0000 7f9cac400640 1 --2- 172.21.15.19:0/3485208019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ca40c9810 0x7f9ca4165e30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009d90 tx=0x7f9c9c02a780 comp rx=0 tx=0).stop 2024-04-25T10:28:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.118+0000 7f9cac400640 1 -- 172.21.15.19:0/3485208019 shutdown_connections 2024-04-25T10:28:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.118+0000 7f9cac400640 1 --2- 172.21.15.19:0/3485208019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ca40c9810 0x7f9ca4165e30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.118+0000 7f9cac400640 1 -- 172.21.15.19:0/3485208019 >> 172.21.15.19:0/3485208019 conn(0x7f9ca406f1f0 msgr2=0x7f9ca406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.118+0000 7f9cac400640 1 -- 172.21.15.19:0/3485208019 shutdown_connections 2024-04-25T10:28:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.118+0000 7f9cac400640 1 -- 172.21.15.19:0/3485208019 wait complete. 2024-04-25T10:28:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.120+0000 7f9cac400640 1 Processor -- start 2024-04-25T10:28:00.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.121+0000 7f9cac400640 1 -- start start 2024-04-25T10:28:00.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9cac400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca4073160 0x7f9ca41efe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:00.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9cac400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ca40c9810 0x7f9ca41f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:00.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9cac400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ca40cca20 0x7f9ca414f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:00.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9cac400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca406d4c0 con 0x7f9ca4073160 2024-04-25T10:28:00.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9cac400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca415a580 con 0x7f9ca40cca20 2024-04-25T10:28:00.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9cac400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca415e930 con 0x7f9ca40c9810 2024-04-25T10:28:00.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9ca9a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca4073160 0x7f9ca41efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:00.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9ca9000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ca40c9810 0x7f9ca41f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:00.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9caa400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ca40cca20 0x7f9ca414f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:00.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9caa400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ca40cca20 0x7f9ca414f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:54942/0 (socket says 172.21.15.19:54942) 2024-04-25T10:28:00.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9ca9a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca4073160 0x7f9ca41efe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55886/0 (socket says 172.21.15.19:55886) 2024-04-25T10:28:00.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.122+0000 7f9caa400640 1 -- 172.21.15.19:0/4205417297 learned_addr learned my addr 172.21.15.19:0/4205417297 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.123+0000 7f9caa400640 1 -- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ca40c9810 msgr2=0x7f9ca41f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.123+0000 7f9caa400640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ca40c9810 0x7f9ca41f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.123+0000 7f9caa400640 1 -- 172.21.15.19:0/4205417297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca4073160 msgr2=0x7f9ca41efe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.123+0000 7f9caa400640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca4073160 0x7f9ca41efe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.123+0000 7f9caa400640 1 -- 172.21.15.19:0/4205417297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca41f2c00 con 0x7f9ca40cca20 2024-04-25T10:28:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.123+0000 7f9ca9000640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ca40c9810 0x7f9ca41f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:00.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.123+0000 7f9ca9a00640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca4073160 0x7f9ca41efe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.123+0000 7f9caa400640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ca40cca20 0x7f9ca414f090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009d90 tx=0x7f9c9c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.124+0000 7f9ca1600640 1 -- 172.21.15.19:0/4205417297 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c042020 con 0x7f9ca40cca20 2024-04-25T10:28:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.124+0000 7f9ca1600640 1 -- 172.21.15.19:0/4205417297 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c9c032990 con 0x7f9ca40cca20 2024-04-25T10:28:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.124+0000 7f9ca1600640 1 -- 172.21.15.19:0/4205417297 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c037040 con 0x7f9ca40cca20 2024-04-25T10:28:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.124+0000 7f9cac400640 1 -- 172.21.15.19:0/4205417297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca41f1380 con 0x7f9ca40cca20 2024-04-25T10:28:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.124+0000 7f9cac400640 1 -- 172.21.15.19:0/4205417297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca41f1900 con 0x7f9ca40cca20 2024-04-25T10:28:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.125+0000 7f9cac400640 1 -- 172.21.15.19:0/4205417297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca4076520 con 0x7f9ca40cca20 2024-04-25T10:28:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.128+0000 7f9ca1600640 1 -- 172.21.15.19:0/4205417297 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9c9c045020 con 0x7f9ca40cca20 2024-04-25T10:28:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.129+0000 7f9ca1600640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c840744e0 0x7f9c840769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.129+0000 7f9ca1600640 1 -- 172.21.15.19:0/4205417297 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f9c9c0b6490 con 0x7f9ca40cca20 2024-04-25T10:28:00.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.129+0000 7f9ca9a00640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c840744e0 0x7f9c840769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:00.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.130+0000 7f9ca9a00640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c840744e0 0x7f9c840769f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9c98000f60 tx=0x7f9c98007e40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:00.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.134+0000 7f9ca1600640 1 -- 172.21.15.19:0/4205417297 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c9c04c070 con 0x7f9ca40cca20 2024-04-25T10:28:00.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.390+0000 7f9cac400640 1 -- 172.21.15.19:0/4205417297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ca4156980 con 0x7f9ca40cca20 2024-04-25T10:28:00.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.391+0000 7f9ca1600640 1 -- 172.21.15.19:0/4205417297 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6047 (secure 0 0 0) 0x7f9c9c0802c0 con 0x7f9ca40cca20 2024-04-25T10:28:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:28:00.394 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:27:57.474996+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:rejoin","state_seq":40,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309,4288]},"id":1}]} 2024-04-25T10:28:00.394 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 18 2024-04-25T10:28:00.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 -- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c840744e0 msgr2=0x7f9c840769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:00.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c840744e0 0x7f9c840769f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9c98000f60 tx=0x7f9c98007e40 comp rx=0 tx=0).stop 2024-04-25T10:28:00.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 -- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ca40cca20 msgr2=0x7f9ca414f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:00.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ca40cca20 0x7f9ca414f090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009d90 tx=0x7f9c9c004a40 comp rx=0 tx=0).stop 2024-04-25T10:28:00.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 -- 172.21.15.19:0/4205417297 shutdown_connections 2024-04-25T10:28:00.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ca40cca20 0x7f9ca414f090 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:00.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9c840744e0 0x7f9c840769f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:00.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ca40c9810 0x7f9ca41f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:00.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 --2- 172.21.15.19:0/4205417297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca4073160 0x7f9ca41efe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:00.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 -- 172.21.15.19:0/4205417297 >> 172.21.15.19:0/4205417297 conn(0x7f9ca406f1f0 msgr2=0x7f9ca406ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:00.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 -- 172.21.15.19:0/4205417297 shutdown_connections 2024-04-25T10:28:00.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:00.394+0000 7f9cac400640 1 -- 172.21.15.19:0/4205417297 wait complete. 2024-04-25T10:28:00.424 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-25T10:28:02.425 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:28:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.696+0000 7f3278e00640 1 Processor -- start 2024-04-25T10:28:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.696+0000 7f3278e00640 1 -- start start 2024-04-25T10:28:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.698+0000 7f3278e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f32740b4090 0x7f32740b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.699+0000 7f3278e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f327415c5f0 con 0x7f32741567a0 2024-04-25T10:28:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.699+0000 7f3278e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f327415c8d0 con 0x7f32740ccdc0 2024-04-25T10:28:02.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.699+0000 7f3278e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f32740cd1d0 con 0x7f32740b4090 2024-04-25T10:28:02.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.699+0000 7f3273400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f32740b4090 0x7f32740b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:02.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.699+0000 7f3273400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f32740b4090 0x7f32740b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55888/0 (socket says 172.21.15.19:55888) 2024-04-25T10:28:02.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.699+0000 7f3273400640 1 -- 172.21.15.19:0/587120861 learned_addr learned my addr 172.21.15.19:0/587120861 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:02.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.699+0000 7f326aa00640 1 --1- 172.21.15.19:0/587120861 >> v1:172.21.15.19:6789/0 conn(0x7f32741567a0 0x7f32740b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39894/0 (socket says 172.21.15.19:39894) 2024-04-25T10:28:02.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.700+0000 7f3273400640 1 -- 172.21.15.19:0/587120861 >> v1:172.21.15.112:6789/0 conn(0x7f32740ccdc0 legacy=0x7f32740cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:02.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.700+0000 7f3273400640 1 -- 172.21.15.19:0/587120861 >> v1:172.21.15.19:6789/0 conn(0x7f32741567a0 legacy=0x7f32740b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.700+0000 7f3273400640 1 -- 172.21.15.19:0/587120861 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327415cbb0 con 0x7f32740b4090 2024-04-25T10:28:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.700+0000 7f3272a00640 1 -- 172.21.15.19:0/587120861 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859182541 0 0) 0x7f327415c5f0 con 0x7f32741567a0 2024-04-25T10:28:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.701+0000 7f3273400640 1 --2- 172.21.15.19:0/587120861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32740b4090 0x7f32740b50e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3264009870 tx=0x7f326402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4ab9bd0aa8258d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.701+0000 7f3272a00640 1 -- 172.21.15.19:0/587120861 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264037070 con 0x7f32740b4090 2024-04-25T10:28:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.701+0000 7f3272a00640 1 -- 172.21.15.19:0/587120861 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326402ae50 con 0x7f32740b4090 2024-04-25T10:28:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.701+0000 7f3272a00640 1 -- 172.21.15.19:0/587120861 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264032860 con 0x7f32740b4090 2024-04-25T10:28:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.702+0000 7f3278e00640 1 -- 172.21.15.19:0/587120861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32740b4090 msgr2=0x7f32740b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.702+0000 7f3278e00640 1 --2- 172.21.15.19:0/587120861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32740b4090 0x7f32740b50e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3264009870 tx=0x7f326402a300 comp rx=0 tx=0).stop 2024-04-25T10:28:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.702+0000 7f3278e00640 1 -- 172.21.15.19:0/587120861 shutdown_connections 2024-04-25T10:28:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.702+0000 7f3278e00640 1 --2- 172.21.15.19:0/587120861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32740b4090 0x7f32740b50e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.702+0000 7f3278e00640 1 -- 172.21.15.19:0/587120861 >> 172.21.15.19:0/587120861 conn(0x7f327408d940 msgr2=0x7f327408dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.702+0000 7f3278e00640 1 -- 172.21.15.19:0/587120861 shutdown_connections 2024-04-25T10:28:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.702+0000 7f3278e00640 1 -- 172.21.15.19:0/587120861 wait complete. 2024-04-25T10:28:02.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.704+0000 7f3278e00640 1 Processor -- start 2024-04-25T10:28:02.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.705+0000 7f3278e00640 1 -- start start 2024-04-25T10:28:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.706+0000 7f3278e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32740b4090 0x7f32741e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.706+0000 7f3278e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32740ccdc0 0x7f32741e5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.706+0000 7f3278e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32741567a0 0x7f32741f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.706+0000 7f3278e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f32740b4cf0 con 0x7f32741567a0 2024-04-25T10:28:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.706+0000 7f3278e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f327415d170 con 0x7f32740b4090 2024-04-25T10:28:02.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.706+0000 7f3278e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f32740b4e70 con 0x7f32740ccdc0 2024-04-25T10:28:02.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f326aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32740ccdc0 0x7f32741e5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:02.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f3273400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32740b4090 0x7f32741e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:02.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f3273400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32740b4090 0x7f32741e72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:54946/0 (socket says 172.21.15.19:54946) 2024-04-25T10:28:02.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f3273400640 1 -- 172.21.15.19:0/2311744094 learned_addr learned my addr 172.21.15.19:0/2311744094 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:02.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f326aa00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32740ccdc0 0x7f32741e5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:44688/0 (socket says 172.21.15.19:44688) 2024-04-25T10:28:02.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f3273e00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32741567a0 0x7f32741f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:02.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f326aa00640 1 -- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32740b4090 msgr2=0x7f32741e72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:02.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f326aa00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32740b4090 0x7f32741e72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:02.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f326aa00640 1 -- 172.21.15.19:0/2311744094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32741567a0 msgr2=0x7f32741f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:02.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f326aa00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32741567a0 0x7f32741f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:02.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f326aa00640 1 -- 172.21.15.19:0/2311744094 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32741e6380 con 0x7f32740ccdc0 2024-04-25T10:28:02.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.707+0000 7f3273400640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32740b4090 0x7f32741e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:02.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.708+0000 7f326aa00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32740ccdc0 0x7f32741e5e40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c3e0 tx=0x7f325c00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:02.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.710+0000 7f326be00640 1 -- 172.21.15.19:0/2311744094 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c0074e0 con 0x7f32740ccdc0 2024-04-25T10:28:02.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.711+0000 7f326be00640 1 -- 172.21.15.19:0/2311744094 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325c0047e0 con 0x7f32740ccdc0 2024-04-25T10:28:02.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.711+0000 7f326be00640 1 -- 172.21.15.19:0/2311744094 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c004bd0 con 0x7f32740ccdc0 2024-04-25T10:28:02.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.711+0000 7f3278e00640 1 -- 172.21.15.19:0/2311744094 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32741e6590 con 0x7f32740ccdc0 2024-04-25T10:28:02.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.711+0000 7f3278e00640 1 -- 172.21.15.19:0/2311744094 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32740cab90 con 0x7f32740ccdc0 2024-04-25T10:28:02.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.712+0000 7f3278e00640 1 -- 172.21.15.19:0/2311744094 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3274050740 con 0x7f32740ccdc0 2024-04-25T10:28:02.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.714+0000 7f326be00640 1 -- 172.21.15.19:0/2311744094 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f325c011070 con 0x7f32740ccdc0 2024-04-25T10:28:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.715+0000 7f326be00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32500744e0 0x7f32500769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.715+0000 7f326be00640 1 -- 172.21.15.19:0/2311744094 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f325c094f70 con 0x7f32740ccdc0 2024-04-25T10:28:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.715+0000 7f3273400640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32500744e0 0x7f32500769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.716+0000 7f3273400640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32500744e0 0x7f32500769f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f32640090b0 tx=0x7f326402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:02.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.721+0000 7f326be00640 1 -- 172.21.15.19:0/2311744094 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f325c05ed60 con 0x7f32740ccdc0 2024-04-25T10:28:02.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.988+0000 7f3278e00640 1 -- 172.21.15.19:0/2311744094 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32740b68e0 con 0x7f32740ccdc0 2024-04-25T10:28:02.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.989+0000 7f326be00640 1 -- 172.21.15.19:0/2311744094 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6052 (secure 0 0 0) 0x7f325c063060 con 0x7f32740ccdc0 2024-04-25T10:28:02.992 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:28:02.992 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:28:02.709081+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":42,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4282,4288,4309]},"id":1}]} 2024-04-25T10:28:02.992 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 19 2024-04-25T10:28:02.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.992+0000 7f3278e00640 1 -- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32500744e0 msgr2=0x7f32500769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:02.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.992+0000 7f3278e00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32500744e0 0x7f32500769f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f32640090b0 tx=0x7f326402e000 comp rx=0 tx=0).stop 2024-04-25T10:28:02.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.992+0000 7f3278e00640 1 -- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32740ccdc0 msgr2=0x7f32741e5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:02.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.992+0000 7f3278e00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32740ccdc0 0x7f32741e5e40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c3e0 tx=0x7f325c00c8a0 comp rx=0 tx=0).stop 2024-04-25T10:28:02.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.992+0000 7f3278e00640 1 -- 172.21.15.19:0/2311744094 shutdown_connections 2024-04-25T10:28:02.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.992+0000 7f3278e00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32741567a0 0x7f32741f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:02.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.992+0000 7f3278e00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f32500744e0 0x7f32500769f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:02.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.992+0000 7f3278e00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32740ccdc0 0x7f32741e5e40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:02.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.992+0000 7f3278e00640 1 --2- 172.21.15.19:0/2311744094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32740b4090 0x7f32741e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:02.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.992+0000 7f3278e00640 1 -- 172.21.15.19:0/2311744094 >> 172.21.15.19:0/2311744094 conn(0x7f327408d940 msgr2=0x7f3274075af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:02.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.993+0000 7f3278e00640 1 -- 172.21.15.19:0/2311744094 shutdown_connections 2024-04-25T10:28:02.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:02.993+0000 7f3278e00640 1 -- 172.21.15.19:0/2311744094 wait complete. 2024-04-25T10:28:03.020 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b has gained rank=2, replacing gid=4285 2024-04-25T10:28:03.020 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 4 secs before reviving mds.d 2024-04-25T10:28:07.021 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.d 2024-04-25T10:28:07.021 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:28:07.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:28:07.025 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:28:07.025 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:28:07.120 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2024-04-25T10:28:07.138 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-04-25T10:28:07.136+0000 7fb28c600640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-25T10:28:07.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.377+0000 7f66e4c00640 1 Processor -- start 2024-04-25T10:28:07.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.377+0000 7f66e4c00640 1 -- start start 2024-04-25T10:28:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.379+0000 7f66e4c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f66e0153200 0x7f66e0167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.379+0000 7f66e4c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e006d900 con 0x7f66e006d410 2024-04-25T10:28:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.379+0000 7f66e4c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e00ca350 con 0x7f66e00c36c0 2024-04-25T10:28:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.379+0000 7f66e4c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f66e006daf0 con 0x7f66e0153200 2024-04-25T10:28:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.379+0000 7f66dfe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f66e0153200 0x7f66e0167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.379+0000 7f66dfe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f66e0153200 0x7f66e0167dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:54958/0 (socket says 172.21.15.19:54958) 2024-04-25T10:28:07.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.379+0000 7f66dfe00640 1 -- 172.21.15.19:0/715392333 learned_addr learned my addr 172.21.15.19:0/715392333 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:07.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.380+0000 7f66dfe00640 1 -- 172.21.15.19:0/715392333 >> v1:172.21.15.112:6789/0 conn(0x7f66e00c36c0 legacy=0x7f66e006fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:07.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.380+0000 7f66dfe00640 1 -- 172.21.15.19:0/715392333 >> v1:172.21.15.19:6789/0 conn(0x7f66e006d410 legacy=0x7f66e015c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:07.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.380+0000 7f66dfe00640 1 -- 172.21.15.19:0/715392333 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e00ca630 con 0x7f66e0153200 2024-04-25T10:28:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.381+0000 7f66dfe00640 1 --2- 172.21.15.19:0/715392333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e0153200 0x7f66e0167dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009e50 tx=0x7f66d802a7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbb6045d66dbe943 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.382+0000 7f66de000640 1 -- 172.21.15.19:0/715392333 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8036070 con 0x7f66e0153200 2024-04-25T10:28:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.382+0000 7f66de000640 1 -- 172.21.15.19:0/715392333 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d8031600 con 0x7f66e0153200 2024-04-25T10:28:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.382+0000 7f66de000640 1 -- 172.21.15.19:0/715392333 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d80319d0 con 0x7f66e0153200 2024-04-25T10:28:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.382+0000 7f66e4c00640 1 -- 172.21.15.19:0/715392333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e0153200 msgr2=0x7f66e0167dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.382+0000 7f66e4c00640 1 --2- 172.21.15.19:0/715392333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e0153200 0x7f66e0167dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009e50 tx=0x7f66d802a7b0 comp rx=0 tx=0).stop 2024-04-25T10:28:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.382+0000 7f66e4c00640 1 -- 172.21.15.19:0/715392333 shutdown_connections 2024-04-25T10:28:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.382+0000 7f66e4c00640 1 --2- 172.21.15.19:0/715392333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e0153200 0x7f66e0167dd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.382+0000 7f66e4c00640 1 -- 172.21.15.19:0/715392333 >> 172.21.15.19:0/715392333 conn(0x7f66e00cb1a0 msgr2=0x7f66e00cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.383+0000 7f66e4c00640 1 -- 172.21.15.19:0/715392333 shutdown_connections 2024-04-25T10:28:07.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.383+0000 7f66e4c00640 1 -- 172.21.15.19:0/715392333 wait complete. 2024-04-25T10:28:07.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.385+0000 7f66e4c00640 1 Processor -- start 2024-04-25T10:28:07.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.385+0000 7f66e4c00640 1 -- start start 2024-04-25T10:28:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66e4c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e006d410 0x7f66e015f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66e4c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e00c36c0 0x7f66e00c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66e4c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66e0153200 0x7f66e0156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66e4c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f66e0153610 con 0x7f66e00c36c0 2024-04-25T10:28:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66e4c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f66e006e0b0 con 0x7f66e006d410 2024-04-25T10:28:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66e4c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f66e00caa70 con 0x7f66e0153200 2024-04-25T10:28:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66df400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e006d410 0x7f66e015f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:07.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66dea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e00c36c0 0x7f66e00c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:07.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66dea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e00c36c0 0x7f66e00c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55898/0 (socket says 172.21.15.19:55898) 2024-04-25T10:28:07.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66df400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e006d410 0x7f66e015f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:54964/0 (socket says 172.21.15.19:54964) 2024-04-25T10:28:07.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66dea00640 1 -- 172.21.15.19:0/4258640997 learned_addr learned my addr 172.21.15.19:0/4258640997 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:07.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.387+0000 7f66dfe00640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66e0153200 0x7f66e0156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:07.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.388+0000 7f66dfe00640 1 -- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e006d410 msgr2=0x7f66e015f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:07.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.388+0000 7f66dfe00640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e006d410 0x7f66e015f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:07.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.388+0000 7f66dfe00640 1 -- 172.21.15.19:0/4258640997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e00c36c0 msgr2=0x7f66e00c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:07.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.388+0000 7f66dfe00640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e00c36c0 0x7f66e00c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:07.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.388+0000 7f66dfe00640 1 -- 172.21.15.19:0/4258640997 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e01f2730 con 0x7f66e0153200 2024-04-25T10:28:07.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.388+0000 7f66dea00640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e00c36c0 0x7f66e00c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:07.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.389+0000 7f66dfe00640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66e0153200 0x7f66e0156340 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f66d802afd0 tx=0x7f66d8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:07.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.389+0000 7f66d7400640 1 -- 172.21.15.19:0/4258640997 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8036040 con 0x7f66e0153200 2024-04-25T10:28:07.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.389+0000 7f66e4c00640 1 -- 172.21.15.19:0/4258640997 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e015fc20 con 0x7f66e0153200 2024-04-25T10:28:07.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.389+0000 7f66e4c00640 1 -- 172.21.15.19:0/4258640997 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e01f2cd0 con 0x7f66e0153200 2024-04-25T10:28:07.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.389+0000 7f66d7400640 1 -- 172.21.15.19:0/4258640997 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d80077a0 con 0x7f66e0153200 2024-04-25T10:28:07.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.389+0000 7f66d7400640 1 -- 172.21.15.19:0/4258640997 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8009510 con 0x7f66e0153200 2024-04-25T10:28:07.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.391+0000 7f66d4c00640 1 -- 172.21.15.19:0/4258640997 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e00c4ff0 con 0x7f66e0153200 2024-04-25T10:28:07.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.392+0000 7f66d7400640 1 -- 172.21.15.19:0/4258640997 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f66d8007b70 con 0x7f66e0153200 2024-04-25T10:28:07.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.393+0000 7f66d7400640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66c00744e0 0x7f66c00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:07.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.393+0000 7f66d7400640 1 -- 172.21.15.19:0/4258640997 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f66d80b5e50 con 0x7f66e0153200 2024-04-25T10:28:07.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.394+0000 7f66df400640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66c00744e0 0x7f66c00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:07.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.395+0000 7f66df400640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66c00744e0 0x7f66c00769f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f66d00016e0 tx=0x7f66d0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:07.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.398+0000 7f66d7400640 1 -- 172.21.15.19:0/4258640997 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f66d807fbb0 con 0x7f66e0153200 2024-04-25T10:28:07.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.772+0000 7f66d4c00640 1 -- 172.21.15.19:0/4258640997 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66e0050740 con 0x7f66e0153200 2024-04-25T10:28:07.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.773+0000 7f66d7400640 1 -- 172.21.15.19:0/4258640997 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6877 (secure 0 0 0) 0x7f66d80881f0 con 0x7f66e0153200 2024-04-25T10:28:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:28:07.776 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/103564411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":103564411},{"type":"v1","addr":"172.21.15.112:6837","nonce":103564411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:28:02.709081+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":42,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309,4288,4282]},"id":1}]} 2024-04-25T10:28:07.776 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 20 2024-04-25T10:28:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.776+0000 7f66d4c00640 1 -- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66c00744e0 msgr2=0x7f66c00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.776+0000 7f66d4c00640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66c00744e0 0x7f66c00769f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f66d00016e0 tx=0x7f66d0009040 comp rx=0 tx=0).stop 2024-04-25T10:28:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.776+0000 7f66d4c00640 1 -- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66e0153200 msgr2=0x7f66e0156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.776+0000 7f66d4c00640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66e0153200 0x7f66e0156340 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f66d802afd0 tx=0x7f66d8004a40 comp rx=0 tx=0).stop 2024-04-25T10:28:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.776+0000 7f66d4c00640 1 -- 172.21.15.19:0/4258640997 shutdown_connections 2024-04-25T10:28:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.776+0000 7f66d4c00640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f66c00744e0 0x7f66c00769f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.776+0000 7f66d4c00640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66e0153200 0x7f66e0156340 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.776+0000 7f66d4c00640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e00c36c0 0x7f66e00c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.776+0000 7f66d4c00640 1 --2- 172.21.15.19:0/4258640997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66e006d410 0x7f66e015f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.776+0000 7f66d4c00640 1 -- 172.21.15.19:0/4258640997 >> 172.21.15.19:0/4258640997 conn(0x7f66e00cb1a0 msgr2=0x7f66e00cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.776+0000 7f66d4c00640 1 -- 172.21.15.19:0/4258640997 shutdown_connections 2024-04-25T10:28:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:07.777+0000 7f66d4c00640 1 -- 172.21.15.19:0/4258640997 wait complete. 2024-04-25T10:28:07.814 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d reported in up:standby state 2024-04-25T10:28:07.814 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 107 secs before thrashing 2024-04-25T10:28:30.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:28:30.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:28:40.814 INFO:tasks.workunit.client.0.smithi019.stderr:Updating files: 60% (7438/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 99% (12256/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-25T10:28:41.842 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T10:28:41.842 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-04-25T10:28:41.842 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-04-25T10:28:41.843 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T10:28:41.857 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T10:28:41.915 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T10:28:41.922 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T10:28:41.923 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T10:28:42.697 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T10:28:42.811 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T10:28:42.900 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T10:28:42.906 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T10:28:42.906 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T10:28:42.993 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T10:28:43.003 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:28:43.003 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T10:28:43.054 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-04-25T10:28:43.056 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-04-25T10:28:43.056 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-04-25T10:28:45.076 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T10:28:45.076 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T10:28:45.198 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-04-25T10:28:45.198 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T10:28:46.289 DEBUG:teuthology.parallel:result is None 2024-04-25T10:28:46.290 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T10:28:46.385 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T10:28:46.386 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-04-25T10:28:46.396 INFO:tasks.mds_thrash:joining mds_thrasher 2024-04-25T10:28:46.396 INFO:tasks.mds_thrash.fs.[cephfs]:stat['max_mds'] = 0 2024-04-25T10:28:46.396 INFO:tasks.mds_thrash.fs.[cephfs]:stat['deactivate'] = 0 2024-04-25T10:28:46.396 INFO:tasks.mds_thrash.fs.[cephfs]:stat['kill'] = 1 2024-04-25T10:28:46.396 INFO:tasks.mds_thrash:done joining 2024-04-25T10:28:46.397 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T10:28:46.421 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T10:28:46.421 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:28:46.421 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:28:46.479 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-04-25T10:28:46.480 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:28:46.534 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:28:46.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.813+0000 7fa52a800640 1 Processor -- start 2024-04-25T10:28:46.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.813+0000 7fa52a800640 1 -- start start 2024-04-25T10:28:46.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.815+0000 7fa52a800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5240c4930 0x7fa5241534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:46.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.815+0000 7fa52a800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa524159b80 0x7fa524159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:46.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.815+0000 7fa52a800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5240b07c0 con 0x7fa5240742c0 2024-04-25T10:28:46.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.815+0000 7fa52a800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fa5241596f0 con 0x7fa524159b80 2024-04-25T10:28:46.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.815+0000 7fa52a800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa5240b2600 con 0x7fa5240c4930 2024-04-25T10:28:46.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.815+0000 7fa51be00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa524159b80 0x7fa524159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:46.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.815+0000 7fa523400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5240c4930 0x7fa5241534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:46.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.815+0000 7fa51be00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa524159b80 0x7fa524159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39740/0 (socket says 172.21.15.19:39740) 2024-04-25T10:28:46.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.815+0000 7fa51be00640 1 -- 172.21.15.19:0/1493345269 learned_addr learned my addr 172.21.15.19:0/1493345269 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:46.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.816+0000 7fa523400640 1 -- 172.21.15.19:0/1493345269 >> v2:172.21.15.19:3300/0 conn(0x7fa524159b80 msgr2=0x7fa524159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:46.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.816+0000 7fa523400640 1 --2- 172.21.15.19:0/1493345269 >> v2:172.21.15.19:3300/0 conn(0x7fa524159b80 0x7fa524159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:46.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.816+0000 7fa523400640 1 -- 172.21.15.19:0/1493345269 >> v1:172.21.15.19:6789/0 conn(0x7fa5240742c0 legacy=0x7fa5240c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:46.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.816+0000 7fa523400640 1 -- 172.21.15.19:0/1493345269 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5240b28e0 con 0x7fa5240c4930 2024-04-25T10:28:46.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.817+0000 7fa523400640 1 --2- 172.21.15.19:0/1493345269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240c4930 0x7fa5241534f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa524073220 tx=0x7fa51402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef1f605dad657af1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:46.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.817+0000 7fa522a00640 1 -- 172.21.15.19:0/1493345269 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514037070 con 0x7fa5240c4930 2024-04-25T10:28:46.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.817+0000 7fa522a00640 1 -- 172.21.15.19:0/1493345269 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa514032440 con 0x7fa5240c4930 2024-04-25T10:28:46.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.817+0000 7fa522a00640 1 -- 172.21.15.19:0/1493345269 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514032810 con 0x7fa5240c4930 2024-04-25T10:28:46.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.818+0000 7fa52a800640 1 -- 172.21.15.19:0/1493345269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240c4930 msgr2=0x7fa5241534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:46.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.818+0000 7fa52a800640 1 --2- 172.21.15.19:0/1493345269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240c4930 0x7fa5241534f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa524073220 tx=0x7fa51402a1a0 comp rx=0 tx=0).stop 2024-04-25T10:28:46.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.818+0000 7fa52a800640 1 -- 172.21.15.19:0/1493345269 shutdown_connections 2024-04-25T10:28:46.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.818+0000 7fa52a800640 1 --2- 172.21.15.19:0/1493345269 >> v2:172.21.15.19:3300/0 conn(0x7fa524159b80 0x7fa524159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:46.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.818+0000 7fa52a800640 1 --2- 172.21.15.19:0/1493345269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240c4930 0x7fa5241534f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:46.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.818+0000 7fa52a800640 1 -- 172.21.15.19:0/1493345269 >> 172.21.15.19:0/1493345269 conn(0x7fa52406f1f0 msgr2=0x7fa52406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:46.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.818+0000 7fa52a800640 1 -- 172.21.15.19:0/1493345269 shutdown_connections 2024-04-25T10:28:46.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.818+0000 7fa52a800640 1 -- 172.21.15.19:0/1493345269 wait complete. 2024-04-25T10:28:46.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.821+0000 7fa52a800640 1 Processor -- start 2024-04-25T10:28:46.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.821+0000 7fa52a800640 1 -- start start 2024-04-25T10:28:46.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.822+0000 7fa52a800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240742c0 0x7fa5241f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:46.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.822+0000 7fa52a800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5240c4930 0x7fa52415a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:46.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.822+0000 7fa52a800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa524159b80 0x7fa524153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:46.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.822+0000 7fa52a800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa52415c900 con 0x7fa5240c4930 2024-04-25T10:28:46.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.822+0000 7fa52a800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa5240b2ea0 con 0x7fa5240742c0 2024-04-25T10:28:46.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.822+0000 7fa52a800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa524153a30 con 0x7fa524159b80 2024-04-25T10:28:46.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.823+0000 7fa51be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5240c4930 0x7fa52415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:46.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.823+0000 7fa51be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5240c4930 0x7fa52415a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39750/0 (socket says 172.21.15.19:39750) 2024-04-25T10:28:46.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.823+0000 7fa51be00640 1 -- 172.21.15.19:0/806526670 learned_addr learned my addr 172.21.15.19:0/806526670 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:46.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.823+0000 7fa523400640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240742c0 0x7fa5241f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:46.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.823+0000 7fa523e00640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa524159b80 0x7fa524153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:46.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.823+0000 7fa51be00640 1 -- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa524159b80 msgr2=0x7fa524153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:46.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.823+0000 7fa51be00640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa524159b80 0x7fa524153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:46.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.823+0000 7fa51be00640 1 -- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240742c0 msgr2=0x7fa5241f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:46.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.823+0000 7fa51be00640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240742c0 0x7fa5241f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:46.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.823+0000 7fa51be00640 1 -- 172.21.15.19:0/806526670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa524155770 con 0x7fa5240c4930 2024-04-25T10:28:46.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.823+0000 7fa523400640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240742c0 0x7fa5241f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:46.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.824+0000 7fa51be00640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5240c4930 0x7fa52415a560 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00e870 tx=0x7fa50c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:46.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.824+0000 7fa51b400640 1 -- 172.21.15.19:0/806526670 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c017070 con 0x7fa5240c4930 2024-04-25T10:28:46.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.824+0000 7fa51b400640 1 -- 172.21.15.19:0/806526670 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50c00c8e0 con 0x7fa5240c4930 2024-04-25T10:28:46.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.824+0000 7fa51b400640 1 -- 172.21.15.19:0/806526670 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00ccd0 con 0x7fa5240c4930 2024-04-25T10:28:46.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.824+0000 7fa52a800640 1 -- 172.21.15.19:0/806526670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5241f2410 con 0x7fa5240c4930 2024-04-25T10:28:46.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.824+0000 7fa52a800640 1 -- 172.21.15.19:0/806526670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5241f29d0 con 0x7fa5240c4930 2024-04-25T10:28:46.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.825+0000 7fa52a800640 1 -- 172.21.15.19:0/806526670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa524076520 con 0x7fa5240c4930 2024-04-25T10:28:46.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.826+0000 7fa51b400640 1 -- 172.21.15.19:0/806526670 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa50c01a070 con 0x7fa5240c4930 2024-04-25T10:28:46.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.828+0000 7fa51b400640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa5000744e0 0x7fa5000769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:46.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.828+0000 7fa51b400640 1 -- 172.21.15.19:0/806526670 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7fa50c095840 con 0x7fa5240c4930 2024-04-25T10:28:46.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.829+0000 7fa523400640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa5000744e0 0x7fa5000769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:46.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.829+0000 7fa523400640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa5000744e0 0x7fa5000769f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa514034000 tx=0x7fa51402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:46.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:46.833+0000 7fa51b400640 1 -- 172.21.15.19:0/806526670 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa50c05f5d0 con 0x7fa5240c4930 2024-04-25T10:28:47.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.041+0000 7fa52a800640 1 -- 172.21.15.19:0/806526670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa524149b60 con 0x7fa5240c4930 2024-04-25T10:28:47.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.044+0000 7fa51b400640 1 -- 172.21.15.19:0/806526670 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18745 (secure 0 0 0) 0x7fa50c0638d0 con 0x7fa5240c4930 2024-04-25T10:28:47.068 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:28:47.068 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:27:42.417364+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/3008138931":"2024-04-26T10:27:42.417214+0000","172.21.15.112:6836/3008138931":"2024-04-26T10:27:42.417214+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:28:47.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 -- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa5000744e0 msgr2=0x7fa5000769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa5000744e0 0x7fa5000769f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa514034000 tx=0x7fa51402e000 comp rx=0 tx=0).stop 2024-04-25T10:28:47.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 -- 172.21.15.19:0/806526670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5240c4930 msgr2=0x7fa52415a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5240c4930 0x7fa52415a560 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00e870 tx=0x7fa50c00ed30 comp rx=0 tx=0).stop 2024-04-25T10:28:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 -- 172.21.15.19:0/806526670 shutdown_connections 2024-04-25T10:28:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fa5000744e0 0x7fa5000769f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa524159b80 0x7fa524153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5240c4930 0x7fa52415a560 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 --2- 172.21.15.19:0/806526670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5240742c0 0x7fa5241f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 -- 172.21.15.19:0/806526670 >> 172.21.15.19:0/806526670 conn(0x7fa52406f1f0 msgr2=0x7fa52406c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 -- 172.21.15.19:0/806526670 shutdown_connections 2024-04-25T10:28:47.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.048+0000 7fa52a800640 1 -- 172.21.15.19:0/806526670 wait complete. 2024-04-25T10:28:47.078 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:25:24.611615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:25:34.760347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:25:35.692430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:25:39.212157+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:28:47.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:28:47.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.372+0000 7f5285000640 1 Processor -- start 2024-04-25T10:28:47.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.372+0000 7f5285000640 1 -- start start 2024-04-25T10:28:47.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.375+0000 7f5285000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f528015fc70 0x7f5280160080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.375+0000 7f5285000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52800cbc00 con 0x7f52800c6370 2024-04-25T10:28:47.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.375+0000 7f5285000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52800c5440 con 0x7f5280156b40 2024-04-25T10:28:47.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.375+0000 7f5285000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f52800c5d70 con 0x7f528015fc70 2024-04-25T10:28:47.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.375+0000 7f527d400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f52800c6370 0x7f52800cf6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40594/0 (socket says 172.21.15.19:40594) 2024-04-25T10:28:47.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.375+0000 7f527d400640 1 -- 172.21.15.19:0/339834678 learned_addr learned my addr 172.21.15.19:0/339834678 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:47.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.375+0000 7f527de00640 1 --1- 172.21.15.19:0/339834678 >> v1:172.21.15.112:6789/0 conn(0x7f5280156b40 0x7f52800cb170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:41598/0 (socket says 172.21.15.19:41598) 2024-04-25T10:28:47.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.375+0000 7f527e800640 1 --2- 172.21.15.19:0/339834678 >> v2:172.21.15.112:3300/0 conn(0x7f528015fc70 0x7f5280160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.376+0000 7f527ca00640 1 -- 172.21.15.19:0/339834678 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4078523415 0 0) 0x7f52800c5440 con 0x7f5280156b40 2024-04-25T10:28:47.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.376+0000 7f527ca00640 1 -- 172.21.15.19:0/339834678 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5260003520 con 0x7f5280156b40 2024-04-25T10:28:47.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.376+0000 7f527ca00640 1 -- 172.21.15.19:0/339834678 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1376628138 0 0) 0x7f52800cbc00 con 0x7f52800c6370 2024-04-25T10:28:47.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.376+0000 7f527ca00640 1 -- 172.21.15.19:0/339834678 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52800c5440 con 0x7f52800c6370 2024-04-25T10:28:47.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.376+0000 7f527e800640 1 -- 172.21.15.19:0/339834678 >> v1:172.21.15.112:6789/0 conn(0x7f5280156b40 legacy=0x7f52800cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.376+0000 7f527e800640 1 -- 172.21.15.19:0/339834678 >> v1:172.21.15.19:6789/0 conn(0x7f52800c6370 legacy=0x7f52800cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.376+0000 7f527e800640 1 -- 172.21.15.19:0/339834678 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52800c5720 con 0x7f528015fc70 2024-04-25T10:28:47.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.377+0000 7f527e800640 1 --2- 172.21.15.19:0/339834678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528015fc70 0x7f5280160080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52780097a0 tx=0x7f527802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65cfb15935cb7f67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.378+0000 7f527ca00640 1 -- 172.21.15.19:0/339834678 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278037070 con 0x7f528015fc70 2024-04-25T10:28:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.378+0000 7f527ca00640 1 -- 172.21.15.19:0/339834678 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5278032440 con 0x7f528015fc70 2024-04-25T10:28:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.378+0000 7f527ca00640 1 -- 172.21.15.19:0/339834678 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278032810 con 0x7f528015fc70 2024-04-25T10:28:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.378+0000 7f5285000640 1 -- 172.21.15.19:0/339834678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528015fc70 msgr2=0x7f5280160080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.378+0000 7f5285000640 1 --2- 172.21.15.19:0/339834678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528015fc70 0x7f5280160080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52780097a0 tx=0x7f527802a230 comp rx=0 tx=0).stop 2024-04-25T10:28:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.378+0000 7f5285000640 1 -- 172.21.15.19:0/339834678 shutdown_connections 2024-04-25T10:28:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.378+0000 7f5285000640 1 --2- 172.21.15.19:0/339834678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528015fc70 0x7f5280160080 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.378+0000 7f5285000640 1 -- 172.21.15.19:0/339834678 >> 172.21.15.19:0/339834678 conn(0x7f52800732a0 msgr2=0x7f5280071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:47.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.379+0000 7f5285000640 1 -- 172.21.15.19:0/339834678 shutdown_connections 2024-04-25T10:28:47.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.379+0000 7f5285000640 1 -- 172.21.15.19:0/339834678 wait complete. 2024-04-25T10:28:47.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.381+0000 7f5285000640 1 Processor -- start 2024-04-25T10:28:47.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.381+0000 7f5285000640 1 -- start start 2024-04-25T10:28:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.382+0000 7f5285000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52800c6370 0x7f5280157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.382+0000 7f5285000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5280156b40 0x7f52801e6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.382+0000 7f5285000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528015fc70 0x7f52801593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.382+0000 7f5285000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f52801605c0 con 0x7f5280156b40 2024-04-25T10:28:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.382+0000 7f5285000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f52800c6780 con 0x7f528015fc70 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f5285000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f52800cb880 con 0x7f52800c6370 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527d400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5280156b40 0x7f52801e6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528015fc70 0x7f52801593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52800c6370 0x7f5280157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527d400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5280156b40 0x7f52801e6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39754/0 (socket says 172.21.15.19:39754) 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527e800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528015fc70 0x7f52801593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:39670/0 (socket says 172.21.15.19:39670) 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527d400640 1 -- 172.21.15.19:0/1829709168 learned_addr learned my addr 172.21.15.19:0/1829709168 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527e800640 1 -- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52800c6370 msgr2=0x7f5280157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527e800640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52800c6370 0x7f5280157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527e800640 1 -- 172.21.15.19:0/1829709168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5280156b40 msgr2=0x7f52801e6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527e800640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5280156b40 0x7f52801e6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527e800640 1 -- 172.21.15.19:0/1829709168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52801e6a60 con 0x7f528015fc70 2024-04-25T10:28:47.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527de00640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52800c6370 0x7f5280157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:47.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.383+0000 7f527d400640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5280156b40 0x7f52801e6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:47.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.384+0000 7f527e800640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528015fc70 0x7f52801593e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f52800d0460 tx=0x7f52780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.384+0000 7f5276000640 1 -- 172.21.15.19:0/1829709168 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278041030 con 0x7f528015fc70 2024-04-25T10:28:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.384+0000 7f5276000640 1 -- 172.21.15.19:0/1829709168 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527803d4e0 con 0x7f528015fc70 2024-04-25T10:28:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.384+0000 7f5285000640 1 -- 172.21.15.19:0/1829709168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52801e6020 con 0x7f528015fc70 2024-04-25T10:28:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.384+0000 7f5276000640 1 -- 172.21.15.19:0/1829709168 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278037040 con 0x7f528015fc70 2024-04-25T10:28:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.384+0000 7f5285000640 1 -- 172.21.15.19:0/1829709168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52801f3570 con 0x7f528015fc70 2024-04-25T10:28:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.385+0000 7f5285000640 1 -- 172.21.15.19:0/1829709168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5280076520 con 0x7f528015fc70 2024-04-25T10:28:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.387+0000 7f5276000640 1 -- 172.21.15.19:0/1829709168 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f527803d8d0 con 0x7f528015fc70 2024-04-25T10:28:47.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.388+0000 7f5276000640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f525c0744b0 0x7f525c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.388+0000 7f5276000640 1 -- 172.21.15.19:0/1829709168 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f52780b5ab0 con 0x7f528015fc70 2024-04-25T10:28:47.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.388+0000 7f527de00640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f525c0744b0 0x7f525c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.389+0000 7f527de00640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f525c0744b0 0x7f525c0769c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5270000f60 tx=0x7f5270007d70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.392+0000 7f5276000640 1 -- 172.21.15.19:0/1829709168 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f527807f800 con 0x7f528015fc70 2024-04-25T10:28:47.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.600+0000 7f5285000640 1 -- 172.21.15.19:0/1829709168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5280069d90 con 0x7f528015fc70 2024-04-25T10:28:47.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.601+0000 7f5276000640 1 -- 172.21.15.19:0/1829709168 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f5278083b00 con 0x7f528015fc70 2024-04-25T10:28:47.603 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-04-25T10:28:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 -- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f525c0744b0 msgr2=0x7f525c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f525c0744b0 0x7f525c0769c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5270000f60 tx=0x7f5270007d70 comp rx=0 tx=0).stop 2024-04-25T10:28:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 -- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528015fc70 msgr2=0x7f52801593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528015fc70 0x7f52801593e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f52800d0460 tx=0x7f52780046c0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 -- 172.21.15.19:0/1829709168 shutdown_connections 2024-04-25T10:28:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528015fc70 0x7f52801593e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5280156b40 0x7f52801e6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f525c0744b0 0x7f525c0769c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 --2- 172.21.15.19:0/1829709168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f52800c6370 0x7f5280157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 -- 172.21.15.19:0/1829709168 >> 172.21.15.19:0/1829709168 conn(0x7f52800732a0 msgr2=0x7f5280150390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:47.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 -- 172.21.15.19:0/1829709168 shutdown_connections 2024-04-25T10:28:47.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.604+0000 7f5285000640 1 -- 172.21.15.19:0/1829709168 wait complete. 2024-04-25T10:28:47.633 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:28:47.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.921+0000 7f6465000640 1 Processor -- start 2024-04-25T10:28:47.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.921+0000 7f6465000640 1 -- start start 2024-04-25T10:28:47.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.923+0000 7f6465000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f64600c2640 0x7f64600c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.923+0000 7f6465000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6460156710 0x7f646006ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.923+0000 7f6465000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f646006f2a0 0x7f646015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.923+0000 7f6465000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f646006ffd0 con 0x7f64600c2640 2024-04-25T10:28:47.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.923+0000 7f6465000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f64600c8b10 con 0x7f646006f2a0 2024-04-25T10:28:47.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.923+0000 7f6465000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6460070200 con 0x7f6460156710 2024-04-25T10:28:47.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.924+0000 7f645f400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f64600c2640 0x7f64600c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.924+0000 7f645fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f646006f2a0 0x7f646015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.924+0000 7f645ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6460156710 0x7f646006ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.924+0000 7f645fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f646006f2a0 0x7f646015f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:55696/0 (socket says 172.21.15.19:55696) 2024-04-25T10:28:47.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.924+0000 7f645ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6460156710 0x7f646006ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:48184/0 (socket says 172.21.15.19:48184) 2024-04-25T10:28:47.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.924+0000 7f645fe00640 1 -- 172.21.15.19:0/3934184708 learned_addr learned my addr 172.21.15.19:0/3934184708 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:47.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.924+0000 7f645f400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f64600c2640 0x7f64600c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59618/0 (socket says 172.21.15.19:59618) 2024-04-25T10:28:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.925+0000 7f645f400640 1 -- 172.21.15.19:0/3934184708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6460156710 msgr2=0x7f646006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.925+0000 7f645f400640 1 --2- 172.21.15.19:0/3934184708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6460156710 0x7f646006ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.925+0000 7f645f400640 1 -- 172.21.15.19:0/3934184708 >> v2:172.21.15.112:3300/0 conn(0x7f646006f2a0 msgr2=0x7f646015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.925+0000 7f645f400640 1 --2- 172.21.15.19:0/3934184708 >> v2:172.21.15.112:3300/0 conn(0x7f646006f2a0 0x7f646015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.925+0000 7f645f400640 1 -- 172.21.15.19:0/3934184708 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64600c8d60 con 0x7f64600c2640 2024-04-25T10:28:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.926+0000 7f645f400640 1 --2- 172.21.15.19:0/3934184708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64600c2640 0x7f64600c9710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64600cb180 tx=0x7f645002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878c667e870ab2a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:47.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.926+0000 7f645e000640 1 -- 172.21.15.19:0/3934184708 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450037070 con 0x7f64600c2640 2024-04-25T10:28:47.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.926+0000 7f645e000640 1 -- 172.21.15.19:0/3934184708 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645002add0 con 0x7f64600c2640 2024-04-25T10:28:47.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.926+0000 7f645e000640 1 -- 172.21.15.19:0/3934184708 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450032660 con 0x7f64600c2640 2024-04-25T10:28:47.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.927+0000 7f6465000640 1 -- 172.21.15.19:0/3934184708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64600c2640 msgr2=0x7f64600c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.927+0000 7f6465000640 1 --2- 172.21.15.19:0/3934184708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64600c2640 0x7f64600c9710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64600cb180 tx=0x7f645002a080 comp rx=0 tx=0).stop 2024-04-25T10:28:47.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.927+0000 7f6465000640 1 -- 172.21.15.19:0/3934184708 shutdown_connections 2024-04-25T10:28:47.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.927+0000 7f6465000640 1 --2- 172.21.15.19:0/3934184708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6460156710 0x7f646006ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.927+0000 7f6465000640 1 --2- 172.21.15.19:0/3934184708 >> v2:172.21.15.112:3300/0 conn(0x7f646006f2a0 0x7f646015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.927+0000 7f6465000640 1 --2- 172.21.15.19:0/3934184708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64600c2640 0x7f64600c9710 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.927+0000 7f6465000640 1 -- 172.21.15.19:0/3934184708 >> 172.21.15.19:0/3934184708 conn(0x7f64600ca120 msgr2=0x7f64600ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:47.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.927+0000 7f6465000640 1 -- 172.21.15.19:0/3934184708 shutdown_connections 2024-04-25T10:28:47.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.928+0000 7f6465000640 1 -- 172.21.15.19:0/3934184708 wait complete. 2024-04-25T10:28:47.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.930+0000 7f6465000640 1 Processor -- start 2024-04-25T10:28:47.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.930+0000 7f6465000640 1 -- start start 2024-04-25T10:28:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.931+0000 7f6465000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f646006f2a0 0x7f6460154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.931+0000 7f6465000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64600c2640 0x7f6460154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.931+0000 7f6465000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6460156710 0x7f64601f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.931+0000 7f6465000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f64600c91f0 con 0x7f646006f2a0 2024-04-25T10:28:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.931+0000 7f6465000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f64600c84a0 con 0x7f6460156710 2024-04-25T10:28:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.931+0000 7f6465000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6460074990 con 0x7f64600c2640 2024-04-25T10:28:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.932+0000 7f645f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f646006f2a0 0x7f6460154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.932+0000 7f645fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6460156710 0x7f64601f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.932+0000 7f645ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64600c2640 0x7f6460154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.932+0000 7f645f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f646006f2a0 0x7f6460154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59632/0 (socket says 172.21.15.19:59632) 2024-04-25T10:28:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.932+0000 7f645f400640 1 -- 172.21.15.19:0/1660923050 learned_addr learned my addr 172.21.15.19:0/1660923050 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:47.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.932+0000 7f645f400640 1 -- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64600c2640 msgr2=0x7f6460154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.932+0000 7f645f400640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64600c2640 0x7f6460154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.932+0000 7f645f400640 1 -- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6460156710 msgr2=0x7f64601f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:47.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.932+0000 7f645f400640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6460156710 0x7f64601f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:47.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.932+0000 7f645f400640 1 -- 172.21.15.19:0/1660923050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64601f6720 con 0x7f646006f2a0 2024-04-25T10:28:47.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.933+0000 7f645f400640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f646006f2a0 0x7f6460154ef0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f645002a0c0 tx=0x7f64500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.933+0000 7f6457400640 1 -- 172.21.15.19:0/1660923050 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450037040 con 0x7f646006f2a0 2024-04-25T10:28:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.933+0000 7f6457400640 1 -- 172.21.15.19:0/1660923050 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645002abd0 con 0x7f646006f2a0 2024-04-25T10:28:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.933+0000 7f6457400640 1 -- 172.21.15.19:0/1660923050 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450006e10 con 0x7f646006f2a0 2024-04-25T10:28:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.933+0000 7f6465000640 1 -- 172.21.15.19:0/1660923050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64601f3540 con 0x7f646006f2a0 2024-04-25T10:28:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.933+0000 7f6465000640 1 -- 172.21.15.19:0/1660923050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64601f2f80 con 0x7f646006f2a0 2024-04-25T10:28:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.934+0000 7f6465000640 1 -- 172.21.15.19:0/1660923050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6460076520 con 0x7f646006f2a0 2024-04-25T10:28:47.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.936+0000 7f6457400640 1 -- 172.21.15.19:0/1660923050 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6450044020 con 0x7f646006f2a0 2024-04-25T10:28:47.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.937+0000 7f6457400640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f64400744b0 0x7f64400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:47.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.937+0000 7f6457400640 1 -- 172.21.15.19:0/1660923050 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f64500b50c0 con 0x7f646006f2a0 2024-04-25T10:28:47.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.937+0000 7f645ea00640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f64400744b0 0x7f64400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:47.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.938+0000 7f645ea00640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f64400744b0 0x7f64400769c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f64601f01b0 tx=0x7f644c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:47.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:47.942+0000 7f6457400640 1 -- 172.21.15.19:0/1660923050 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f645004b020 con 0x7f646006f2a0 2024-04-25T10:28:48.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.151+0000 7f6465000640 1 -- 172.21.15.19:0/1660923050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f646015d240 con 0x7f646006f2a0 2024-04-25T10:28:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.152+0000 7f6457400640 1 -- 172.21.15.19:0/1660923050 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f645007ef50 con 0x7f646006f2a0 2024-04-25T10:28:48.153 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:28:48.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.154+0000 7f6465000640 1 -- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f64400744b0 msgr2=0x7f64400769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:48.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.154+0000 7f6465000640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f64400744b0 0x7f64400769c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f64601f01b0 tx=0x7f644c009190 comp rx=0 tx=0).stop 2024-04-25T10:28:48.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.154+0000 7f6465000640 1 -- 172.21.15.19:0/1660923050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f646006f2a0 msgr2=0x7f6460154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:48.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.154+0000 7f6465000640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f646006f2a0 0x7f6460154ef0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f645002a0c0 tx=0x7f64500046c0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.154+0000 7f6465000640 1 -- 172.21.15.19:0/1660923050 shutdown_connections 2024-04-25T10:28:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.154+0000 7f6465000640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6460156710 0x7f64601f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.154+0000 7f6465000640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f64400744b0 0x7f64400769c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.154+0000 7f6465000640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64600c2640 0x7f6460154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.154+0000 7f6465000640 1 --2- 172.21.15.19:0/1660923050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f646006f2a0 0x7f6460154ef0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.154+0000 7f6465000640 1 -- 172.21.15.19:0/1660923050 >> 172.21.15.19:0/1660923050 conn(0x7f64600ca120 msgr2=0x7f64600ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.155+0000 7f6465000640 1 -- 172.21.15.19:0/1660923050 shutdown_connections 2024-04-25T10:28:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.155+0000 7f6465000640 1 -- 172.21.15.19:0/1660923050 wait complete. 2024-04-25T10:28:48.184 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:28:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.477+0000 7f3812200640 1 Processor -- start 2024-04-25T10:28:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.478+0000 7f3812200640 1 -- start start 2024-04-25T10:28:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.480+0000 7f3812200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15b2c0 0x7f380c0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.480+0000 7f3812200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f380c073160 0x7f380c15e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.480+0000 7f3812200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f380c158010 con 0x7f380c15e760 2024-04-25T10:28:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.480+0000 7f3812200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f380c074970 con 0x7f380c073160 2024-04-25T10:28:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.480+0000 7f3812200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f380c0c8600 con 0x7f380c15b2c0 2024-04-25T10:28:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.480+0000 7f3803e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f380c073160 0x7f380c15e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.480+0000 7f3803e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f380c073160 0x7f380c15e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59640/0 (socket says 172.21.15.19:59640) 2024-04-25T10:28:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.480+0000 7f3803e00640 1 -- 172.21.15.19:0/1814703820 learned_addr learned my addr 172.21.15.19:0/1814703820 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.480+0000 7f380b400640 1 --2- 172.21.15.19:0/1814703820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15b2c0 0x7f380c0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.481+0000 7f3803e00640 1 -- 172.21.15.19:0/1814703820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15b2c0 msgr2=0x7f380c0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.481+0000 7f3803e00640 1 --2- 172.21.15.19:0/1814703820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15b2c0 0x7f380c0c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.481+0000 7f3803e00640 1 -- 172.21.15.19:0/1814703820 >> v1:172.21.15.19:6789/0 conn(0x7f380c15e760 legacy=0x7f380c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.481+0000 7f3803e00640 1 -- 172.21.15.19:0/1814703820 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380c0c88e0 con 0x7f380c073160 2024-04-25T10:28:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.481+0000 7f380b400640 1 --2- 172.21.15.19:0/1814703820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15b2c0 0x7f380c0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.482+0000 7f3803e00640 1 --2- 172.21.15.19:0/1814703820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f380c073160 0x7f380c15e220 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009870 tx=0x7f37f402a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76ccaa9312a1ad6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.482+0000 7f380aa00640 1 -- 172.21.15.19:0/1814703820 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4037070 con 0x7f380c073160 2024-04-25T10:28:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.482+0000 7f380aa00640 1 -- 172.21.15.19:0/1814703820 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4032640 con 0x7f380c073160 2024-04-25T10:28:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.482+0000 7f380aa00640 1 -- 172.21.15.19:0/1814703820 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4032a10 con 0x7f380c073160 2024-04-25T10:28:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.483+0000 7f3812200640 1 -- 172.21.15.19:0/1814703820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f380c073160 msgr2=0x7f380c15e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.483+0000 7f3812200640 1 --2- 172.21.15.19:0/1814703820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f380c073160 0x7f380c15e220 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009870 tx=0x7f37f402a2e0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.483+0000 7f3812200640 1 -- 172.21.15.19:0/1814703820 shutdown_connections 2024-04-25T10:28:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.483+0000 7f3812200640 1 --2- 172.21.15.19:0/1814703820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f380c073160 0x7f380c15e220 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.483+0000 7f3812200640 1 --2- 172.21.15.19:0/1814703820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15b2c0 0x7f380c0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.483+0000 7f3812200640 1 -- 172.21.15.19:0/1814703820 >> 172.21.15.19:0/1814703820 conn(0x7f380c06f1f0 msgr2=0x7f380c06f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.483+0000 7f3812200640 1 -- 172.21.15.19:0/1814703820 shutdown_connections 2024-04-25T10:28:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.483+0000 7f3812200640 1 -- 172.21.15.19:0/1814703820 wait complete. 2024-04-25T10:28:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.485+0000 7f3812200640 1 Processor -- start 2024-04-25T10:28:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.486+0000 7f3812200640 1 -- start start 2024-04-25T10:28:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f3812200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c073160 0x7f380c1f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f3812200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15e760 0x7f380c14f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f3812200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f380c1f0620 0x7f380c0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f3812200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f380c06d4c0 con 0x7f380c1f0620 2024-04-25T10:28:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f3812200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f380c15a580 con 0x7f380c073160 2024-04-25T10:28:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f3812200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f380c0ce4f0 con 0x7f380c15e760 2024-04-25T10:28:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f380be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f380c1f0620 0x7f380c0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f3803e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15e760 0x7f380c14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f380b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c073160 0x7f380c1f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f3803e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15e760 0x7f380c14f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:48224/0 (socket says 172.21.15.19:48224) 2024-04-25T10:28:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f380b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c073160 0x7f380c1f4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:55718/0 (socket says 172.21.15.19:55718) 2024-04-25T10:28:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.487+0000 7f3803e00640 1 -- 172.21.15.19:0/714771937 learned_addr learned my addr 172.21.15.19:0/714771937 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.488+0000 7f3803e00640 1 -- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c073160 msgr2=0x7f380c1f4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.488+0000 7f3803e00640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c073160 0x7f380c1f4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.488+0000 7f3803e00640 1 -- 172.21.15.19:0/714771937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f380c1f0620 msgr2=0x7f380c0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.488+0000 7f3803e00640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f380c1f0620 0x7f380c0cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.488+0000 7f3803e00640 1 -- 172.21.15.19:0/714771937 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380c14e340 con 0x7f380c15e760 2024-04-25T10:28:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.488+0000 7f3803e00640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15e760 0x7f380c14f740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37f402a320 tx=0x7f37f40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.489+0000 7f3803400640 1 -- 172.21.15.19:0/714771937 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4037040 con 0x7f380c15e760 2024-04-25T10:28:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.489+0000 7f3803400640 1 -- 172.21.15.19:0/714771937 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4042070 con 0x7f380c15e760 2024-04-25T10:28:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.489+0000 7f3803400640 1 -- 172.21.15.19:0/714771937 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f40309b0 con 0x7f380c15e760 2024-04-25T10:28:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.489+0000 7f3812200640 1 -- 172.21.15.19:0/714771937 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380c1532d0 con 0x7f380c15e760 2024-04-25T10:28:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.489+0000 7f3812200640 1 -- 172.21.15.19:0/714771937 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f380c14e8e0 con 0x7f380c15e760 2024-04-25T10:28:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.490+0000 7f3812200640 1 -- 172.21.15.19:0/714771937 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f380c076520 con 0x7f380c15e760 2024-04-25T10:28:48.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.491+0000 7f3803400640 1 -- 172.21.15.19:0/714771937 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f37f4030b50 con 0x7f380c15e760 2024-04-25T10:28:48.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.492+0000 7f3803400640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744e0 0x7f37e80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:48.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.493+0000 7f3803400640 1 -- 172.21.15.19:0/714771937 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f37f40b67f0 con 0x7f380c15e760 2024-04-25T10:28:48.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.493+0000 7f380b400640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744e0 0x7f37e80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:48.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.493+0000 7f380b400640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744e0 0x7f37e80769f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009560 tx=0x7f37fc009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:48.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.496+0000 7f3803400640 1 -- 172.21.15.19:0/714771937 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f37f4080540 con 0x7f380c15e760 2024-04-25T10:28:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.700+0000 7f3812200640 1 -- 172.21.15.19:0/714771937 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f380c074100 con 0x7f380c15e760 2024-04-25T10:28:48.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.701+0000 7f3803400640 1 -- 172.21.15.19:0/714771937 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f37f4084840 con 0x7f380c15e760 2024-04-25T10:28:48.702 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-04-25T10:28:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 -- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744e0 msgr2=0x7f37e80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744e0 0x7f37e80769f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009560 tx=0x7f37fc009190 comp rx=0 tx=0).stop 2024-04-25T10:28:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 -- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15e760 msgr2=0x7f380c14f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15e760 0x7f380c14f740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37f402a320 tx=0x7f37f40046c0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 -- 172.21.15.19:0/714771937 shutdown_connections 2024-04-25T10:28:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f380c1f0620 0x7f380c0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f37e80744e0 0x7f37e80769f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f380c15e760 0x7f380c14f740 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 --2- 172.21.15.19:0/714771937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c073160 0x7f380c1f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 -- 172.21.15.19:0/714771937 >> 172.21.15.19:0/714771937 conn(0x7f380c06f1f0 msgr2=0x7f380c0cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 -- 172.21.15.19:0/714771937 shutdown_connections 2024-04-25T10:28:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:48.704+0000 7f3812200640 1 -- 172.21.15.19:0/714771937 wait complete. 2024-04-25T10:28:48.732 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:28:49.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.022+0000 7fcb9fe00640 1 Processor -- start 2024-04-25T10:28:49.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.022+0000 7fcb9fe00640 1 -- start start 2024-04-25T10:28:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.024+0000 7fcb9fe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcba006fd20 0x7fcba00c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.024+0000 7fcb9fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcba00c77a0 0x7fcba0153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.024+0000 7fcb9fe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcba015af60 con 0x7fcba01544e0 2024-04-25T10:28:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.024+0000 7fcb9fe00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fcba01548f0 con 0x7fcba006fd20 2024-04-25T10:28:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.024+0000 7fcb9fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcba00c6dd0 con 0x7fcba00c77a0 2024-04-25T10:28:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.024+0000 7fcb9ea00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcba006fd20 0x7fcba00c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.025+0000 7fcb9ea00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcba006fd20 0x7fcba00c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59664/0 (socket says 172.21.15.19:59664) 2024-04-25T10:28:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.025+0000 7fcb9ea00640 1 -- 172.21.15.19:0/870558591 learned_addr learned my addr 172.21.15.19:0/870558591 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.025+0000 7fcb97e00640 1 --2- 172.21.15.19:0/870558591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcba00c77a0 0x7fcba0153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.025+0000 7fcb9e000640 1 -- 172.21.15.19:0/870558591 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887933708 0 0) 0x7fcba015af60 con 0x7fcba01544e0 2024-04-25T10:28:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.025+0000 7fcb9ea00640 1 -- 172.21.15.19:0/870558591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcba00c77a0 msgr2=0x7fcba0153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.025+0000 7fcb9ea00640 1 --2- 172.21.15.19:0/870558591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcba00c77a0 0x7fcba0153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.025+0000 7fcb9ea00640 1 -- 172.21.15.19:0/870558591 >> v1:172.21.15.112:6789/0 conn(0x7fcba01544e0 legacy=0x7fcba006ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.025+0000 7fcb9ea00640 1 -- 172.21.15.19:0/870558591 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba00c61c0 con 0x7fcba006fd20 2024-04-25T10:28:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.026+0000 7fcb9ea00640 1 --2- 172.21.15.19:0/870558591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba006fd20 0x7fcba00c7260 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009870 tx=0x7fcb9002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7278296a95c378 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.027+0000 7fcb9e000640 1 -- 172.21.15.19:0/870558591 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90037070 con 0x7fcba006fd20 2024-04-25T10:28:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.027+0000 7fcb9e000640 1 -- 172.21.15.19:0/870558591 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9002ae50 con 0x7fcba006fd20 2024-04-25T10:28:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.027+0000 7fcb9e000640 1 -- 172.21.15.19:0/870558591 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90032860 con 0x7fcba006fd20 2024-04-25T10:28:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.027+0000 7fcb9fe00640 1 -- 172.21.15.19:0/870558591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba006fd20 msgr2=0x7fcba00c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.027+0000 7fcb9fe00640 1 --2- 172.21.15.19:0/870558591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba006fd20 0x7fcba00c7260 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009870 tx=0x7fcb9002a300 comp rx=0 tx=0).stop 2024-04-25T10:28:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.027+0000 7fcb9fe00640 1 -- 172.21.15.19:0/870558591 shutdown_connections 2024-04-25T10:28:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.027+0000 7fcb9fe00640 1 --2- 172.21.15.19:0/870558591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcba00c77a0 0x7fcba0153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.027+0000 7fcb9fe00640 1 --2- 172.21.15.19:0/870558591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba006fd20 0x7fcba00c7260 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.027+0000 7fcb9fe00640 1 -- 172.21.15.19:0/870558591 >> 172.21.15.19:0/870558591 conn(0x7fcba00ca120 msgr2=0x7fcba00ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.028+0000 7fcb9fe00640 1 -- 172.21.15.19:0/870558591 shutdown_connections 2024-04-25T10:28:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.028+0000 7fcb9fe00640 1 -- 172.21.15.19:0/870558591 wait complete. 2024-04-25T10:28:49.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.030+0000 7fcb9fe00640 1 Processor -- start 2024-04-25T10:28:49.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.030+0000 7fcb9fe00640 1 -- start start 2024-04-25T10:28:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba006fd20 0x7fcba0156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcba00c77a0 0x7fcba00c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcba01544e0 0x7fcba0147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9fe00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcba00c6a60 con 0x7fcba006fd20 2024-04-25T10:28:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcba00c6780 con 0x7fcba00c77a0 2024-04-25T10:28:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcba0073010 con 0x7fcba01544e0 2024-04-25T10:28:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba006fd20 0x7fcba0156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba006fd20 0x7fcba0156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59668/0 (socket says 172.21.15.19:59668) 2024-04-25T10:28:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9ea00640 1 -- 172.21.15.19:0/3907002835 learned_addr learned my addr 172.21.15.19:0/3907002835 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb97e00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcba00c77a0 0x7fcba00c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9f400640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcba01544e0 0x7fcba0147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9ea00640 1 -- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcba01544e0 msgr2=0x7fcba0147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9ea00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcba01544e0 0x7fcba0147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9ea00640 1 -- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcba00c77a0 msgr2=0x7fcba00c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9ea00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcba00c77a0 0x7fcba00c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.032+0000 7fcb9ea00640 1 -- 172.21.15.19:0/3907002835 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba0157260 con 0x7fcba006fd20 2024-04-25T10:28:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.033+0000 7fcb9ea00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba006fd20 0x7fcba0156d20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009870 tx=0x7fcb900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.033+0000 7fcb97400640 1 -- 172.21.15.19:0/3907002835 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90037040 con 0x7fcba006fd20 2024-04-25T10:28:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.033+0000 7fcb97400640 1 -- 172.21.15.19:0/3907002835 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb90004250 con 0x7fcba006fd20 2024-04-25T10:28:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.033+0000 7fcb9fe00640 1 -- 172.21.15.19:0/3907002835 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba01559a0 con 0x7fcba006fd20 2024-04-25T10:28:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.033+0000 7fcb97400640 1 -- 172.21.15.19:0/3907002835 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90003610 con 0x7fcba006fd20 2024-04-25T10:28:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.033+0000 7fcb9fe00640 1 -- 172.21.15.19:0/3907002835 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba0156520 con 0x7fcba006fd20 2024-04-25T10:28:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.035+0000 7fcb9fe00640 1 -- 172.21.15.19:0/3907002835 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba0070680 con 0x7fcba006fd20 2024-04-25T10:28:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.036+0000 7fcb97400640 1 -- 172.21.15.19:0/3907002835 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcb9003a070 con 0x7fcba006fd20 2024-04-25T10:28:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.037+0000 7fcb97400640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcb7c0744e0 0x7fcb7c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.037+0000 7fcb97400640 1 -- 172.21.15.19:0/3907002835 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7fcb900b5930 con 0x7fcba006fd20 2024-04-25T10:28:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.037+0000 7fcb97e00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcb7c0744e0 0x7fcb7c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.038+0000 7fcb97e00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcb7c0744e0 0x7fcb7c0769f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcba006fc60 tx=0x7fcb88009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.042+0000 7fcb97400640 1 -- 172.21.15.19:0/3907002835 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcba0070680 con 0x7fcba006fd20 2024-04-25T10:28:49.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.251+0000 7fcb9fe00640 1 -- 172.21.15.19:0/3907002835 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fcba0076520 con 0x7fcba006fd20 2024-04-25T10:28:49.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.253+0000 7fcb97400640 1 -- 172.21.15.19:0/3907002835 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fcb90041020 con 0x7fcba006fd20 2024-04-25T10:28:49.254 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-04-25T10:28:49.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.255+0000 7fcb9fe00640 1 -- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcb7c0744e0 msgr2=0x7fcb7c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.255+0000 7fcb9fe00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcb7c0744e0 0x7fcb7c0769f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcba006fc60 tx=0x7fcb88009190 comp rx=0 tx=0).stop 2024-04-25T10:28:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.255+0000 7fcb9fe00640 1 -- 172.21.15.19:0/3907002835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba006fd20 msgr2=0x7fcba0156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.255+0000 7fcb9fe00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba006fd20 0x7fcba0156d20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009870 tx=0x7fcb900046c0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.256+0000 7fcb9fe00640 1 -- 172.21.15.19:0/3907002835 shutdown_connections 2024-04-25T10:28:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.256+0000 7fcb9fe00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fcb7c0744e0 0x7fcb7c0769f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.256+0000 7fcb9fe00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcba01544e0 0x7fcba0147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.256+0000 7fcb9fe00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcba00c77a0 0x7fcba00c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.256+0000 7fcb9fe00640 1 --2- 172.21.15.19:0/3907002835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba006fd20 0x7fcba0156d20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.256+0000 7fcb9fe00640 1 -- 172.21.15.19:0/3907002835 >> 172.21.15.19:0/3907002835 conn(0x7fcba00ca120 msgr2=0x7fcba0074490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.256+0000 7fcb9fe00640 1 -- 172.21.15.19:0/3907002835 shutdown_connections 2024-04-25T10:28:49.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.256+0000 7fcb9fe00640 1 -- 172.21.15.19:0/3907002835 wait complete. 2024-04-25T10:28:49.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:28:49.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.569+0000 7f3a37200640 1 Processor -- start 2024-04-25T10:28:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.569+0000 7f3a37200640 1 -- start start 2024-04-25T10:28:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.571+0000 7f3a37200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a300cf040 0x7f3a30071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.571+0000 7f3a37200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3a300cd840 0x7f3a30166d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a37200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3008d840 con 0x7f3a3006e9d0 2024-04-25T10:28:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a37200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3a30070ba0 con 0x7f3a300cd840 2024-04-25T10:28:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a37200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3015c930 con 0x7f3a300cf040 2024-04-25T10:28:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a35e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a300cf040 0x7f3a30071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a36800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3a300cd840 0x7f3a30166d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a35400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3a3006e9d0 0x7f3a300cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35316/0 (socket says 172.21.15.19:35316) 2024-04-25T10:28:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a35400640 1 -- 172.21.15.19:0/702829527 learned_addr learned my addr 172.21.15.19:0/702829527 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a35e00640 1 -- 172.21.15.19:0/702829527 >> v2:172.21.15.112:3300/0 conn(0x7f3a300cd840 msgr2=0x7f3a30166d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a35e00640 1 --2- 172.21.15.19:0/702829527 >> v2:172.21.15.112:3300/0 conn(0x7f3a300cd840 0x7f3a30166d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a35e00640 1 -- 172.21.15.19:0/702829527 >> v1:172.21.15.19:6789/0 conn(0x7f3a3006e9d0 legacy=0x7f3a300cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a34a00640 1 -- 172.21.15.19:0/702829527 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1487397620 0 0) 0x7f3a3008d840 con 0x7f3a3006e9d0 2024-04-25T10:28:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.572+0000 7f3a35e00640 1 -- 172.21.15.19:0/702829527 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3015cc10 con 0x7f3a300cf040 2024-04-25T10:28:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.574+0000 7f3a35e00640 1 --2- 172.21.15.19:0/702829527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a300cf040 0x7f3a30071030 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3a240097a0 tx=0x7f3a2402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c00d9f8bfc97d64f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.574+0000 7f3a34a00640 1 -- 172.21.15.19:0/702829527 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24037070 con 0x7f3a300cf040 2024-04-25T10:28:49.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.574+0000 7f3a34a00640 1 -- 172.21.15.19:0/702829527 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a24032440 con 0x7f3a300cf040 2024-04-25T10:28:49.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.574+0000 7f3a34a00640 1 -- 172.21.15.19:0/702829527 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24032810 con 0x7f3a300cf040 2024-04-25T10:28:49.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.575+0000 7f3a37200640 1 -- 172.21.15.19:0/702829527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a300cf040 msgr2=0x7f3a30071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.575+0000 7f3a37200640 1 --2- 172.21.15.19:0/702829527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a300cf040 0x7f3a30071030 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3a240097a0 tx=0x7f3a2402a180 comp rx=0 tx=0).stop 2024-04-25T10:28:49.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.575+0000 7f3a37200640 1 -- 172.21.15.19:0/702829527 shutdown_connections 2024-04-25T10:28:49.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.575+0000 7f3a37200640 1 --2- 172.21.15.19:0/702829527 >> v2:172.21.15.112:3300/0 conn(0x7f3a300cd840 0x7f3a30166d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.575+0000 7f3a37200640 1 --2- 172.21.15.19:0/702829527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a300cf040 0x7f3a30071030 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.575+0000 7f3a37200640 1 -- 172.21.15.19:0/702829527 >> 172.21.15.19:0/702829527 conn(0x7f3a30068e30 msgr2=0x7f3a30072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:49.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.575+0000 7f3a37200640 1 -- 172.21.15.19:0/702829527 shutdown_connections 2024-04-25T10:28:49.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.575+0000 7f3a37200640 1 -- 172.21.15.19:0/702829527 wait complete. 2024-04-25T10:28:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.578+0000 7f3a37200640 1 Processor -- start 2024-04-25T10:28:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.579+0000 7f3a37200640 1 -- start start 2024-04-25T10:28:49.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a37200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a3006e9d0 0x7f3a300c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a37200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a300cd840 0x7f3a300c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a37200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a300cf040 0x7f3a300c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a37200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a300cc6c0 con 0x7f3a3006e9d0 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a37200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3015d1d0 con 0x7f3a300cd840 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a37200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3a300cc840 con 0x7f3a300cf040 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a35e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a3006e9d0 0x7f3a300c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a35e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a3006e9d0 0x7f3a300c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59678/0 (socket says 172.21.15.19:59678) 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a35e00640 1 -- 172.21.15.19:0/3572093970 learned_addr learned my addr 172.21.15.19:0/3572093970 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a35400640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a300cd840 0x7f3a300c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a36800640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a300cf040 0x7f3a300c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a35e00640 1 -- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a300cf040 msgr2=0x7f3a300c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a35e00640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a300cf040 0x7f3a300c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a35e00640 1 -- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a300cd840 msgr2=0x7f3a300c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a35e00640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a300cd840 0x7f3a300c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.581+0000 7f3a35e00640 1 -- 172.21.15.19:0/3572093970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a300c92b0 con 0x7f3a3006e9d0 2024-04-25T10:28:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.582+0000 7f3a35e00640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a3006e9d0 0x7f3a300c8d70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3a240098c0 tx=0x7f3a240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.582+0000 7f3a2a000640 1 -- 172.21.15.19:0/3572093970 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24037040 con 0x7f3a3006e9d0 2024-04-25T10:28:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.582+0000 7f3a2a000640 1 -- 172.21.15.19:0/3572093970 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a24042070 con 0x7f3a3006e9d0 2024-04-25T10:28:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.582+0000 7f3a37200640 1 -- 172.21.15.19:0/3572093970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a30159bb0 con 0x7f3a3006e9d0 2024-04-25T10:28:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.582+0000 7f3a2a000640 1 -- 172.21.15.19:0/3572093970 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24030940 con 0x7f3a3006e9d0 2024-04-25T10:28:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.582+0000 7f3a37200640 1 -- 172.21.15.19:0/3572093970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a300c7cd0 con 0x7f3a3006e9d0 2024-04-25T10:28:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.584+0000 7f3a37200640 1 -- 172.21.15.19:0/3572093970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a300c9480 con 0x7f3a3006e9d0 2024-04-25T10:28:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.585+0000 7f3a2a000640 1 -- 172.21.15.19:0/3572093970 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3a24030ae0 con 0x7f3a3006e9d0 2024-04-25T10:28:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.586+0000 7f3a2a000640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3a140744b0 0x7f3a140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.586+0000 7f3a2a000640 1 -- 172.21.15.19:0/3572093970 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f3a240b5ef0 con 0x7f3a3006e9d0 2024-04-25T10:28:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.586+0000 7f3a35400640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3a140744b0 0x7f3a140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.587+0000 7f3a35400640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3a140744b0 0x7f3a140769c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3a301589a0 tx=0x7f3a20007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:49.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.590+0000 7f3a2a000640 1 -- 172.21.15.19:0/3572093970 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a2407fbc0 con 0x7f3a3006e9d0 2024-04-25T10:28:49.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.809+0000 7f3a37200640 1 -- 172.21.15.19:0/3572093970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3a30076520 con 0x7f3a3006e9d0 2024-04-25T10:28:49.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.810+0000 7f3a2a000640 1 -- 172.21.15.19:0/3572093970 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v27) ==== 80+0+124 (secure 0 0 0) 0x7f3a24088290 con 0x7f3a3006e9d0 2024-04-25T10:28:49.812 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.112:6837/3008138931 2024-04-26T10:27:42.417214+0000 2024-04-25T10:28:49.812 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.112:6836/3008138931 2024-04-26T10:27:42.417214+0000 2024-04-25T10:28:49.812 INFO:teuthology.orchestra.run.smithi019.stderr:listed 2 entries 2024-04-25T10:28:49.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.812+0000 7f3a37200640 1 -- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3a140744b0 msgr2=0x7f3a140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.812+0000 7f3a37200640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3a140744b0 0x7f3a140769c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3a301589a0 tx=0x7f3a20007de0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.813+0000 7f3a37200640 1 -- 172.21.15.19:0/3572093970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a3006e9d0 msgr2=0x7f3a300c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:49.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.813+0000 7f3a37200640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a3006e9d0 0x7f3a300c8d70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3a240098c0 tx=0x7f3a240046c0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.813+0000 7f3a37200640 1 -- 172.21.15.19:0/3572093970 shutdown_connections 2024-04-25T10:28:49.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.813+0000 7f3a37200640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3a140744b0 0x7f3a140769c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.813+0000 7f3a37200640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a300cf040 0x7f3a300c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.813+0000 7f3a37200640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a300cd840 0x7f3a300c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.813+0000 7f3a37200640 1 --2- 172.21.15.19:0/3572093970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a3006e9d0 0x7f3a300c8d70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:49.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.813+0000 7f3a37200640 1 -- 172.21.15.19:0/3572093970 >> 172.21.15.19:0/3572093970 conn(0x7f3a30068e30 msgr2=0x7f3a300c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:49.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.813+0000 7f3a37200640 1 -- 172.21.15.19:0/3572093970 shutdown_connections 2024-04-25T10:28:49.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:49.813+0000 7f3a37200640 1 -- 172.21.15.19:0/3572093970 wait complete. 2024-04-25T10:28:49.843 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:28:49.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:28:49.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:28:49.974 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:28:49.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:28:49.975 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:28:50.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:28:50.042 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-04-25T10:28:50.079 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:28:50.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:28:50.080 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:28:50.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:28:50.189 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-04-25T10:28:50.288 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T10:28:50.297 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T10:28:50.298 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:28:50.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.550+0000 7f6959600640 1 Processor -- start 2024-04-25T10:28:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.551+0000 7f6959600640 1 -- start start 2024-04-25T10:28:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.553+0000 7f6959600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f695415a370 0x7f6954070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.553+0000 7f6959600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540c7f90 0x7f6954073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.553+0000 7f6959600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69540cac80 0x7f6954073b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.553+0000 7f6959600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f6954072ea0 con 0x7f69540cac80 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.553+0000 7f6959600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6954073180 con 0x7f695415a370 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.553+0000 7f6959600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f695415a8b0 con 0x7f69540c7f90 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.554+0000 7f6958c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69540cac80 0x7f6954073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.554+0000 7f6953400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540c7f90 0x7f6954073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.554+0000 7f6953400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540c7f90 0x7f6954073610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:48256/0 (socket says 172.21.15.19:48256) 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.554+0000 7f6953e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f695415a370 0x7f6954070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.554+0000 7f6953400640 1 -- 172.21.15.19:0/3467824017 learned_addr learned my addr 172.21.15.19:0/3467824017 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.554+0000 7f6953400640 1 -- 172.21.15.19:0/3467824017 >> v2:172.21.15.112:3300/0 conn(0x7f695415a370 msgr2=0x7f6954070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.554+0000 7f6953400640 1 --2- 172.21.15.19:0/3467824017 >> v2:172.21.15.112:3300/0 conn(0x7f695415a370 0x7f6954070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.554+0000 7f6953400640 1 -- 172.21.15.19:0/3467824017 >> v2:172.21.15.19:3300/0 conn(0x7f69540cac80 msgr2=0x7f6954073b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:50.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.554+0000 7f6953400640 1 --2- 172.21.15.19:0/3467824017 >> v2:172.21.15.19:3300/0 conn(0x7f69540cac80 0x7f6954073b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.554+0000 7f6953400640 1 -- 172.21.15.19:0/3467824017 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695415ab70 con 0x7f69540c7f90 2024-04-25T10:28:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.555+0000 7f6953400640 1 --2- 172.21.15.19:0/3467824017 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540c7f90 0x7f6954073610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6954072950 tx=0x7f693c02a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd014edd4dbffa2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.556+0000 7f6952a00640 1 -- 172.21.15.19:0/3467824017 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c037070 con 0x7f69540c7f90 2024-04-25T10:28:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.556+0000 7f6952a00640 1 -- 172.21.15.19:0/3467824017 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c032440 con 0x7f69540c7f90 2024-04-25T10:28:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.556+0000 7f6952a00640 1 -- 172.21.15.19:0/3467824017 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c032810 con 0x7f69540c7f90 2024-04-25T10:28:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.556+0000 7f6959600640 1 -- 172.21.15.19:0/3467824017 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540c7f90 msgr2=0x7f6954073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.556+0000 7f6959600640 1 --2- 172.21.15.19:0/3467824017 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540c7f90 0x7f6954073610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6954072950 tx=0x7f693c02a140 comp rx=0 tx=0).stop 2024-04-25T10:28:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.557+0000 7f6959600640 1 -- 172.21.15.19:0/3467824017 shutdown_connections 2024-04-25T10:28:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.557+0000 7f6959600640 1 --2- 172.21.15.19:0/3467824017 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540c7f90 0x7f6954073610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.557+0000 7f6959600640 1 --2- 172.21.15.19:0/3467824017 >> v2:172.21.15.19:3300/0 conn(0x7f69540cac80 0x7f6954073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.557+0000 7f6959600640 1 --2- 172.21.15.19:0/3467824017 >> v2:172.21.15.112:3300/0 conn(0x7f695415a370 0x7f6954070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.557+0000 7f6959600640 1 -- 172.21.15.19:0/3467824017 >> 172.21.15.19:0/3467824017 conn(0x7f69540cdbc0 msgr2=0x7f69540ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.557+0000 7f6959600640 1 -- 172.21.15.19:0/3467824017 shutdown_connections 2024-04-25T10:28:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.557+0000 7f6959600640 1 -- 172.21.15.19:0/3467824017 wait complete. 2024-04-25T10:28:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.560+0000 7f6959600640 1 Processor -- start 2024-04-25T10:28:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.560+0000 7f6959600640 1 -- start start 2024-04-25T10:28:50.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.562+0000 7f6959600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69540c7f90 0x7f69541e5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:50.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.562+0000 7f6959600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540cac80 0x7f69541e4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:50.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.562+0000 7f6959600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f695415a370 0x7f6954156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.562+0000 7f6959600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f69540c4b20 con 0x7f69540c7f90 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.562+0000 7f6959600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f695415b130 con 0x7f695415a370 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.562+0000 7f6959600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6954070da0 con 0x7f69540cac80 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.562+0000 7f6953e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69540c7f90 0x7f69541e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.562+0000 7f6953e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69540c7f90 0x7f69541e5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59694/0 (socket says 172.21.15.19:59694) 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.562+0000 7f6953e00640 1 -- 172.21.15.19:0/3417235398 learned_addr learned my addr 172.21.15.19:0/3417235398 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.562+0000 7f6953400640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540cac80 0x7f69541e4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.562+0000 7f6958c00640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f695415a370 0x7f6954156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f6953400640 1 -- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f695415a370 msgr2=0x7f6954156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f6953400640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f695415a370 0x7f6954156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f6953400640 1 -- 172.21.15.19:0/3417235398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69540c7f90 msgr2=0x7f69541e5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f6953400640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69540c7f90 0x7f69541e5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f6953400640 1 -- 172.21.15.19:0/3417235398 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69541e5c50 con 0x7f69540cac80 2024-04-25T10:28:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f6958c00640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f695415a370 0x7f6954156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f6953e00640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69540c7f90 0x7f69541e5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f6953400640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540cac80 0x7f69541e4610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f693c031000 tx=0x7f693c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:50.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f694be00640 1 -- 172.21.15.19:0/3417235398 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c041020 con 0x7f69540cac80 2024-04-25T10:28:50.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f694be00640 1 -- 172.21.15.19:0/3417235398 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c03d660 con 0x7f69540cac80 2024-04-25T10:28:50.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f694be00640 1 -- 172.21.15.19:0/3417235398 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c037040 con 0x7f69540cac80 2024-04-25T10:28:50.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.563+0000 7f6959600640 1 -- 172.21.15.19:0/3417235398 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69541f6340 con 0x7f69540cac80 2024-04-25T10:28:50.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.564+0000 7f6959600640 1 -- 172.21.15.19:0/3417235398 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6954157c70 con 0x7f69540cac80 2024-04-25T10:28:50.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.565+0000 7f6959600640 1 -- 172.21.15.19:0/3417235398 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6954050740 con 0x7f69540cac80 2024-04-25T10:28:50.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.566+0000 7f694be00640 1 -- 172.21.15.19:0/3417235398 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f693c044020 con 0x7f69540cac80 2024-04-25T10:28:50.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.567+0000 7f694be00640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f69300744e0 0x7f69300769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:50.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.567+0000 7f694be00640 1 -- 172.21.15.19:0/3417235398 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f693c0b5a80 con 0x7f69540cac80 2024-04-25T10:28:50.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.567+0000 7f6953e00640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f69300744e0 0x7f69300769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:50.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.568+0000 7f6953e00640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f69300744e0 0x7f69300769f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f69440094c0 tx=0x7f694400b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.572+0000 7f694be00640 1 -- 172.21.15.19:0/3417235398 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f693c0b7e20 con 0x7f69540cac80 2024-04-25T10:28:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.774+0000 7f6959600640 1 -- 172.21.15.19:0/3417235398 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69540c59e0 con 0x7f69300744e0 2024-04-25T10:28:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.785+0000 7f694be00640 1 -- 172.21.15.19:0/3417235398 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332692 (secure 0 0 0) 0x7f69540c59e0 con 0x7f69300744e0 2024-04-25T10:28:50.792 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:28:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:28:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.792+0000 7f6959600640 1 -- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f69300744e0 msgr2=0x7f69300769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:50.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.792+0000 7f6959600640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f69300744e0 0x7f69300769f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f69440094c0 tx=0x7f694400b040 comp rx=0 tx=0).stop 2024-04-25T10:28:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.792+0000 7f6959600640 1 -- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540cac80 msgr2=0x7f69541e4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.792+0000 7f6959600640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540cac80 0x7f69541e4610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f693c031000 tx=0x7f693c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.792+0000 7f6959600640 1 -- 172.21.15.19:0/3417235398 shutdown_connections 2024-04-25T10:28:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.792+0000 7f6959600640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f695415a370 0x7f6954156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.792+0000 7f6959600640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f69300744e0 0x7f69300769f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.792+0000 7f6959600640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f69540cac80 0x7f69541e4610 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.792+0000 7f6959600640 1 --2- 172.21.15.19:0/3417235398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69540c7f90 0x7f69541e5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.792+0000 7f6959600640 1 -- 172.21.15.19:0/3417235398 >> 172.21.15.19:0/3417235398 conn(0x7f69540cdbc0 msgr2=0x7f69540c83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.793+0000 7f6959600640 1 -- 172.21.15.19:0/3417235398 shutdown_connections 2024-04-25T10:28:50.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:50.793+0000 7f6959600640 1 -- 172.21.15.19:0/3417235398 wait complete. 2024-04-25T10:28:50.819 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-04-25T10:28:50.633407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627231,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":141,"num_read_kb":133,"num_write":263,"num_write_kb":1718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219784,"kb_used_data":3656,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754936,"statfs":{"total":773094113280,"available":772869054464,"internally_reserved":0,"allocated":3743744,"data_stored":2221502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25346,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003425"},"pg_stats":[{"pgid":"2.1f","version":"27'10","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.734369+0000","last_change":"2024-04-25T10:25:36.182605+0000","last_active":"2024-04-25T10:28:07.734369+0000","last_peered":"2024-04-25T10:28:07.734369+0000","last_clean":"2024-04-25T10:28:07.734369+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:28:07.734369+0000","last_undegraded":"2024-04-25T10:28:07.734369+0000","last_fullsized":"2024-04-25T10:28:07.734369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280577+0000","last_change":"2024-04-25T10:25:37.199467+0000","last_active":"2024-04-25T10:27:43.280577+0000","last_peered":"2024-04-25T10:27:43.280577+0000","last_clean":"2024-04-25T10:27:43.280577+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:27:43.280577+0000","last_undegraded":"2024-04-25T10:27:43.280577+0000","last_fullsized":"2024-04-25T10:27:43.280577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426008+0000","last_change":"2024-04-25T10:25:41.234657+0000","last_active":"2024-04-25T10:27:42.426008+0000","last_peered":"2024-04-25T10:27:42.426008+0000","last_clean":"2024-04-25T10:27:42.426008+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:27:42.426008+0000","last_undegraded":"2024-04-25T10:27:42.426008+0000","last_fullsized":"2024-04-25T10:27:42.426008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:56.869031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280765+0000","last_change":"2024-04-25T10:25:36.166548+0000","last_active":"2024-04-25T10:27:43.280765+0000","last_peered":"2024-04-25T10:27:43.280765+0000","last_clean":"2024-04-25T10:27:43.280765+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:27:43.280765+0000","last_undegraded":"2024-04-25T10:27:43.280765+0000","last_fullsized":"2024-04-25T10:27:43.280765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280925+0000","last_change":"2024-04-25T10:25:37.179746+0000","last_active":"2024-04-25T10:27:43.280925+0000","last_peered":"2024-04-25T10:27:43.280925+0000","last_clean":"2024-04-25T10:27:43.280925+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:27:43.280925+0000","last_undegraded":"2024-04-25T10:27:43.280925+0000","last_fullsized":"2024-04-25T10:27:43.280925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780202+0000","last_change":"2024-04-25T10:25:41.232828+0000","last_active":"2024-04-25T10:27:42.780202+0000","last_peered":"2024-04-25T10:27:42.780202+0000","last_clean":"2024-04-25T10:27:42.780202+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:27:42.780202+0000","last_undegraded":"2024-04-25T10:27:42.780202+0000","last_fullsized":"2024-04-25T10:27:42.780202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:01.782881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:09.656041+0000","last_change":"2024-04-25T10:25:36.190035+0000","last_active":"2024-04-25T10:28:09.656041+0000","last_peered":"2024-04-25T10:28:09.656041+0000","last_clean":"2024-04-25T10:28:09.656041+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:28:09.656041+0000","last_undegraded":"2024-04-25T10:28:09.656041+0000","last_fullsized":"2024-04-25T10:28:09.656041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":7,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.429329+0000","last_change":"2024-04-25T10:25:37.191742+0000","last_active":"2024-04-25T10:27:42.429329+0000","last_peered":"2024-04-25T10:27:42.429329+0000","last_clean":"2024-04-25T10:27:42.429329+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:27:42.429329+0000","last_undegraded":"2024-04-25T10:27:42.429329+0000","last_fullsized":"2024-04-25T10:27:42.429329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780246+0000","last_change":"2024-04-25T10:25:41.242444+0000","last_active":"2024-04-25T10:27:42.780246+0000","last_peered":"2024-04-25T10:27:42.780246+0000","last_clean":"2024-04-25T10:27:42.780246+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:27:42.780246+0000","last_undegraded":"2024-04-25T10:27:42.780246+0000","last_fullsized":"2024-04-25T10:27:42.780246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195642+0000","last_change":"2024-04-25T10:25:36.190527+0000","last_active":"2024-04-25T10:27:43.195642+0000","last_peered":"2024-04-25T10:27:43.195642+0000","last_clean":"2024-04-25T10:27:43.195642+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:27:43.195642+0000","last_undegraded":"2024-04-25T10:27:43.195642+0000","last_fullsized":"2024-04-25T10:27:43.195642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283453+0000","last_change":"2024-04-25T10:25:37.204468+0000","last_active":"2024-04-25T10:27:43.283453+0000","last_peered":"2024-04-25T10:27:43.283453+0000","last_clean":"2024-04-25T10:27:43.283453+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:27:43.283453+0000","last_undegraded":"2024-04-25T10:27:43.283453+0000","last_fullsized":"2024-04-25T10:27:43.283453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780091+0000","last_change":"2024-04-25T10:25:41.236518+0000","last_active":"2024-04-25T10:27:42.780091+0000","last_peered":"2024-04-25T10:27:42.780091+0000","last_clean":"2024-04-25T10:27:42.780091+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:27:42.780091+0000","last_undegraded":"2024-04-25T10:27:42.780091+0000","last_fullsized":"2024-04-25T10:27:42.780091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282642+0000","last_change":"2024-04-25T10:25:37.194114+0000","last_active":"2024-04-25T10:27:43.282642+0000","last_peered":"2024-04-25T10:27:43.282642+0000","last_clean":"2024-04-25T10:27:43.282642+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:27:43.282642+0000","last_undegraded":"2024-04-25T10:27:43.282642+0000","last_fullsized":"2024-04-25T10:27:43.282642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:40.192156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.656892+0000","last_change":"2024-04-25T10:25:36.188266+0000","last_active":"2024-04-25T10:27:54.656892+0000","last_peered":"2024-04-25T10:27:54.656892+0000","last_clean":"2024-04-25T10:27:54.656892+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:27:54.656892+0000","last_undegraded":"2024-04-25T10:27:54.656892+0000","last_fullsized":"2024-04-25T10:27:54.656892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.845953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283091+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:27:43.283091+0000","last_peered":"2024-04-25T10:27:43.283091+0000","last_clean":"2024-04-25T10:27:43.283091+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:27:43.283091+0000","last_undegraded":"2024-04-25T10:27:43.283091+0000","last_fullsized":"2024-04-25T10:27:43.283091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:13.684019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426239+0000","last_change":"2024-04-25T10:25:37.166002+0000","last_active":"2024-04-25T10:27:42.426239+0000","last_peered":"2024-04-25T10:27:42.426239+0000","last_clean":"2024-04-25T10:27:42.426239+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:27:42.426239+0000","last_undegraded":"2024-04-25T10:27:42.426239+0000","last_fullsized":"2024-04-25T10:27:42.426239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279806+0000","last_change":"2024-04-25T10:25:36.168204+0000","last_active":"2024-04-25T10:27:43.279806+0000","last_peered":"2024-04-25T10:27:43.279806+0000","last_clean":"2024-04-25T10:27:43.279806+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:27:43.279806+0000","last_undegraded":"2024-04-25T10:27:43.279806+0000","last_fullsized":"2024-04-25T10:27:43.279806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.907635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195061+0000","last_change":"2024-04-25T10:25:41.257264+0000","last_active":"2024-04-25T10:27:43.195061+0000","last_peered":"2024-04-25T10:27:43.195061+0000","last_clean":"2024-04-25T10:27:43.195061+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:27:43.195061+0000","last_undegraded":"2024-04-25T10:27:43.195061+0000","last_fullsized":"2024-04-25T10:27:43.195061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278490+0000","last_change":"2024-04-25T10:25:37.158884+0000","last_active":"2024-04-25T10:27:43.278490+0000","last_peered":"2024-04-25T10:27:43.278490+0000","last_clean":"2024-04-25T10:27:43.278490+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:27:43.278490+0000","last_undegraded":"2024-04-25T10:27:43.278490+0000","last_fullsized":"2024-04-25T10:27:43.278490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278949+0000","last_change":"2024-04-25T10:25:36.173499+0000","last_active":"2024-04-25T10:27:43.278949+0000","last_peered":"2024-04-25T10:27:43.278949+0000","last_clean":"2024-04-25T10:27:43.278949+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:27:43.278949+0000","last_undegraded":"2024-04-25T10:27:43.278949+0000","last_fullsized":"2024-04-25T10:27:43.278949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426750+0000","last_change":"2024-04-25T10:25:41.239990+0000","last_active":"2024-04-25T10:27:42.426750+0000","last_peered":"2024-04-25T10:27:42.426750+0000","last_clean":"2024-04-25T10:27:42.426750+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:27:42.426750+0000","last_undegraded":"2024-04-25T10:27:42.426750+0000","last_fullsized":"2024-04-25T10:27:42.426750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:15.055786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282179+0000","last_change":"2024-04-25T10:25:37.193560+0000","last_active":"2024-04-25T10:27:43.282179+0000","last_peered":"2024-04-25T10:27:43.282179+0000","last_clean":"2024-04-25T10:27:43.282179+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:27:43.282179+0000","last_undegraded":"2024-04-25T10:27:43.282179+0000","last_fullsized":"2024-04-25T10:27:43.282179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.193166+0000","last_change":"2024-04-25T10:25:36.174077+0000","last_active":"2024-04-25T10:27:43.193166+0000","last_peered":"2024-04-25T10:27:43.193166+0000","last_clean":"2024-04-25T10:27:43.193166+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:27:43.193166+0000","last_undegraded":"2024-04-25T10:27:43.193166+0000","last_fullsized":"2024-04-25T10:27:43.193166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781240+0000","last_change":"2024-04-25T10:25:41.262158+0000","last_active":"2024-04-25T10:27:42.781240+0000","last_peered":"2024-04-25T10:27:42.781240+0000","last_clean":"2024-04-25T10:27:42.781240+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:27:42.781240+0000","last_undegraded":"2024-04-25T10:27:42.781240+0000","last_fullsized":"2024-04-25T10:27:42.781240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279955+0000","last_change":"2024-04-25T10:25:37.159876+0000","last_active":"2024-04-25T10:27:43.279955+0000","last_peered":"2024-04-25T10:27:43.279955+0000","last_clean":"2024-04-25T10:27:43.279955+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:27:43.279955+0000","last_undegraded":"2024-04-25T10:27:43.279955+0000","last_fullsized":"2024-04-25T10:27:43.279955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284548+0000","last_change":"2024-04-25T10:25:36.194275+0000","last_active":"2024-04-25T10:27:43.284548+0000","last_peered":"2024-04-25T10:27:43.284548+0000","last_clean":"2024-04-25T10:27:43.284548+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:27:43.284548+0000","last_undegraded":"2024-04-25T10:27:43.284548+0000","last_fullsized":"2024-04-25T10:27:43.284548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780250+0000","last_change":"2024-04-25T10:25:41.261185+0000","last_active":"2024-04-25T10:27:42.780250+0000","last_peered":"2024-04-25T10:27:42.780250+0000","last_clean":"2024-04-25T10:27:42.780250+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:27:42.780250+0000","last_undegraded":"2024-04-25T10:27:42.780250+0000","last_fullsized":"2024-04-25T10:27:42.780250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280158+0000","last_change":"2024-04-25T10:25:37.165436+0000","last_active":"2024-04-25T10:27:43.280158+0000","last_peered":"2024-04-25T10:27:43.280158+0000","last_clean":"2024-04-25T10:27:43.280158+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:27:43.280158+0000","last_undegraded":"2024-04-25T10:27:43.280158+0000","last_fullsized":"2024-04-25T10:27:43.280158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'11","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.494095+0000","last_change":"2024-04-25T10:25:36.181966+0000","last_active":"2024-04-25T10:28:46.494095+0000","last_peered":"2024-04-25T10:28:46.494095+0000","last_clean":"2024-04-25T10:28:46.494095+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:28:46.494095+0000","last_undegraded":"2024-04-25T10:28:46.494095+0000","last_fullsized":"2024-04-25T10:28:46.494095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278487+0000","last_change":"2024-04-25T10:25:41.246715+0000","last_active":"2024-04-25T10:27:43.278487+0000","last_peered":"2024-04-25T10:27:43.278487+0000","last_clean":"2024-04-25T10:27:43.278487+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:27:43.278487+0000","last_undegraded":"2024-04-25T10:27:43.278487+0000","last_fullsized":"2024-04-25T10:27:43.278487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:03.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280786+0000","last_change":"2024-04-25T10:25:37.170738+0000","last_active":"2024-04-25T10:27:43.280786+0000","last_peered":"2024-04-25T10:27:43.280786+0000","last_clean":"2024-04-25T10:27:43.280786+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:27:43.280786+0000","last_undegraded":"2024-04-25T10:27:43.280786+0000","last_fullsized":"2024-04-25T10:27:43.280786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:43.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284276+0000","last_change":"2024-04-25T10:25:36.186052+0000","last_active":"2024-04-25T10:27:43.284276+0000","last_peered":"2024-04-25T10:27:43.284276+0000","last_clean":"2024-04-25T10:27:43.284276+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:27:43.284276+0000","last_undegraded":"2024-04-25T10:27:43.284276+0000","last_fullsized":"2024-04-25T10:27:43.284276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:42.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279843+0000","last_change":"2024-04-25T10:25:41.244909+0000","last_active":"2024-04-25T10:27:43.279843+0000","last_peered":"2024-04-25T10:27:43.279843+0000","last_clean":"2024-04-25T10:27:43.279843+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:27:43.279843+0000","last_undegraded":"2024-04-25T10:27:43.279843+0000","last_fullsized":"2024-04-25T10:27:43.279843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781028+0000","last_change":"2024-04-25T10:25:37.181614+0000","last_active":"2024-04-25T10:27:42.781028+0000","last_peered":"2024-04-25T10:27:42.781028+0000","last_clean":"2024-04-25T10:27:42.781028+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:27:42.781028+0000","last_undegraded":"2024-04-25T10:27:42.781028+0000","last_fullsized":"2024-04-25T10:27:42.781028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280145+0000","last_change":"2024-04-25T10:25:36.166395+0000","last_active":"2024-04-25T10:27:43.280145+0000","last_peered":"2024-04-25T10:27:43.280145+0000","last_clean":"2024-04-25T10:27:43.280145+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:27:43.280145+0000","last_undegraded":"2024-04-25T10:27:43.280145+0000","last_fullsized":"2024-04-25T10:27:43.280145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279527+0000","last_change":"2024-04-25T10:25:41.237175+0000","last_active":"2024-04-25T10:27:43.279527+0000","last_peered":"2024-04-25T10:27:43.279527+0000","last_clean":"2024-04-25T10:27:43.279527+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:27:43.279527+0000","last_undegraded":"2024-04-25T10:27:43.279527+0000","last_fullsized":"2024-04-25T10:27:43.279527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194409+0000","last_change":"2024-04-25T10:25:37.192638+0000","last_active":"2024-04-25T10:27:43.194409+0000","last_peered":"2024-04-25T10:27:43.194409+0000","last_clean":"2024-04-25T10:27:43.194409+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:27:43.194409+0000","last_undegraded":"2024-04-25T10:27:43.194409+0000","last_fullsized":"2024-04-25T10:27:43.194409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:44.654592+0000","last_change":"2024-04-25T10:25:36.182126+0000","last_active":"2024-04-25T10:27:44.654592+0000","last_peered":"2024-04-25T10:27:44.654592+0000","last_clean":"2024-04-25T10:27:44.654592+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:27:44.654592+0000","last_undegraded":"2024-04-25T10:27:44.654592+0000","last_fullsized":"2024-04-25T10:27:44.654592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:50.385012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280453+0000","last_change":"2024-04-25T10:25:41.247504+0000","last_active":"2024-04-25T10:27:43.280453+0000","last_peered":"2024-04-25T10:27:43.280453+0000","last_clean":"2024-04-25T10:27:43.280453+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:27:43.280453+0000","last_undegraded":"2024-04-25T10:27:43.280453+0000","last_fullsized":"2024-04-25T10:27:43.280453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279226+0000","last_change":"2024-04-25T10:25:37.171962+0000","last_active":"2024-04-25T10:27:43.279226+0000","last_peered":"2024-04-25T10:27:43.279226+0000","last_clean":"2024-04-25T10:27:43.279226+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:27:43.279226+0000","last_undegraded":"2024-04-25T10:27:43.279226+0000","last_fullsized":"2024-04-25T10:27:43.279226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.499878+0000","last_change":"2024-04-25T10:25:36.167914+0000","last_active":"2024-04-25T10:28:46.499878+0000","last_peered":"2024-04-25T10:28:46.499878+0000","last_clean":"2024-04-25T10:28:46.499878+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:28:46.499878+0000","last_undegraded":"2024-04-25T10:28:46.499878+0000","last_fullsized":"2024-04-25T10:28:46.499878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.281110+0000","last_change":"2024-04-25T10:25:41.250414+0000","last_active":"2024-04-25T10:27:43.281110+0000","last_peered":"2024-04-25T10:27:43.281110+0000","last_clean":"2024-04-25T10:27:43.281110+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:27:43.281110+0000","last_undegraded":"2024-04-25T10:27:43.281110+0000","last_fullsized":"2024-04-25T10:27:43.281110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279484+0000","last_change":"2024-04-25T10:25:37.179610+0000","last_active":"2024-04-25T10:27:43.279484+0000","last_peered":"2024-04-25T10:27:43.279484+0000","last_clean":"2024-04-25T10:27:43.279484+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:27:43.279484+0000","last_undegraded":"2024-04-25T10:27:43.279484+0000","last_fullsized":"2024-04-25T10:27:43.279484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:22.862181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.727049+0000","last_change":"2024-04-25T10:25:36.187683+0000","last_active":"2024-04-25T10:28:07.727049+0000","last_peered":"2024-04-25T10:28:07.727049+0000","last_clean":"2024-04-25T10:28:07.727049+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:28:07.727049+0000","last_undegraded":"2024-04-25T10:28:07.727049+0000","last_fullsized":"2024-04-25T10:28:07.727049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279929+0000","last_change":"2024-04-25T10:25:41.239687+0000","last_active":"2024-04-25T10:27:43.279929+0000","last_peered":"2024-04-25T10:27:43.279929+0000","last_clean":"2024-04-25T10:27:43.279929+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:27:43.279929+0000","last_undegraded":"2024-04-25T10:27:43.279929+0000","last_fullsized":"2024-04-25T10:27:43.279929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.061875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278799+0000","last_change":"2024-04-25T10:25:37.172981+0000","last_active":"2024-04-25T10:27:43.278799+0000","last_peered":"2024-04-25T10:27:43.278799+0000","last_clean":"2024-04-25T10:27:43.278799+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:27:43.278799+0000","last_undegraded":"2024-04-25T10:27:43.278799+0000","last_fullsized":"2024-04-25T10:27:43.278799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:44.654627+0000","last_change":"2024-04-25T10:25:36.186586+0000","last_active":"2024-04-25T10:27:44.654627+0000","last_peered":"2024-04-25T10:27:44.654627+0000","last_clean":"2024-04-25T10:27:44.654627+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:27:44.654627+0000","last_undegraded":"2024-04-25T10:27:44.654627+0000","last_fullsized":"2024-04-25T10:27:44.654627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:00.696356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428150+0000","last_change":"2024-04-25T10:25:25.811918+0000","last_active":"2024-04-25T10:27:42.428150+0000","last_peered":"2024-04-25T10:27:42.428150+0000","last_clean":"2024-04-25T10:27:42.428150+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:27:42.428150+0000","last_undegraded":"2024-04-25T10:27:42.428150+0000","last_fullsized":"2024-04-25T10:27:42.428150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_clean_scrub_stamp":"2024-04-25T10:25:24.774439+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:46.603072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283902+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:27:43.283902+0000","last_peered":"2024-04-25T10:27:43.283902+0000","last_clean":"2024-04-25T10:27:43.283902+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:27:43.283902+0000","last_undegraded":"2024-04-25T10:27:43.283902+0000","last_fullsized":"2024-04-25T10:27:43.283902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:56.121358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283710+0000","last_change":"2024-04-25T10:25:37.187670+0000","last_active":"2024-04-25T10:27:43.283710+0000","last_peered":"2024-04-25T10:27:43.283710+0000","last_clean":"2024-04-25T10:27:43.283710+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:27:43.283710+0000","last_undegraded":"2024-04-25T10:27:43.283710+0000","last_fullsized":"2024-04-25T10:27:43.283710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:09.567527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.729957+0000","last_change":"2024-04-25T10:25:36.190434+0000","last_active":"2024-04-25T10:28:07.729957+0000","last_peered":"2024-04-25T10:28:07.729957+0000","last_clean":"2024-04-25T10:28:07.729957+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:28:07.729957+0000","last_undegraded":"2024-04-25T10:28:07.729957+0000","last_fullsized":"2024-04-25T10:28:07.729957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780176+0000","last_change":"2024-04-25T10:25:41.249210+0000","last_active":"2024-04-25T10:27:42.780176+0000","last_peered":"2024-04-25T10:27:42.780176+0000","last_clean":"2024-04-25T10:27:42.780176+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:27:42.780176+0000","last_undegraded":"2024-04-25T10:27:42.780176+0000","last_fullsized":"2024-04-25T10:27:42.780176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195593+0000","last_change":"2024-04-25T10:25:37.176608+0000","last_active":"2024-04-25T10:27:43.195593+0000","last_peered":"2024-04-25T10:27:43.195593+0000","last_clean":"2024-04-25T10:27:43.195593+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:27:43.195593+0000","last_undegraded":"2024-04-25T10:27:43.195593+0000","last_fullsized":"2024-04-25T10:27:43.195593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280330+0000","last_change":"2024-04-25T10:25:36.175833+0000","last_active":"2024-04-25T10:27:43.280330+0000","last_peered":"2024-04-25T10:27:43.280330+0000","last_clean":"2024-04-25T10:27:43.280330+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:27:43.280330+0000","last_undegraded":"2024-04-25T10:27:43.280330+0000","last_fullsized":"2024-04-25T10:27:43.280330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279397+0000","last_change":"2024-04-25T10:25:41.256600+0000","last_active":"2024-04-25T10:27:43.279397+0000","last_peered":"2024-04-25T10:27:43.279397+0000","last_clean":"2024-04-25T10:27:43.279397+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:27:43.279397+0000","last_undegraded":"2024-04-25T10:27:43.279397+0000","last_fullsized":"2024-04-25T10:27:43.279397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195181+0000","last_change":"2024-04-25T10:25:37.185203+0000","last_active":"2024-04-25T10:27:43.195181+0000","last_peered":"2024-04-25T10:27:43.195181+0000","last_clean":"2024-04-25T10:27:43.195181+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:27:43.195181+0000","last_undegraded":"2024-04-25T10:27:43.195181+0000","last_fullsized":"2024-04-25T10:27:43.195181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279990+0000","last_change":"2024-04-25T10:25:36.168542+0000","last_active":"2024-04-25T10:27:43.279990+0000","last_peered":"2024-04-25T10:27:43.279990+0000","last_clean":"2024-04-25T10:27:43.279990+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:27:43.279990+0000","last_undegraded":"2024-04-25T10:27:43.279990+0000","last_fullsized":"2024-04-25T10:27:43.279990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.281759+0000","last_change":"2024-04-25T10:25:41.242053+0000","last_active":"2024-04-25T10:27:43.281759+0000","last_peered":"2024-04-25T10:27:43.281759+0000","last_clean":"2024-04-25T10:27:43.281759+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:27:43.281759+0000","last_undegraded":"2024-04-25T10:27:43.281759+0000","last_fullsized":"2024-04-25T10:27:43.281759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:05.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781697+0000","last_change":"2024-04-25T10:25:37.198952+0000","last_active":"2024-04-25T10:27:42.781697+0000","last_peered":"2024-04-25T10:27:42.781697+0000","last_clean":"2024-04-25T10:27:42.781697+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:27:42.781697+0000","last_undegraded":"2024-04-25T10:27:42.781697+0000","last_fullsized":"2024-04-25T10:27:42.781697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.653232+0000","last_change":"2024-04-25T10:25:36.179694+0000","last_active":"2024-04-25T10:27:54.653232+0000","last_peered":"2024-04-25T10:27:54.653232+0000","last_clean":"2024-04-25T10:27:54.653232+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:27:54.653232+0000","last_undegraded":"2024-04-25T10:27:54.653232+0000","last_fullsized":"2024-04-25T10:27:54.653232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428298+0000","last_change":"2024-04-25T10:25:41.251379+0000","last_active":"2024-04-25T10:27:42.428298+0000","last_peered":"2024-04-25T10:27:42.428298+0000","last_clean":"2024-04-25T10:27:42.428298+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:27:42.428298+0000","last_undegraded":"2024-04-25T10:27:42.428298+0000","last_fullsized":"2024-04-25T10:27:42.428298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:47.690188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282183+0000","last_change":"2024-04-25T10:25:37.202390+0000","last_active":"2024-04-25T10:27:43.282183+0000","last_peered":"2024-04-25T10:27:43.282183+0000","last_clean":"2024-04-25T10:27:43.282183+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:27:43.282183+0000","last_undegraded":"2024-04-25T10:27:43.282183+0000","last_fullsized":"2024-04-25T10:27:43.282183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'16","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.731880+0000","last_change":"2024-04-25T10:25:36.154879+0000","last_active":"2024-04-25T10:28:07.731880+0000","last_peered":"2024-04-25T10:28:07.731880+0000","last_clean":"2024-04-25T10:28:07.731880+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:28:07.731880+0000","last_undegraded":"2024-04-25T10:28:07.731880+0000","last_fullsized":"2024-04-25T10:28:07.731880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280514+0000","last_change":"2024-04-25T10:25:41.239631+0000","last_active":"2024-04-25T10:27:43.280514+0000","last_peered":"2024-04-25T10:27:43.280514+0000","last_clean":"2024-04-25T10:27:43.280514+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:27:43.280514+0000","last_undegraded":"2024-04-25T10:27:43.280514+0000","last_fullsized":"2024-04-25T10:27:43.280514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.684623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428678+0000","last_change":"2024-04-25T10:25:37.181525+0000","last_active":"2024-04-25T10:27:42.428678+0000","last_peered":"2024-04-25T10:27:42.428678+0000","last_clean":"2024-04-25T10:27:42.428678+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:27:42.428678+0000","last_undegraded":"2024-04-25T10:27:42.428678+0000","last_fullsized":"2024-04-25T10:27:42.428678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:47.435073+0000","last_change":"2024-04-25T10:25:36.192797+0000","last_active":"2024-04-25T10:27:47.435073+0000","last_peered":"2024-04-25T10:27:47.435073+0000","last_clean":"2024-04-25T10:27:47.435073+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:27:47.435073+0000","last_undegraded":"2024-04-25T10:27:47.435073+0000","last_fullsized":"2024-04-25T10:27:47.435073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280869+0000","last_change":"2024-04-25T10:25:41.244618+0000","last_active":"2024-04-25T10:27:43.280869+0000","last_peered":"2024-04-25T10:27:43.280869+0000","last_clean":"2024-04-25T10:27:43.280869+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:27:43.280869+0000","last_undegraded":"2024-04-25T10:27:43.280869+0000","last_fullsized":"2024-04-25T10:27:43.280869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:13.625947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284116+0000","last_change":"2024-04-25T10:25:37.208984+0000","last_active":"2024-04-25T10:27:43.284116+0000","last_peered":"2024-04-25T10:27:43.284116+0000","last_clean":"2024-04-25T10:27:43.284116+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:27:43.284116+0000","last_undegraded":"2024-04-25T10:27:43.284116+0000","last_fullsized":"2024-04-25T10:27:43.284116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.658061+0000","last_change":"2024-04-25T10:25:36.185689+0000","last_active":"2024-04-25T10:27:59.658061+0000","last_peered":"2024-04-25T10:27:59.658061+0000","last_clean":"2024-04-25T10:27:59.658061+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:27:59.658061+0000","last_undegraded":"2024-04-25T10:27:59.658061+0000","last_fullsized":"2024-04-25T10:27:59.658061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:35.671970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280314+0000","last_change":"2024-04-25T10:25:41.247314+0000","last_active":"2024-04-25T10:27:43.280314+0000","last_peered":"2024-04-25T10:27:43.280314+0000","last_clean":"2024-04-25T10:27:43.280314+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:27:43.280314+0000","last_undegraded":"2024-04-25T10:27:43.280314+0000","last_fullsized":"2024-04-25T10:27:43.280314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279734+0000","last_change":"2024-04-25T10:25:37.193696+0000","last_active":"2024-04-25T10:27:43.279734+0000","last_peered":"2024-04-25T10:27:43.279734+0000","last_clean":"2024-04-25T10:27:43.279734+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:27:43.279734+0000","last_undegraded":"2024-04-25T10:27:43.279734+0000","last_fullsized":"2024-04-25T10:27:43.279734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.728571+0000","last_change":"2024-04-25T10:25:36.181843+0000","last_active":"2024-04-25T10:28:07.728571+0000","last_peered":"2024-04-25T10:28:07.728571+0000","last_clean":"2024-04-25T10:28:07.728571+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:28:07.728571+0000","last_undegraded":"2024-04-25T10:28:07.728571+0000","last_fullsized":"2024-04-25T10:28:07.728571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283282+0000","last_change":"2024-04-25T10:25:41.247061+0000","last_active":"2024-04-25T10:27:43.283282+0000","last_peered":"2024-04-25T10:27:43.283282+0000","last_clean":"2024-04-25T10:27:43.283282+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:27:43.283282+0000","last_undegraded":"2024-04-25T10:27:43.283282+0000","last_fullsized":"2024-04-25T10:27:43.283282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.491573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195370+0000","last_change":"2024-04-25T10:25:37.185402+0000","last_active":"2024-04-25T10:27:43.195370+0000","last_peered":"2024-04-25T10:27:43.195370+0000","last_clean":"2024-04-25T10:27:43.195370+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:27:43.195370+0000","last_undegraded":"2024-04-25T10:27:43.195370+0000","last_fullsized":"2024-04-25T10:27:43.195370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'23","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.497836+0000","last_change":"2024-04-25T10:25:36.166998+0000","last_active":"2024-04-25T10:28:46.497836+0000","last_peered":"2024-04-25T10:28:46.497836+0000","last_clean":"2024-04-25T10:28:46.497836+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:28:46.497836+0000","last_undegraded":"2024-04-25T10:28:46.497836+0000","last_fullsized":"2024-04-25T10:28:46.497836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:25.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33043,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:43.157048+0000","last_change":"2024-04-25T10:25:41.248522+0000","last_active":"2024-04-25T10:28:43.157048+0000","last_peered":"2024-04-25T10:28:43.157048+0000","last_clean":"2024-04-25T10:28:43.157048+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:28:43.157048+0000","last_undegraded":"2024-04-25T10:28:43.157048+0000","last_fullsized":"2024-04-25T10:28:43.157048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:51.139406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282916+0000","last_change":"2024-04-25T10:25:37.196588+0000","last_active":"2024-04-25T10:27:43.282916+0000","last_peered":"2024-04-25T10:27:43.282916+0000","last_clean":"2024-04-25T10:27:43.282916+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:27:43.282916+0000","last_undegraded":"2024-04-25T10:27:43.282916+0000","last_fullsized":"2024-04-25T10:27:43.282916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:00.003456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.494929+0000","last_change":"2024-04-25T10:25:36.156630+0000","last_active":"2024-04-25T10:28:46.494929+0000","last_peered":"2024-04-25T10:28:46.494929+0000","last_clean":"2024-04-25T10:28:46.494929+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:28:46.494929+0000","last_undegraded":"2024-04-25T10:28:46.494929+0000","last_fullsized":"2024-04-25T10:28:46.494929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780922+0000","last_change":"2024-04-25T10:26:18.708803+0000","last_active":"2024-04-25T10:27:42.780922+0000","last_peered":"2024-04-25T10:27:42.780922+0000","last_clean":"2024-04-25T10:27:42.780922+0000","last_became_active":"2024-04-25T10:26:18.708320+0000","last_became_peered":"2024-04-25T10:26:18.708320+0000","last_unstale":"2024-04-25T10:27:42.780922+0000","last_undegraded":"2024-04-25T10:27:42.780922+0000","last_fullsized":"2024-04-25T10:27:42.780922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:09.714453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,7],"acting":[2,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280982+0000","last_change":"2024-04-25T10:25:37.187575+0000","last_active":"2024-04-25T10:27:43.280982+0000","last_peered":"2024-04-25T10:27:43.280982+0000","last_clean":"2024-04-25T10:27:43.280982+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:27:43.280982+0000","last_undegraded":"2024-04-25T10:27:43.280982+0000","last_fullsized":"2024-04-25T10:27:43.280982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194905+0000","last_change":"2024-04-25T10:25:36.183582+0000","last_active":"2024-04-25T10:27:43.194905+0000","last_peered":"2024-04-25T10:27:43.194905+0000","last_clean":"2024-04-25T10:27:43.194905+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:27:43.194905+0000","last_undegraded":"2024-04-25T10:27:43.194905+0000","last_fullsized":"2024-04-25T10:27:43.194905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.425916+0000","last_change":"2024-04-25T10:25:41.238488+0000","last_active":"2024-04-25T10:27:42.425916+0000","last_peered":"2024-04-25T10:27:42.425916+0000","last_clean":"2024-04-25T10:27:42.425916+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:27:42.425916+0000","last_undegraded":"2024-04-25T10:27:42.425916+0000","last_fullsized":"2024-04-25T10:27:42.425916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:05.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781685+0000","last_change":"2024-04-25T10:25:37.192707+0000","last_active":"2024-04-25T10:27:42.781685+0000","last_peered":"2024-04-25T10:27:42.781685+0000","last_clean":"2024-04-25T10:27:42.781685+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:27:42.781685+0000","last_undegraded":"2024-04-25T10:27:42.781685+0000","last_fullsized":"2024-04-25T10:27:42.781685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:04.655214+0000","last_change":"2024-04-25T10:25:36.173755+0000","last_active":"2024-04-25T10:28:04.655214+0000","last_peered":"2024-04-25T10:28:04.655214+0000","last_clean":"2024-04-25T10:28:04.655214+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:28:04.655214+0000","last_undegraded":"2024-04-25T10:28:04.655214+0000","last_fullsized":"2024-04-25T10:28:04.655214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278627+0000","last_change":"2024-04-25T10:25:41.248983+0000","last_active":"2024-04-25T10:27:43.278627+0000","last_peered":"2024-04-25T10:27:43.278627+0000","last_clean":"2024-04-25T10:27:43.278627+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:27:43.278627+0000","last_undegraded":"2024-04-25T10:27:43.278627+0000","last_fullsized":"2024-04-25T10:27:43.278627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.880608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279809+0000","last_change":"2024-04-25T10:25:41.246692+0000","last_active":"2024-04-25T10:27:43.279809+0000","last_peered":"2024-04-25T10:27:43.279809+0000","last_clean":"2024-04-25T10:27:43.279809+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:27:43.279809+0000","last_undegraded":"2024-04-25T10:27:43.279809+0000","last_fullsized":"2024-04-25T10:27:43.279809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:44.250576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278814+0000","last_change":"2024-04-25T10:25:37.178691+0000","last_active":"2024-04-25T10:27:43.278814+0000","last_peered":"2024-04-25T10:27:43.278814+0000","last_clean":"2024-04-25T10:27:43.278814+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:27:43.278814+0000","last_undegraded":"2024-04-25T10:27:43.278814+0000","last_fullsized":"2024-04-25T10:27:43.278814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282596+0000","last_change":"2024-04-25T10:25:36.191338+0000","last_active":"2024-04-25T10:27:43.282596+0000","last_peered":"2024-04-25T10:27:43.282596+0000","last_clean":"2024-04-25T10:27:43.282596+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:27:43.282596+0000","last_undegraded":"2024-04-25T10:27:43.282596+0000","last_fullsized":"2024-04-25T10:27:43.282596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283891+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:27:43.283891+0000","last_peered":"2024-04-25T10:27:43.283891+0000","last_clean":"2024-04-25T10:27:43.283891+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:27:43.283891+0000","last_undegraded":"2024-04-25T10:27:43.283891+0000","last_fullsized":"2024-04-25T10:27:43.283891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:21.254459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279373+0000","last_change":"2024-04-25T10:25:37.170931+0000","last_active":"2024-04-25T10:27:43.279373+0000","last_peered":"2024-04-25T10:27:43.279373+0000","last_clean":"2024-04-25T10:27:43.279373+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:27:43.279373+0000","last_undegraded":"2024-04-25T10:27:43.279373+0000","last_fullsized":"2024-04-25T10:27:43.279373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.731321+0000","last_change":"2024-04-25T10:25:36.173721+0000","last_active":"2024-04-25T10:28:07.731321+0000","last_peered":"2024-04-25T10:28:07.731321+0000","last_clean":"2024-04-25T10:28:07.731321+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:28:07.731321+0000","last_undegraded":"2024-04-25T10:28:07.731321+0000","last_fullsized":"2024-04-25T10:28:07.731321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:42.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.738163+0000","last_change":"2024-04-25T10:25:36.195499+0000","last_active":"2024-04-25T10:28:07.738163+0000","last_peered":"2024-04-25T10:28:07.738163+0000","last_clean":"2024-04-25T10:28:07.738163+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:28:07.738163+0000","last_undegraded":"2024-04-25T10:28:07.738163+0000","last_fullsized":"2024-04-25T10:28:07.738163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:05.600702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278821+0000","last_change":"2024-04-25T10:25:37.180896+0000","last_active":"2024-04-25T10:27:43.278821+0000","last_peered":"2024-04-25T10:27:43.278821+0000","last_clean":"2024-04-25T10:27:43.278821+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:27:43.278821+0000","last_undegraded":"2024-04-25T10:27:43.278821+0000","last_fullsized":"2024-04-25T10:27:43.278821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279711+0000","last_change":"2024-04-25T10:25:41.231793+0000","last_active":"2024-04-25T10:27:43.279711+0000","last_peered":"2024-04-25T10:27:43.279711+0000","last_clean":"2024-04-25T10:27:43.279711+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:27:43.279711+0000","last_undegraded":"2024-04-25T10:27:43.279711+0000","last_fullsized":"2024-04-25T10:27:43.279711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:33.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279659+0000","last_change":"2024-04-25T10:25:36.166742+0000","last_active":"2024-04-25T10:27:43.279659+0000","last_peered":"2024-04-25T10:27:43.279659+0000","last_clean":"2024-04-25T10:27:43.279659+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:27:43.279659+0000","last_undegraded":"2024-04-25T10:27:43.279659+0000","last_fullsized":"2024-04-25T10:27:43.279659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428380+0000","last_change":"2024-04-25T10:25:37.185699+0000","last_active":"2024-04-25T10:27:42.428380+0000","last_peered":"2024-04-25T10:27:42.428380+0000","last_clean":"2024-04-25T10:27:42.428380+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:27:42.428380+0000","last_undegraded":"2024-04-25T10:27:42.428380+0000","last_fullsized":"2024-04-25T10:27:42.428380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426354+0000","last_change":"2024-04-25T10:25:41.258191+0000","last_active":"2024-04-25T10:27:42.426354+0000","last_peered":"2024-04-25T10:27:42.426354+0000","last_clean":"2024-04-25T10:27:42.426354+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:27:42.426354+0000","last_undegraded":"2024-04-25T10:27:42.426354+0000","last_fullsized":"2024-04-25T10:27:42.426354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.479785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780838+0000","last_change":"2024-04-25T10:25:37.183192+0000","last_active":"2024-04-25T10:27:42.780838+0000","last_peered":"2024-04-25T10:27:42.780838+0000","last_clean":"2024-04-25T10:27:42.780838+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:27:42.780838+0000","last_undegraded":"2024-04-25T10:27:42.780838+0000","last_fullsized":"2024-04-25T10:27:42.780838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426068+0000","last_change":"2024-04-25T10:25:37.180242+0000","last_active":"2024-04-25T10:27:42.426068+0000","last_peered":"2024-04-25T10:27:42.426068+0000","last_clean":"2024-04-25T10:27:42.426068+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:27:42.426068+0000","last_undegraded":"2024-04-25T10:27:42.426068+0000","last_fullsized":"2024-04-25T10:27:42.426068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282478+0000","last_change":"2024-04-25T10:25:37.187312+0000","last_active":"2024-04-25T10:27:43.282478+0000","last_peered":"2024-04-25T10:27:43.282478+0000","last_clean":"2024-04-25T10:27:43.282478+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:27:43.282478+0000","last_undegraded":"2024-04-25T10:27:43.282478+0000","last_fullsized":"2024-04-25T10:27:43.282478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:22.595222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279529+0000","last_change":"2024-04-25T10:25:37.166351+0000","last_active":"2024-04-25T10:27:43.279529+0000","last_peered":"2024-04-25T10:27:43.279529+0000","last_clean":"2024-04-25T10:27:43.279529+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:27:43.279529+0000","last_undegraded":"2024-04-25T10:27:43.279529+0000","last_fullsized":"2024-04-25T10:27:43.279529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280670+0000","last_change":"2024-04-25T10:26:18.699084+0000","last_active":"2024-04-25T10:27:43.280670+0000","last_peered":"2024-04-25T10:27:43.280670+0000","last_clean":"2024-04-25T10:27:43.280670+0000","last_became_active":"2024-04-25T10:26:18.698625+0000","last_became_peered":"2024-04-25T10:26:18.698625+0000","last_unstale":"2024-04-25T10:27:43.280670+0000","last_undegraded":"2024-04-25T10:27:43.280670+0000","last_fullsized":"2024-04-25T10:27:43.280670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:44.112645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.281198+0000","last_change":"2024-04-25T10:25:37.170647+0000","last_active":"2024-04-25T10:27:43.281198+0000","last_peered":"2024-04-25T10:27:43.281198+0000","last_clean":"2024-04-25T10:27:43.281198+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:27:43.281198+0000","last_undegraded":"2024-04-25T10:27:43.281198+0000","last_fullsized":"2024-04-25T10:27:43.281198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781292+0000","last_change":"2024-04-25T10:25:37.196676+0000","last_active":"2024-04-25T10:27:42.781292+0000","last_peered":"2024-04-25T10:27:42.781292+0000","last_clean":"2024-04-25T10:27:42.781292+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:27:42.781292+0000","last_undegraded":"2024-04-25T10:27:42.781292+0000","last_fullsized":"2024-04-25T10:27:42.781292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280807+0000","last_change":"2024-04-25T10:25:37.186567+0000","last_active":"2024-04-25T10:27:43.280807+0000","last_peered":"2024-04-25T10:27:43.280807+0000","last_clean":"2024-04-25T10:27:43.280807+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:27:43.280807+0000","last_undegraded":"2024-04-25T10:27:43.280807+0000","last_fullsized":"2024-04-25T10:27:43.280807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282553+0000","last_change":"2024-04-25T10:25:37.184887+0000","last_active":"2024-04-25T10:27:43.282553+0000","last_peered":"2024-04-25T10:27:43.282553+0000","last_clean":"2024-04-25T10:27:43.282553+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:27:43.282553+0000","last_undegraded":"2024-04-25T10:27:43.282553+0000","last_fullsized":"2024-04-25T10:27:43.282553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279191+0000","last_change":"2024-04-25T10:25:37.196649+0000","last_active":"2024-04-25T10:27:43.279191+0000","last_peered":"2024-04-25T10:27:43.279191+0000","last_clean":"2024-04-25T10:27:43.279191+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:27:43.279191+0000","last_undegraded":"2024-04-25T10:27:43.279191+0000","last_fullsized":"2024-04-25T10:27:43.279191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428204+0000","last_change":"2024-04-25T10:25:37.192093+0000","last_active":"2024-04-25T10:27:42.428204+0000","last_peered":"2024-04-25T10:27:42.428204+0000","last_clean":"2024-04-25T10:27:42.428204+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:27:42.428204+0000","last_undegraded":"2024-04-25T10:27:42.428204+0000","last_fullsized":"2024-04-25T10:27:42.428204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278653+0000","last_change":"2024-04-25T10:25:37.184014+0000","last_active":"2024-04-25T10:27:43.278653+0000","last_peered":"2024-04-25T10:27:43.278653+0000","last_clean":"2024-04-25T10:27:43.278653+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:27:43.278653+0000","last_undegraded":"2024-04-25T10:27:43.278653+0000","last_fullsized":"2024-04-25T10:27:43.278653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:52.810612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195111+0000","last_change":"2024-04-25T10:25:37.187384+0000","last_active":"2024-04-25T10:27:43.195111+0000","last_peered":"2024-04-25T10:27:43.195111+0000","last_clean":"2024-04-25T10:27:43.195111+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:27:43.195111+0000","last_undegraded":"2024-04-25T10:27:43.195111+0000","last_fullsized":"2024-04-25T10:27:43.195111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284184+0000","last_change":"2024-04-25T10:25:37.195712+0000","last_active":"2024-04-25T10:27:43.284184+0000","last_peered":"2024-04-25T10:27:43.284184+0000","last_clean":"2024-04-25T10:27:43.284184+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:27:43.284184+0000","last_undegraded":"2024-04-25T10:27:43.284184+0000","last_fullsized":"2024-04-25T10:27:43.284184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:13.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426883+0000","last_change":"2024-04-25T10:25:37.198664+0000","last_active":"2024-04-25T10:27:42.426883+0000","last_peered":"2024-04-25T10:27:42.426883+0000","last_clean":"2024-04-25T10:27:42.426883+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:27:42.426883+0000","last_undegraded":"2024-04-25T10:27:42.426883+0000","last_fullsized":"2024-04-25T10:27:42.426883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284482+0000","last_change":"2024-04-25T10:25:37.203174+0000","last_active":"2024-04-25T10:27:43.284482+0000","last_peered":"2024-04-25T10:27:43.284482+0000","last_clean":"2024-04-25T10:27:43.284482+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:27:43.284482+0000","last_undegraded":"2024-04-25T10:27:43.284482+0000","last_fullsized":"2024-04-25T10:27:43.284482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:05.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282160+0000","last_change":"2024-04-25T10:25:37.199911+0000","last_active":"2024-04-25T10:27:43.282160+0000","last_peered":"2024-04-25T10:27:43.282160+0000","last_clean":"2024-04-25T10:27:43.282160+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:27:43.282160+0000","last_undegraded":"2024-04-25T10:27:43.282160+0000","last_fullsized":"2024-04-25T10:27:43.282160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:29.272654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278998+0000","last_change":"2024-04-25T10:25:37.177405+0000","last_active":"2024-04-25T10:27:43.278998+0000","last_peered":"2024-04-25T10:27:43.278998+0000","last_clean":"2024-04-25T10:27:43.278998+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:27:43.278998+0000","last_undegraded":"2024-04-25T10:27:43.278998+0000","last_fullsized":"2024-04-25T10:27:43.278998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.634145+0000","last_change":"2024-04-25T10:25:37.167752+0000","last_active":"2024-04-25T10:27:59.634145+0000","last_peered":"2024-04-25T10:27:59.634145+0000","last_clean":"2024-04-25T10:27:59.634145+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:27:59.634145+0000","last_undegraded":"2024-04-25T10:27:59.634145+0000","last_fullsized":"2024-04-25T10:27:59.634145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280308+0000","last_change":"2024-04-25T10:25:37.180781+0000","last_active":"2024-04-25T10:27:43.280308+0000","last_peered":"2024-04-25T10:27:43.280308+0000","last_clean":"2024-04-25T10:27:43.280308+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:27:43.280308+0000","last_undegraded":"2024-04-25T10:27:43.280308+0000","last_fullsized":"2024-04-25T10:27:43.280308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194792+0000","last_change":"2024-04-25T10:25:37.192759+0000","last_active":"2024-04-25T10:27:43.194792+0000","last_peered":"2024-04-25T10:27:43.194792+0000","last_clean":"2024-04-25T10:27:43.194792+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:27:43.194792+0000","last_undegraded":"2024-04-25T10:27:43.194792+0000","last_fullsized":"2024-04-25T10:27:43.194792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195256+0000","last_change":"2024-04-25T10:25:37.195532+0000","last_active":"2024-04-25T10:27:43.195256+0000","last_peered":"2024-04-25T10:27:43.195256+0000","last_clean":"2024-04-25T10:27:43.195256+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:27:43.195256+0000","last_undegraded":"2024-04-25T10:27:43.195256+0000","last_fullsized":"2024-04-25T10:27:43.195256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194446+0000","last_change":"2024-04-25T10:25:37.200331+0000","last_active":"2024-04-25T10:27:43.194446+0000","last_peered":"2024-04-25T10:27:43.194446+0000","last_clean":"2024-04-25T10:27:43.194446+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:27:43.194446+0000","last_undegraded":"2024-04-25T10:27:43.194446+0000","last_fullsized":"2024-04-25T10:27:43.194446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.429870+0000","last_change":"2024-04-25T10:25:37.194514+0000","last_active":"2024-04-25T10:27:42.429870+0000","last_peered":"2024-04-25T10:27:42.429870+0000","last_clean":"2024-04-25T10:27:42.429870+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:27:42.429870+0000","last_undegraded":"2024-04-25T10:27:42.429870+0000","last_fullsized":"2024-04-25T10:27:42.429870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279230+0000","last_change":"2024-04-25T10:25:37.177730+0000","last_active":"2024-04-25T10:27:43.279230+0000","last_peered":"2024-04-25T10:27:43.279230+0000","last_clean":"2024-04-25T10:27:43.279230+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:27:43.279230+0000","last_undegraded":"2024-04-25T10:27:43.279230+0000","last_fullsized":"2024-04-25T10:27:43.279230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.193851+0000","last_change":"2024-04-25T10:25:37.173419+0000","last_active":"2024-04-25T10:27:43.193851+0000","last_peered":"2024-04-25T10:27:43.193851+0000","last_clean":"2024-04-25T10:27:43.193851+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:27:43.193851+0000","last_undegraded":"2024-04-25T10:27:43.193851+0000","last_fullsized":"2024-04-25T10:27:43.193851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780611+0000","last_change":"2024-04-25T10:25:37.182871+0000","last_active":"2024-04-25T10:27:42.780611+0000","last_peered":"2024-04-25T10:27:42.780611+0000","last_clean":"2024-04-25T10:27:42.780611+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:27:42.780611+0000","last_undegraded":"2024-04-25T10:27:42.780611+0000","last_fullsized":"2024-04-25T10:27:42.780611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194479+0000","last_change":"2024-04-25T10:25:37.173983+0000","last_active":"2024-04-25T10:27:43.194479+0000","last_peered":"2024-04-25T10:27:43.194479+0000","last_clean":"2024-04-25T10:27:43.194479+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:27:43.194479+0000","last_undegraded":"2024-04-25T10:27:43.194479+0000","last_fullsized":"2024-04-25T10:27:43.194479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781241+0000","last_change":"2024-04-25T10:25:37.182178+0000","last_active":"2024-04-25T10:27:42.781241+0000","last_peered":"2024-04-25T10:27:42.781241+0000","last_clean":"2024-04-25T10:27:42.781241+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:27:42.781241+0000","last_undegraded":"2024-04-25T10:27:42.781241+0000","last_fullsized":"2024-04-25T10:27:42.781241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280171+0000","last_change":"2024-04-25T10:25:37.170383+0000","last_active":"2024-04-25T10:27:43.280171+0000","last_peered":"2024-04-25T10:27:43.280171+0000","last_clean":"2024-04-25T10:27:43.280171+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:27:43.280171+0000","last_undegraded":"2024-04-25T10:27:43.280171+0000","last_fullsized":"2024-04-25T10:27:43.280171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280501+0000","last_change":"2024-04-25T10:25:37.167687+0000","last_active":"2024-04-25T10:27:43.280501+0000","last_peered":"2024-04-25T10:27:43.280501+0000","last_clean":"2024-04-25T10:27:43.280501+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:27:43.280501+0000","last_undegraded":"2024-04-25T10:27:43.280501+0000","last_fullsized":"2024-04-25T10:27:43.280501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195171+0000","last_change":"2024-04-25T10:25:37.196591+0000","last_active":"2024-04-25T10:27:43.195171+0000","last_peered":"2024-04-25T10:27:43.195171+0000","last_clean":"2024-04-25T10:27:43.195171+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:27:43.195171+0000","last_undegraded":"2024-04-25T10:27:43.195171+0000","last_fullsized":"2024-04-25T10:27:43.195171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":36863,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":75,"num_read_kb":78,"num_write":160,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":73726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":121998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":712262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":155491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":153957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":892928,"data_stored":711408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":33077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":34611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:28:50.826 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:28:51.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.145+0000 7f2c4e200640 1 Processor -- start 2024-04-25T10:28:51.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.146+0000 7f2c4e200640 1 -- start start 2024-04-25T10:28:51.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.148+0000 7f2c4e200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c4815a370 0x7f2c48070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.148+0000 7f2c4e200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2c480c7f90 0x7f2c48073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.148+0000 7f2c4e200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c480cac80 0x7f2c48073b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.148+0000 7f2c4e200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f2c48072ea0 con 0x7f2c480c7f90 2024-04-25T10:28:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.148+0000 7f2c4e200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2c48073180 con 0x7f2c480cac80 2024-04-25T10:28:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.148+0000 7f2c4e200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4815a8b0 con 0x7f2c4815a370 2024-04-25T10:28:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c4d800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c480cac80 0x7f2c48073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c4ce00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c4815a370 0x7f2c48070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c47e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2c480c7f90 0x7f2c48073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c4d800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c480cac80 0x7f2c48073b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:55768/0 (socket says 172.21.15.19:55768) 2024-04-25T10:28:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c4d800640 1 -- 172.21.15.19:0/988132232 learned_addr learned my addr 172.21.15.19:0/988132232 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c4ce00640 1 --2- 172.21.15.19:0/988132232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c4815a370 0x7f2c48070860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:48270/0 (socket says 172.21.15.19:48270) 2024-04-25T10:28:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c4d800640 1 -- 172.21.15.19:0/988132232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c4815a370 msgr2=0x7f2c48070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c4d800640 1 --2- 172.21.15.19:0/988132232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c4815a370 0x7f2c48070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c4d800640 1 -- 172.21.15.19:0/988132232 >> v2:172.21.15.19:3300/0 conn(0x7f2c480c7f90 msgr2=0x7f2c48073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c4d800640 1 --2- 172.21.15.19:0/988132232 >> v2:172.21.15.19:3300/0 conn(0x7f2c480c7f90 0x7f2c48073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c4d800640 1 -- 172.21.15.19:0/988132232 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4815ab70 con 0x7f2c480cac80 2024-04-25T10:28:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.149+0000 7f2c4ce00640 1 --2- 172.21.15.19:0/988132232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c4815a370 0x7f2c48070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.150+0000 7f2c4d800640 1 --2- 172.21.15.19:0/988132232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c480cac80 0x7f2c48073b50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2c4815e980 tx=0x7f2c4002a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f103bd77150c72c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.151+0000 7f2c47400640 1 -- 172.21.15.19:0/988132232 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40036070 con 0x7f2c480cac80 2024-04-25T10:28:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.151+0000 7f2c47400640 1 -- 172.21.15.19:0/988132232 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40031600 con 0x7f2c480cac80 2024-04-25T10:28:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.151+0000 7f2c47400640 1 -- 172.21.15.19:0/988132232 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c400319d0 con 0x7f2c480cac80 2024-04-25T10:28:51.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.152+0000 7f2c4e200640 1 -- 172.21.15.19:0/988132232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c480cac80 msgr2=0x7f2c48073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.152+0000 7f2c4e200640 1 --2- 172.21.15.19:0/988132232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c480cac80 0x7f2c48073b50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2c4815e980 tx=0x7f2c4002a610 comp rx=0 tx=0).stop 2024-04-25T10:28:51.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.152+0000 7f2c4e200640 1 -- 172.21.15.19:0/988132232 shutdown_connections 2024-04-25T10:28:51.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.152+0000 7f2c4e200640 1 --2- 172.21.15.19:0/988132232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c480cac80 0x7f2c48073b50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.152+0000 7f2c4e200640 1 --2- 172.21.15.19:0/988132232 >> v2:172.21.15.19:3300/0 conn(0x7f2c480c7f90 0x7f2c48073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.152+0000 7f2c4e200640 1 --2- 172.21.15.19:0/988132232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c4815a370 0x7f2c48070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.152+0000 7f2c4e200640 1 -- 172.21.15.19:0/988132232 >> 172.21.15.19:0/988132232 conn(0x7f2c480cdbc0 msgr2=0x7f2c480ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.152+0000 7f2c4e200640 1 -- 172.21.15.19:0/988132232 shutdown_connections 2024-04-25T10:28:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.152+0000 7f2c4e200640 1 -- 172.21.15.19:0/988132232 wait complete. 2024-04-25T10:28:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.154+0000 7f2c4e200640 1 Processor -- start 2024-04-25T10:28:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.155+0000 7f2c4e200640 1 -- start start 2024-04-25T10:28:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.156+0000 7f2c4e200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c480c7f90 0x7f2c481f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.156+0000 7f2c4e200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c480cac80 0x7f2c480cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.156+0000 7f2c4e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c4815a370 0x7f2c4814f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.156+0000 7f2c4e200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c480c4b20 con 0x7f2c480c7f90 2024-04-25T10:28:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.156+0000 7f2c4e200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4815b130 con 0x7f2c4815a370 2024-04-25T10:28:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.156+0000 7f2c4e200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2c48070da0 con 0x7f2c480cac80 2024-04-25T10:28:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.156+0000 7f2c4d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c4815a370 0x7f2c4814f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.157+0000 7f2c47e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c480cac80 0x7f2c480cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.157+0000 7f2c4d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c4815a370 0x7f2c4814f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:55782/0 (socket says 172.21.15.19:55782) 2024-04-25T10:28:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.157+0000 7f2c4d800640 1 -- 172.21.15.19:0/2108441005 learned_addr learned my addr 172.21.15.19:0/2108441005 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.157+0000 7f2c4ce00640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c480c7f90 0x7f2c481f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.157+0000 7f2c4d800640 1 -- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c480cac80 msgr2=0x7f2c480cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.157+0000 7f2c4d800640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c480cac80 0x7f2c480cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.157+0000 7f2c4d800640 1 -- 172.21.15.19:0/2108441005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c480c7f90 msgr2=0x7f2c481f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.157+0000 7f2c4d800640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c480c7f90 0x7f2c481f61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.157+0000 7f2c4d800640 1 -- 172.21.15.19:0/2108441005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c48157780 con 0x7f2c4815a370 2024-04-25T10:28:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.157+0000 7f2c4d800640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c4815a370 0x7f2c4814f1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c4002ac00 tx=0x7f2c40004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.158+0000 7f2c44c00640 1 -- 172.21.15.19:0/2108441005 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40036050 con 0x7f2c4815a370 2024-04-25T10:28:51.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.158+0000 7f2c44c00640 1 -- 172.21.15.19:0/2108441005 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40042070 con 0x7f2c4815a370 2024-04-25T10:28:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.158+0000 7f2c44c00640 1 -- 172.21.15.19:0/2108441005 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40009510 con 0x7f2c4815a370 2024-04-25T10:28:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.158+0000 7f2c4e200640 1 -- 172.21.15.19:0/2108441005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c481f6710 con 0x7f2c4815a370 2024-04-25T10:28:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.158+0000 7f2c4e200640 1 -- 172.21.15.19:0/2108441005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c481f59d0 con 0x7f2c4815a370 2024-04-25T10:28:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.159+0000 7f2c4e200640 1 -- 172.21.15.19:0/2108441005 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c48050740 con 0x7f2c4815a370 2024-04-25T10:28:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.160+0000 7f2c44c00640 1 -- 172.21.15.19:0/2108441005 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2c40007c50 con 0x7f2c4815a370 2024-04-25T10:28:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.161+0000 7f2c44c00640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2c280744e0 0x7f2c280769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.161+0000 7f2c44c00640 1 -- 172.21.15.19:0/2108441005 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f2c400b5c30 con 0x7f2c4815a370 2024-04-25T10:28:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.161+0000 7f2c4ce00640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2c280744e0 0x7f2c280769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.162+0000 7f2c4ce00640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2c280744e0 0x7f2c280769f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009560 tx=0x7f2c3c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:51.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.166+0000 7f2c44c00640 1 -- 172.21.15.19:0/2108441005 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c4004b020 con 0x7f2c4815a370 2024-04-25T10:28:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.370+0000 7f2c4e200640 1 -- 172.21.15.19:0/2108441005 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c480c59e0 con 0x7f2c280744e0 2024-04-25T10:28:51.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.381+0000 7f2c44c00640 1 -- 172.21.15.19:0/2108441005 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332692 (secure 0 0 0) 0x7f2c480c59e0 con 0x7f2c280744e0 2024-04-25T10:28:51.386 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:28:51.390 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:28:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 -- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2c280744e0 msgr2=0x7f2c280769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2c280744e0 0x7f2c280769f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009560 tx=0x7f2c3c009190 comp rx=0 tx=0).stop 2024-04-25T10:28:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 -- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c4815a370 msgr2=0x7f2c4814f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c4815a370 0x7f2c4814f1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c4002ac00 tx=0x7f2c40004a40 comp rx=0 tx=0).stop 2024-04-25T10:28:51.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 -- 172.21.15.19:0/2108441005 shutdown_connections 2024-04-25T10:28:51.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c4815a370 0x7f2c4814f1a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f2c280744e0 0x7f2c280769f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c480cac80 0x7f2c480cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 --2- 172.21.15.19:0/2108441005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c480c7f90 0x7f2c481f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 -- 172.21.15.19:0/2108441005 >> 172.21.15.19:0/2108441005 conn(0x7f2c480cdbc0 msgr2=0x7f2c480c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:51.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 -- 172.21.15.19:0/2108441005 shutdown_connections 2024-04-25T10:28:51.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.389+0000 7f2c4e200640 1 -- 172.21.15.19:0/2108441005 wait complete. 2024-04-25T10:28:51.421 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-04-25T10:28:50.633407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627231,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":141,"num_read_kb":133,"num_write":263,"num_write_kb":1718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219784,"kb_used_data":3656,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754936,"statfs":{"total":773094113280,"available":772869054464,"internally_reserved":0,"allocated":3743744,"data_stored":2221502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25346,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003425"},"pg_stats":[{"pgid":"2.1f","version":"27'10","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.734369+0000","last_change":"2024-04-25T10:25:36.182605+0000","last_active":"2024-04-25T10:28:07.734369+0000","last_peered":"2024-04-25T10:28:07.734369+0000","last_clean":"2024-04-25T10:28:07.734369+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:28:07.734369+0000","last_undegraded":"2024-04-25T10:28:07.734369+0000","last_fullsized":"2024-04-25T10:28:07.734369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280577+0000","last_change":"2024-04-25T10:25:37.199467+0000","last_active":"2024-04-25T10:27:43.280577+0000","last_peered":"2024-04-25T10:27:43.280577+0000","last_clean":"2024-04-25T10:27:43.280577+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:27:43.280577+0000","last_undegraded":"2024-04-25T10:27:43.280577+0000","last_fullsized":"2024-04-25T10:27:43.280577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426008+0000","last_change":"2024-04-25T10:25:41.234657+0000","last_active":"2024-04-25T10:27:42.426008+0000","last_peered":"2024-04-25T10:27:42.426008+0000","last_clean":"2024-04-25T10:27:42.426008+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:27:42.426008+0000","last_undegraded":"2024-04-25T10:27:42.426008+0000","last_fullsized":"2024-04-25T10:27:42.426008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:56.869031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280765+0000","last_change":"2024-04-25T10:25:36.166548+0000","last_active":"2024-04-25T10:27:43.280765+0000","last_peered":"2024-04-25T10:27:43.280765+0000","last_clean":"2024-04-25T10:27:43.280765+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:27:43.280765+0000","last_undegraded":"2024-04-25T10:27:43.280765+0000","last_fullsized":"2024-04-25T10:27:43.280765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280925+0000","last_change":"2024-04-25T10:25:37.179746+0000","last_active":"2024-04-25T10:27:43.280925+0000","last_peered":"2024-04-25T10:27:43.280925+0000","last_clean":"2024-04-25T10:27:43.280925+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:27:43.280925+0000","last_undegraded":"2024-04-25T10:27:43.280925+0000","last_fullsized":"2024-04-25T10:27:43.280925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780202+0000","last_change":"2024-04-25T10:25:41.232828+0000","last_active":"2024-04-25T10:27:42.780202+0000","last_peered":"2024-04-25T10:27:42.780202+0000","last_clean":"2024-04-25T10:27:42.780202+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:27:42.780202+0000","last_undegraded":"2024-04-25T10:27:42.780202+0000","last_fullsized":"2024-04-25T10:27:42.780202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:01.782881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:09.656041+0000","last_change":"2024-04-25T10:25:36.190035+0000","last_active":"2024-04-25T10:28:09.656041+0000","last_peered":"2024-04-25T10:28:09.656041+0000","last_clean":"2024-04-25T10:28:09.656041+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:28:09.656041+0000","last_undegraded":"2024-04-25T10:28:09.656041+0000","last_fullsized":"2024-04-25T10:28:09.656041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":7,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.429329+0000","last_change":"2024-04-25T10:25:37.191742+0000","last_active":"2024-04-25T10:27:42.429329+0000","last_peered":"2024-04-25T10:27:42.429329+0000","last_clean":"2024-04-25T10:27:42.429329+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:27:42.429329+0000","last_undegraded":"2024-04-25T10:27:42.429329+0000","last_fullsized":"2024-04-25T10:27:42.429329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780246+0000","last_change":"2024-04-25T10:25:41.242444+0000","last_active":"2024-04-25T10:27:42.780246+0000","last_peered":"2024-04-25T10:27:42.780246+0000","last_clean":"2024-04-25T10:27:42.780246+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:27:42.780246+0000","last_undegraded":"2024-04-25T10:27:42.780246+0000","last_fullsized":"2024-04-25T10:27:42.780246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195642+0000","last_change":"2024-04-25T10:25:36.190527+0000","last_active":"2024-04-25T10:27:43.195642+0000","last_peered":"2024-04-25T10:27:43.195642+0000","last_clean":"2024-04-25T10:27:43.195642+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:27:43.195642+0000","last_undegraded":"2024-04-25T10:27:43.195642+0000","last_fullsized":"2024-04-25T10:27:43.195642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283453+0000","last_change":"2024-04-25T10:25:37.204468+0000","last_active":"2024-04-25T10:27:43.283453+0000","last_peered":"2024-04-25T10:27:43.283453+0000","last_clean":"2024-04-25T10:27:43.283453+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:27:43.283453+0000","last_undegraded":"2024-04-25T10:27:43.283453+0000","last_fullsized":"2024-04-25T10:27:43.283453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780091+0000","last_change":"2024-04-25T10:25:41.236518+0000","last_active":"2024-04-25T10:27:42.780091+0000","last_peered":"2024-04-25T10:27:42.780091+0000","last_clean":"2024-04-25T10:27:42.780091+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:27:42.780091+0000","last_undegraded":"2024-04-25T10:27:42.780091+0000","last_fullsized":"2024-04-25T10:27:42.780091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282642+0000","last_change":"2024-04-25T10:25:37.194114+0000","last_active":"2024-04-25T10:27:43.282642+0000","last_peered":"2024-04-25T10:27:43.282642+0000","last_clean":"2024-04-25T10:27:43.282642+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:27:43.282642+0000","last_undegraded":"2024-04-25T10:27:43.282642+0000","last_fullsized":"2024-04-25T10:27:43.282642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:40.192156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.656892+0000","last_change":"2024-04-25T10:25:36.188266+0000","last_active":"2024-04-25T10:27:54.656892+0000","last_peered":"2024-04-25T10:27:54.656892+0000","last_clean":"2024-04-25T10:27:54.656892+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:27:54.656892+0000","last_undegraded":"2024-04-25T10:27:54.656892+0000","last_fullsized":"2024-04-25T10:27:54.656892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.845953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283091+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:27:43.283091+0000","last_peered":"2024-04-25T10:27:43.283091+0000","last_clean":"2024-04-25T10:27:43.283091+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:27:43.283091+0000","last_undegraded":"2024-04-25T10:27:43.283091+0000","last_fullsized":"2024-04-25T10:27:43.283091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:13.684019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426239+0000","last_change":"2024-04-25T10:25:37.166002+0000","last_active":"2024-04-25T10:27:42.426239+0000","last_peered":"2024-04-25T10:27:42.426239+0000","last_clean":"2024-04-25T10:27:42.426239+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:27:42.426239+0000","last_undegraded":"2024-04-25T10:27:42.426239+0000","last_fullsized":"2024-04-25T10:27:42.426239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279806+0000","last_change":"2024-04-25T10:25:36.168204+0000","last_active":"2024-04-25T10:27:43.279806+0000","last_peered":"2024-04-25T10:27:43.279806+0000","last_clean":"2024-04-25T10:27:43.279806+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:27:43.279806+0000","last_undegraded":"2024-04-25T10:27:43.279806+0000","last_fullsized":"2024-04-25T10:27:43.279806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.907635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195061+0000","last_change":"2024-04-25T10:25:41.257264+0000","last_active":"2024-04-25T10:27:43.195061+0000","last_peered":"2024-04-25T10:27:43.195061+0000","last_clean":"2024-04-25T10:27:43.195061+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:27:43.195061+0000","last_undegraded":"2024-04-25T10:27:43.195061+0000","last_fullsized":"2024-04-25T10:27:43.195061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278490+0000","last_change":"2024-04-25T10:25:37.158884+0000","last_active":"2024-04-25T10:27:43.278490+0000","last_peered":"2024-04-25T10:27:43.278490+0000","last_clean":"2024-04-25T10:27:43.278490+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:27:43.278490+0000","last_undegraded":"2024-04-25T10:27:43.278490+0000","last_fullsized":"2024-04-25T10:27:43.278490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278949+0000","last_change":"2024-04-25T10:25:36.173499+0000","last_active":"2024-04-25T10:27:43.278949+0000","last_peered":"2024-04-25T10:27:43.278949+0000","last_clean":"2024-04-25T10:27:43.278949+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:27:43.278949+0000","last_undegraded":"2024-04-25T10:27:43.278949+0000","last_fullsized":"2024-04-25T10:27:43.278949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426750+0000","last_change":"2024-04-25T10:25:41.239990+0000","last_active":"2024-04-25T10:27:42.426750+0000","last_peered":"2024-04-25T10:27:42.426750+0000","last_clean":"2024-04-25T10:27:42.426750+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:27:42.426750+0000","last_undegraded":"2024-04-25T10:27:42.426750+0000","last_fullsized":"2024-04-25T10:27:42.426750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:15.055786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282179+0000","last_change":"2024-04-25T10:25:37.193560+0000","last_active":"2024-04-25T10:27:43.282179+0000","last_peered":"2024-04-25T10:27:43.282179+0000","last_clean":"2024-04-25T10:27:43.282179+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:27:43.282179+0000","last_undegraded":"2024-04-25T10:27:43.282179+0000","last_fullsized":"2024-04-25T10:27:43.282179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.193166+0000","last_change":"2024-04-25T10:25:36.174077+0000","last_active":"2024-04-25T10:27:43.193166+0000","last_peered":"2024-04-25T10:27:43.193166+0000","last_clean":"2024-04-25T10:27:43.193166+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:27:43.193166+0000","last_undegraded":"2024-04-25T10:27:43.193166+0000","last_fullsized":"2024-04-25T10:27:43.193166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781240+0000","last_change":"2024-04-25T10:25:41.262158+0000","last_active":"2024-04-25T10:27:42.781240+0000","last_peered":"2024-04-25T10:27:42.781240+0000","last_clean":"2024-04-25T10:27:42.781240+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:27:42.781240+0000","last_undegraded":"2024-04-25T10:27:42.781240+0000","last_fullsized":"2024-04-25T10:27:42.781240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279955+0000","last_change":"2024-04-25T10:25:37.159876+0000","last_active":"2024-04-25T10:27:43.279955+0000","last_peered":"2024-04-25T10:27:43.279955+0000","last_clean":"2024-04-25T10:27:43.279955+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:27:43.279955+0000","last_undegraded":"2024-04-25T10:27:43.279955+0000","last_fullsized":"2024-04-25T10:27:43.279955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284548+0000","last_change":"2024-04-25T10:25:36.194275+0000","last_active":"2024-04-25T10:27:43.284548+0000","last_peered":"2024-04-25T10:27:43.284548+0000","last_clean":"2024-04-25T10:27:43.284548+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:27:43.284548+0000","last_undegraded":"2024-04-25T10:27:43.284548+0000","last_fullsized":"2024-04-25T10:27:43.284548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780250+0000","last_change":"2024-04-25T10:25:41.261185+0000","last_active":"2024-04-25T10:27:42.780250+0000","last_peered":"2024-04-25T10:27:42.780250+0000","last_clean":"2024-04-25T10:27:42.780250+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:27:42.780250+0000","last_undegraded":"2024-04-25T10:27:42.780250+0000","last_fullsized":"2024-04-25T10:27:42.780250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280158+0000","last_change":"2024-04-25T10:25:37.165436+0000","last_active":"2024-04-25T10:27:43.280158+0000","last_peered":"2024-04-25T10:27:43.280158+0000","last_clean":"2024-04-25T10:27:43.280158+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:27:43.280158+0000","last_undegraded":"2024-04-25T10:27:43.280158+0000","last_fullsized":"2024-04-25T10:27:43.280158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'11","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.494095+0000","last_change":"2024-04-25T10:25:36.181966+0000","last_active":"2024-04-25T10:28:46.494095+0000","last_peered":"2024-04-25T10:28:46.494095+0000","last_clean":"2024-04-25T10:28:46.494095+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:28:46.494095+0000","last_undegraded":"2024-04-25T10:28:46.494095+0000","last_fullsized":"2024-04-25T10:28:46.494095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278487+0000","last_change":"2024-04-25T10:25:41.246715+0000","last_active":"2024-04-25T10:27:43.278487+0000","last_peered":"2024-04-25T10:27:43.278487+0000","last_clean":"2024-04-25T10:27:43.278487+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:27:43.278487+0000","last_undegraded":"2024-04-25T10:27:43.278487+0000","last_fullsized":"2024-04-25T10:27:43.278487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:03.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280786+0000","last_change":"2024-04-25T10:25:37.170738+0000","last_active":"2024-04-25T10:27:43.280786+0000","last_peered":"2024-04-25T10:27:43.280786+0000","last_clean":"2024-04-25T10:27:43.280786+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:27:43.280786+0000","last_undegraded":"2024-04-25T10:27:43.280786+0000","last_fullsized":"2024-04-25T10:27:43.280786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:43.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284276+0000","last_change":"2024-04-25T10:25:36.186052+0000","last_active":"2024-04-25T10:27:43.284276+0000","last_peered":"2024-04-25T10:27:43.284276+0000","last_clean":"2024-04-25T10:27:43.284276+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:27:43.284276+0000","last_undegraded":"2024-04-25T10:27:43.284276+0000","last_fullsized":"2024-04-25T10:27:43.284276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:42.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279843+0000","last_change":"2024-04-25T10:25:41.244909+0000","last_active":"2024-04-25T10:27:43.279843+0000","last_peered":"2024-04-25T10:27:43.279843+0000","last_clean":"2024-04-25T10:27:43.279843+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:27:43.279843+0000","last_undegraded":"2024-04-25T10:27:43.279843+0000","last_fullsized":"2024-04-25T10:27:43.279843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781028+0000","last_change":"2024-04-25T10:25:37.181614+0000","last_active":"2024-04-25T10:27:42.781028+0000","last_peered":"2024-04-25T10:27:42.781028+0000","last_clean":"2024-04-25T10:27:42.781028+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:27:42.781028+0000","last_undegraded":"2024-04-25T10:27:42.781028+0000","last_fullsized":"2024-04-25T10:27:42.781028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280145+0000","last_change":"2024-04-25T10:25:36.166395+0000","last_active":"2024-04-25T10:27:43.280145+0000","last_peered":"2024-04-25T10:27:43.280145+0000","last_clean":"2024-04-25T10:27:43.280145+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:27:43.280145+0000","last_undegraded":"2024-04-25T10:27:43.280145+0000","last_fullsized":"2024-04-25T10:27:43.280145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279527+0000","last_change":"2024-04-25T10:25:41.237175+0000","last_active":"2024-04-25T10:27:43.279527+0000","last_peered":"2024-04-25T10:27:43.279527+0000","last_clean":"2024-04-25T10:27:43.279527+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:27:43.279527+0000","last_undegraded":"2024-04-25T10:27:43.279527+0000","last_fullsized":"2024-04-25T10:27:43.279527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194409+0000","last_change":"2024-04-25T10:25:37.192638+0000","last_active":"2024-04-25T10:27:43.194409+0000","last_peered":"2024-04-25T10:27:43.194409+0000","last_clean":"2024-04-25T10:27:43.194409+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:27:43.194409+0000","last_undegraded":"2024-04-25T10:27:43.194409+0000","last_fullsized":"2024-04-25T10:27:43.194409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:44.654592+0000","last_change":"2024-04-25T10:25:36.182126+0000","last_active":"2024-04-25T10:27:44.654592+0000","last_peered":"2024-04-25T10:27:44.654592+0000","last_clean":"2024-04-25T10:27:44.654592+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:27:44.654592+0000","last_undegraded":"2024-04-25T10:27:44.654592+0000","last_fullsized":"2024-04-25T10:27:44.654592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:50.385012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280453+0000","last_change":"2024-04-25T10:25:41.247504+0000","last_active":"2024-04-25T10:27:43.280453+0000","last_peered":"2024-04-25T10:27:43.280453+0000","last_clean":"2024-04-25T10:27:43.280453+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:27:43.280453+0000","last_undegraded":"2024-04-25T10:27:43.280453+0000","last_fullsized":"2024-04-25T10:27:43.280453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279226+0000","last_change":"2024-04-25T10:25:37.171962+0000","last_active":"2024-04-25T10:27:43.279226+0000","last_peered":"2024-04-25T10:27:43.279226+0000","last_clean":"2024-04-25T10:27:43.279226+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:27:43.279226+0000","last_undegraded":"2024-04-25T10:27:43.279226+0000","last_fullsized":"2024-04-25T10:27:43.279226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.499878+0000","last_change":"2024-04-25T10:25:36.167914+0000","last_active":"2024-04-25T10:28:46.499878+0000","last_peered":"2024-04-25T10:28:46.499878+0000","last_clean":"2024-04-25T10:28:46.499878+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:28:46.499878+0000","last_undegraded":"2024-04-25T10:28:46.499878+0000","last_fullsized":"2024-04-25T10:28:46.499878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.281110+0000","last_change":"2024-04-25T10:25:41.250414+0000","last_active":"2024-04-25T10:27:43.281110+0000","last_peered":"2024-04-25T10:27:43.281110+0000","last_clean":"2024-04-25T10:27:43.281110+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:27:43.281110+0000","last_undegraded":"2024-04-25T10:27:43.281110+0000","last_fullsized":"2024-04-25T10:27:43.281110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279484+0000","last_change":"2024-04-25T10:25:37.179610+0000","last_active":"2024-04-25T10:27:43.279484+0000","last_peered":"2024-04-25T10:27:43.279484+0000","last_clean":"2024-04-25T10:27:43.279484+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:27:43.279484+0000","last_undegraded":"2024-04-25T10:27:43.279484+0000","last_fullsized":"2024-04-25T10:27:43.279484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:22.862181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.727049+0000","last_change":"2024-04-25T10:25:36.187683+0000","last_active":"2024-04-25T10:28:07.727049+0000","last_peered":"2024-04-25T10:28:07.727049+0000","last_clean":"2024-04-25T10:28:07.727049+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:28:07.727049+0000","last_undegraded":"2024-04-25T10:28:07.727049+0000","last_fullsized":"2024-04-25T10:28:07.727049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279929+0000","last_change":"2024-04-25T10:25:41.239687+0000","last_active":"2024-04-25T10:27:43.279929+0000","last_peered":"2024-04-25T10:27:43.279929+0000","last_clean":"2024-04-25T10:27:43.279929+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:27:43.279929+0000","last_undegraded":"2024-04-25T10:27:43.279929+0000","last_fullsized":"2024-04-25T10:27:43.279929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.061875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278799+0000","last_change":"2024-04-25T10:25:37.172981+0000","last_active":"2024-04-25T10:27:43.278799+0000","last_peered":"2024-04-25T10:27:43.278799+0000","last_clean":"2024-04-25T10:27:43.278799+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:27:43.278799+0000","last_undegraded":"2024-04-25T10:27:43.278799+0000","last_fullsized":"2024-04-25T10:27:43.278799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:44.654627+0000","last_change":"2024-04-25T10:25:36.186586+0000","last_active":"2024-04-25T10:27:44.654627+0000","last_peered":"2024-04-25T10:27:44.654627+0000","last_clean":"2024-04-25T10:27:44.654627+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:27:44.654627+0000","last_undegraded":"2024-04-25T10:27:44.654627+0000","last_fullsized":"2024-04-25T10:27:44.654627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:00.696356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428150+0000","last_change":"2024-04-25T10:25:25.811918+0000","last_active":"2024-04-25T10:27:42.428150+0000","last_peered":"2024-04-25T10:27:42.428150+0000","last_clean":"2024-04-25T10:27:42.428150+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:27:42.428150+0000","last_undegraded":"2024-04-25T10:27:42.428150+0000","last_fullsized":"2024-04-25T10:27:42.428150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_clean_scrub_stamp":"2024-04-25T10:25:24.774439+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:46.603072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283902+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:27:43.283902+0000","last_peered":"2024-04-25T10:27:43.283902+0000","last_clean":"2024-04-25T10:27:43.283902+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:27:43.283902+0000","last_undegraded":"2024-04-25T10:27:43.283902+0000","last_fullsized":"2024-04-25T10:27:43.283902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:56.121358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283710+0000","last_change":"2024-04-25T10:25:37.187670+0000","last_active":"2024-04-25T10:27:43.283710+0000","last_peered":"2024-04-25T10:27:43.283710+0000","last_clean":"2024-04-25T10:27:43.283710+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:27:43.283710+0000","last_undegraded":"2024-04-25T10:27:43.283710+0000","last_fullsized":"2024-04-25T10:27:43.283710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:09.567527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.729957+0000","last_change":"2024-04-25T10:25:36.190434+0000","last_active":"2024-04-25T10:28:07.729957+0000","last_peered":"2024-04-25T10:28:07.729957+0000","last_clean":"2024-04-25T10:28:07.729957+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:28:07.729957+0000","last_undegraded":"2024-04-25T10:28:07.729957+0000","last_fullsized":"2024-04-25T10:28:07.729957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780176+0000","last_change":"2024-04-25T10:25:41.249210+0000","last_active":"2024-04-25T10:27:42.780176+0000","last_peered":"2024-04-25T10:27:42.780176+0000","last_clean":"2024-04-25T10:27:42.780176+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:27:42.780176+0000","last_undegraded":"2024-04-25T10:27:42.780176+0000","last_fullsized":"2024-04-25T10:27:42.780176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195593+0000","last_change":"2024-04-25T10:25:37.176608+0000","last_active":"2024-04-25T10:27:43.195593+0000","last_peered":"2024-04-25T10:27:43.195593+0000","last_clean":"2024-04-25T10:27:43.195593+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:27:43.195593+0000","last_undegraded":"2024-04-25T10:27:43.195593+0000","last_fullsized":"2024-04-25T10:27:43.195593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280330+0000","last_change":"2024-04-25T10:25:36.175833+0000","last_active":"2024-04-25T10:27:43.280330+0000","last_peered":"2024-04-25T10:27:43.280330+0000","last_clean":"2024-04-25T10:27:43.280330+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:27:43.280330+0000","last_undegraded":"2024-04-25T10:27:43.280330+0000","last_fullsized":"2024-04-25T10:27:43.280330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279397+0000","last_change":"2024-04-25T10:25:41.256600+0000","last_active":"2024-04-25T10:27:43.279397+0000","last_peered":"2024-04-25T10:27:43.279397+0000","last_clean":"2024-04-25T10:27:43.279397+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:27:43.279397+0000","last_undegraded":"2024-04-25T10:27:43.279397+0000","last_fullsized":"2024-04-25T10:27:43.279397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195181+0000","last_change":"2024-04-25T10:25:37.185203+0000","last_active":"2024-04-25T10:27:43.195181+0000","last_peered":"2024-04-25T10:27:43.195181+0000","last_clean":"2024-04-25T10:27:43.195181+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:27:43.195181+0000","last_undegraded":"2024-04-25T10:27:43.195181+0000","last_fullsized":"2024-04-25T10:27:43.195181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279990+0000","last_change":"2024-04-25T10:25:36.168542+0000","last_active":"2024-04-25T10:27:43.279990+0000","last_peered":"2024-04-25T10:27:43.279990+0000","last_clean":"2024-04-25T10:27:43.279990+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:27:43.279990+0000","last_undegraded":"2024-04-25T10:27:43.279990+0000","last_fullsized":"2024-04-25T10:27:43.279990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.281759+0000","last_change":"2024-04-25T10:25:41.242053+0000","last_active":"2024-04-25T10:27:43.281759+0000","last_peered":"2024-04-25T10:27:43.281759+0000","last_clean":"2024-04-25T10:27:43.281759+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:27:43.281759+0000","last_undegraded":"2024-04-25T10:27:43.281759+0000","last_fullsized":"2024-04-25T10:27:43.281759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:05.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781697+0000","last_change":"2024-04-25T10:25:37.198952+0000","last_active":"2024-04-25T10:27:42.781697+0000","last_peered":"2024-04-25T10:27:42.781697+0000","last_clean":"2024-04-25T10:27:42.781697+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:27:42.781697+0000","last_undegraded":"2024-04-25T10:27:42.781697+0000","last_fullsized":"2024-04-25T10:27:42.781697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.653232+0000","last_change":"2024-04-25T10:25:36.179694+0000","last_active":"2024-04-25T10:27:54.653232+0000","last_peered":"2024-04-25T10:27:54.653232+0000","last_clean":"2024-04-25T10:27:54.653232+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:27:54.653232+0000","last_undegraded":"2024-04-25T10:27:54.653232+0000","last_fullsized":"2024-04-25T10:27:54.653232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428298+0000","last_change":"2024-04-25T10:25:41.251379+0000","last_active":"2024-04-25T10:27:42.428298+0000","last_peered":"2024-04-25T10:27:42.428298+0000","last_clean":"2024-04-25T10:27:42.428298+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:27:42.428298+0000","last_undegraded":"2024-04-25T10:27:42.428298+0000","last_fullsized":"2024-04-25T10:27:42.428298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:47.690188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282183+0000","last_change":"2024-04-25T10:25:37.202390+0000","last_active":"2024-04-25T10:27:43.282183+0000","last_peered":"2024-04-25T10:27:43.282183+0000","last_clean":"2024-04-25T10:27:43.282183+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:27:43.282183+0000","last_undegraded":"2024-04-25T10:27:43.282183+0000","last_fullsized":"2024-04-25T10:27:43.282183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'16","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.731880+0000","last_change":"2024-04-25T10:25:36.154879+0000","last_active":"2024-04-25T10:28:07.731880+0000","last_peered":"2024-04-25T10:28:07.731880+0000","last_clean":"2024-04-25T10:28:07.731880+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:28:07.731880+0000","last_undegraded":"2024-04-25T10:28:07.731880+0000","last_fullsized":"2024-04-25T10:28:07.731880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280514+0000","last_change":"2024-04-25T10:25:41.239631+0000","last_active":"2024-04-25T10:27:43.280514+0000","last_peered":"2024-04-25T10:27:43.280514+0000","last_clean":"2024-04-25T10:27:43.280514+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:27:43.280514+0000","last_undegraded":"2024-04-25T10:27:43.280514+0000","last_fullsized":"2024-04-25T10:27:43.280514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.684623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428678+0000","last_change":"2024-04-25T10:25:37.181525+0000","last_active":"2024-04-25T10:27:42.428678+0000","last_peered":"2024-04-25T10:27:42.428678+0000","last_clean":"2024-04-25T10:27:42.428678+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:27:42.428678+0000","last_undegraded":"2024-04-25T10:27:42.428678+0000","last_fullsized":"2024-04-25T10:27:42.428678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:47.435073+0000","last_change":"2024-04-25T10:25:36.192797+0000","last_active":"2024-04-25T10:27:47.435073+0000","last_peered":"2024-04-25T10:27:47.435073+0000","last_clean":"2024-04-25T10:27:47.435073+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:27:47.435073+0000","last_undegraded":"2024-04-25T10:27:47.435073+0000","last_fullsized":"2024-04-25T10:27:47.435073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280869+0000","last_change":"2024-04-25T10:25:41.244618+0000","last_active":"2024-04-25T10:27:43.280869+0000","last_peered":"2024-04-25T10:27:43.280869+0000","last_clean":"2024-04-25T10:27:43.280869+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:27:43.280869+0000","last_undegraded":"2024-04-25T10:27:43.280869+0000","last_fullsized":"2024-04-25T10:27:43.280869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:13.625947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284116+0000","last_change":"2024-04-25T10:25:37.208984+0000","last_active":"2024-04-25T10:27:43.284116+0000","last_peered":"2024-04-25T10:27:43.284116+0000","last_clean":"2024-04-25T10:27:43.284116+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:27:43.284116+0000","last_undegraded":"2024-04-25T10:27:43.284116+0000","last_fullsized":"2024-04-25T10:27:43.284116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.658061+0000","last_change":"2024-04-25T10:25:36.185689+0000","last_active":"2024-04-25T10:27:59.658061+0000","last_peered":"2024-04-25T10:27:59.658061+0000","last_clean":"2024-04-25T10:27:59.658061+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:27:59.658061+0000","last_undegraded":"2024-04-25T10:27:59.658061+0000","last_fullsized":"2024-04-25T10:27:59.658061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:35.671970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280314+0000","last_change":"2024-04-25T10:25:41.247314+0000","last_active":"2024-04-25T10:27:43.280314+0000","last_peered":"2024-04-25T10:27:43.280314+0000","last_clean":"2024-04-25T10:27:43.280314+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:27:43.280314+0000","last_undegraded":"2024-04-25T10:27:43.280314+0000","last_fullsized":"2024-04-25T10:27:43.280314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279734+0000","last_change":"2024-04-25T10:25:37.193696+0000","last_active":"2024-04-25T10:27:43.279734+0000","last_peered":"2024-04-25T10:27:43.279734+0000","last_clean":"2024-04-25T10:27:43.279734+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:27:43.279734+0000","last_undegraded":"2024-04-25T10:27:43.279734+0000","last_fullsized":"2024-04-25T10:27:43.279734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.728571+0000","last_change":"2024-04-25T10:25:36.181843+0000","last_active":"2024-04-25T10:28:07.728571+0000","last_peered":"2024-04-25T10:28:07.728571+0000","last_clean":"2024-04-25T10:28:07.728571+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:28:07.728571+0000","last_undegraded":"2024-04-25T10:28:07.728571+0000","last_fullsized":"2024-04-25T10:28:07.728571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283282+0000","last_change":"2024-04-25T10:25:41.247061+0000","last_active":"2024-04-25T10:27:43.283282+0000","last_peered":"2024-04-25T10:27:43.283282+0000","last_clean":"2024-04-25T10:27:43.283282+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:27:43.283282+0000","last_undegraded":"2024-04-25T10:27:43.283282+0000","last_fullsized":"2024-04-25T10:27:43.283282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.491573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195370+0000","last_change":"2024-04-25T10:25:37.185402+0000","last_active":"2024-04-25T10:27:43.195370+0000","last_peered":"2024-04-25T10:27:43.195370+0000","last_clean":"2024-04-25T10:27:43.195370+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:27:43.195370+0000","last_undegraded":"2024-04-25T10:27:43.195370+0000","last_fullsized":"2024-04-25T10:27:43.195370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'23","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.497836+0000","last_change":"2024-04-25T10:25:36.166998+0000","last_active":"2024-04-25T10:28:46.497836+0000","last_peered":"2024-04-25T10:28:46.497836+0000","last_clean":"2024-04-25T10:28:46.497836+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:28:46.497836+0000","last_undegraded":"2024-04-25T10:28:46.497836+0000","last_fullsized":"2024-04-25T10:28:46.497836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:25.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33043,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:43.157048+0000","last_change":"2024-04-25T10:25:41.248522+0000","last_active":"2024-04-25T10:28:43.157048+0000","last_peered":"2024-04-25T10:28:43.157048+0000","last_clean":"2024-04-25T10:28:43.157048+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:28:43.157048+0000","last_undegraded":"2024-04-25T10:28:43.157048+0000","last_fullsized":"2024-04-25T10:28:43.157048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:51.139406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282916+0000","last_change":"2024-04-25T10:25:37.196588+0000","last_active":"2024-04-25T10:27:43.282916+0000","last_peered":"2024-04-25T10:27:43.282916+0000","last_clean":"2024-04-25T10:27:43.282916+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:27:43.282916+0000","last_undegraded":"2024-04-25T10:27:43.282916+0000","last_fullsized":"2024-04-25T10:27:43.282916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:00.003456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.494929+0000","last_change":"2024-04-25T10:25:36.156630+0000","last_active":"2024-04-25T10:28:46.494929+0000","last_peered":"2024-04-25T10:28:46.494929+0000","last_clean":"2024-04-25T10:28:46.494929+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:28:46.494929+0000","last_undegraded":"2024-04-25T10:28:46.494929+0000","last_fullsized":"2024-04-25T10:28:46.494929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780922+0000","last_change":"2024-04-25T10:26:18.708803+0000","last_active":"2024-04-25T10:27:42.780922+0000","last_peered":"2024-04-25T10:27:42.780922+0000","last_clean":"2024-04-25T10:27:42.780922+0000","last_became_active":"2024-04-25T10:26:18.708320+0000","last_became_peered":"2024-04-25T10:26:18.708320+0000","last_unstale":"2024-04-25T10:27:42.780922+0000","last_undegraded":"2024-04-25T10:27:42.780922+0000","last_fullsized":"2024-04-25T10:27:42.780922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:09.714453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,7],"acting":[2,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280982+0000","last_change":"2024-04-25T10:25:37.187575+0000","last_active":"2024-04-25T10:27:43.280982+0000","last_peered":"2024-04-25T10:27:43.280982+0000","last_clean":"2024-04-25T10:27:43.280982+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:27:43.280982+0000","last_undegraded":"2024-04-25T10:27:43.280982+0000","last_fullsized":"2024-04-25T10:27:43.280982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194905+0000","last_change":"2024-04-25T10:25:36.183582+0000","last_active":"2024-04-25T10:27:43.194905+0000","last_peered":"2024-04-25T10:27:43.194905+0000","last_clean":"2024-04-25T10:27:43.194905+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:27:43.194905+0000","last_undegraded":"2024-04-25T10:27:43.194905+0000","last_fullsized":"2024-04-25T10:27:43.194905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.425916+0000","last_change":"2024-04-25T10:25:41.238488+0000","last_active":"2024-04-25T10:27:42.425916+0000","last_peered":"2024-04-25T10:27:42.425916+0000","last_clean":"2024-04-25T10:27:42.425916+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:27:42.425916+0000","last_undegraded":"2024-04-25T10:27:42.425916+0000","last_fullsized":"2024-04-25T10:27:42.425916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:05.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781685+0000","last_change":"2024-04-25T10:25:37.192707+0000","last_active":"2024-04-25T10:27:42.781685+0000","last_peered":"2024-04-25T10:27:42.781685+0000","last_clean":"2024-04-25T10:27:42.781685+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:27:42.781685+0000","last_undegraded":"2024-04-25T10:27:42.781685+0000","last_fullsized":"2024-04-25T10:27:42.781685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:04.655214+0000","last_change":"2024-04-25T10:25:36.173755+0000","last_active":"2024-04-25T10:28:04.655214+0000","last_peered":"2024-04-25T10:28:04.655214+0000","last_clean":"2024-04-25T10:28:04.655214+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:28:04.655214+0000","last_undegraded":"2024-04-25T10:28:04.655214+0000","last_fullsized":"2024-04-25T10:28:04.655214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278627+0000","last_change":"2024-04-25T10:25:41.248983+0000","last_active":"2024-04-25T10:27:43.278627+0000","last_peered":"2024-04-25T10:27:43.278627+0000","last_clean":"2024-04-25T10:27:43.278627+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:27:43.278627+0000","last_undegraded":"2024-04-25T10:27:43.278627+0000","last_fullsized":"2024-04-25T10:27:43.278627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.880608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279809+0000","last_change":"2024-04-25T10:25:41.246692+0000","last_active":"2024-04-25T10:27:43.279809+0000","last_peered":"2024-04-25T10:27:43.279809+0000","last_clean":"2024-04-25T10:27:43.279809+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:27:43.279809+0000","last_undegraded":"2024-04-25T10:27:43.279809+0000","last_fullsized":"2024-04-25T10:27:43.279809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:44.250576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278814+0000","last_change":"2024-04-25T10:25:37.178691+0000","last_active":"2024-04-25T10:27:43.278814+0000","last_peered":"2024-04-25T10:27:43.278814+0000","last_clean":"2024-04-25T10:27:43.278814+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:27:43.278814+0000","last_undegraded":"2024-04-25T10:27:43.278814+0000","last_fullsized":"2024-04-25T10:27:43.278814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282596+0000","last_change":"2024-04-25T10:25:36.191338+0000","last_active":"2024-04-25T10:27:43.282596+0000","last_peered":"2024-04-25T10:27:43.282596+0000","last_clean":"2024-04-25T10:27:43.282596+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:27:43.282596+0000","last_undegraded":"2024-04-25T10:27:43.282596+0000","last_fullsized":"2024-04-25T10:27:43.282596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283891+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:27:43.283891+0000","last_peered":"2024-04-25T10:27:43.283891+0000","last_clean":"2024-04-25T10:27:43.283891+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:27:43.283891+0000","last_undegraded":"2024-04-25T10:27:43.283891+0000","last_fullsized":"2024-04-25T10:27:43.283891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:21.254459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279373+0000","last_change":"2024-04-25T10:25:37.170931+0000","last_active":"2024-04-25T10:27:43.279373+0000","last_peered":"2024-04-25T10:27:43.279373+0000","last_clean":"2024-04-25T10:27:43.279373+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:27:43.279373+0000","last_undegraded":"2024-04-25T10:27:43.279373+0000","last_fullsized":"2024-04-25T10:27:43.279373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.731321+0000","last_change":"2024-04-25T10:25:36.173721+0000","last_active":"2024-04-25T10:28:07.731321+0000","last_peered":"2024-04-25T10:28:07.731321+0000","last_clean":"2024-04-25T10:28:07.731321+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:28:07.731321+0000","last_undegraded":"2024-04-25T10:28:07.731321+0000","last_fullsized":"2024-04-25T10:28:07.731321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:42.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.738163+0000","last_change":"2024-04-25T10:25:36.195499+0000","last_active":"2024-04-25T10:28:07.738163+0000","last_peered":"2024-04-25T10:28:07.738163+0000","last_clean":"2024-04-25T10:28:07.738163+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:28:07.738163+0000","last_undegraded":"2024-04-25T10:28:07.738163+0000","last_fullsized":"2024-04-25T10:28:07.738163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:05.600702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278821+0000","last_change":"2024-04-25T10:25:37.180896+0000","last_active":"2024-04-25T10:27:43.278821+0000","last_peered":"2024-04-25T10:27:43.278821+0000","last_clean":"2024-04-25T10:27:43.278821+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:27:43.278821+0000","last_undegraded":"2024-04-25T10:27:43.278821+0000","last_fullsized":"2024-04-25T10:27:43.278821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279711+0000","last_change":"2024-04-25T10:25:41.231793+0000","last_active":"2024-04-25T10:27:43.279711+0000","last_peered":"2024-04-25T10:27:43.279711+0000","last_clean":"2024-04-25T10:27:43.279711+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:27:43.279711+0000","last_undegraded":"2024-04-25T10:27:43.279711+0000","last_fullsized":"2024-04-25T10:27:43.279711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:33.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279659+0000","last_change":"2024-04-25T10:25:36.166742+0000","last_active":"2024-04-25T10:27:43.279659+0000","last_peered":"2024-04-25T10:27:43.279659+0000","last_clean":"2024-04-25T10:27:43.279659+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:27:43.279659+0000","last_undegraded":"2024-04-25T10:27:43.279659+0000","last_fullsized":"2024-04-25T10:27:43.279659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428380+0000","last_change":"2024-04-25T10:25:37.185699+0000","last_active":"2024-04-25T10:27:42.428380+0000","last_peered":"2024-04-25T10:27:42.428380+0000","last_clean":"2024-04-25T10:27:42.428380+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:27:42.428380+0000","last_undegraded":"2024-04-25T10:27:42.428380+0000","last_fullsized":"2024-04-25T10:27:42.428380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426354+0000","last_change":"2024-04-25T10:25:41.258191+0000","last_active":"2024-04-25T10:27:42.426354+0000","last_peered":"2024-04-25T10:27:42.426354+0000","last_clean":"2024-04-25T10:27:42.426354+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:27:42.426354+0000","last_undegraded":"2024-04-25T10:27:42.426354+0000","last_fullsized":"2024-04-25T10:27:42.426354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.479785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780838+0000","last_change":"2024-04-25T10:25:37.183192+0000","last_active":"2024-04-25T10:27:42.780838+0000","last_peered":"2024-04-25T10:27:42.780838+0000","last_clean":"2024-04-25T10:27:42.780838+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:27:42.780838+0000","last_undegraded":"2024-04-25T10:27:42.780838+0000","last_fullsized":"2024-04-25T10:27:42.780838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426068+0000","last_change":"2024-04-25T10:25:37.180242+0000","last_active":"2024-04-25T10:27:42.426068+0000","last_peered":"2024-04-25T10:27:42.426068+0000","last_clean":"2024-04-25T10:27:42.426068+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:27:42.426068+0000","last_undegraded":"2024-04-25T10:27:42.426068+0000","last_fullsized":"2024-04-25T10:27:42.426068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282478+0000","last_change":"2024-04-25T10:25:37.187312+0000","last_active":"2024-04-25T10:27:43.282478+0000","last_peered":"2024-04-25T10:27:43.282478+0000","last_clean":"2024-04-25T10:27:43.282478+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:27:43.282478+0000","last_undegraded":"2024-04-25T10:27:43.282478+0000","last_fullsized":"2024-04-25T10:27:43.282478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:22.595222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279529+0000","last_change":"2024-04-25T10:25:37.166351+0000","last_active":"2024-04-25T10:27:43.279529+0000","last_peered":"2024-04-25T10:27:43.279529+0000","last_clean":"2024-04-25T10:27:43.279529+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:27:43.279529+0000","last_undegraded":"2024-04-25T10:27:43.279529+0000","last_fullsized":"2024-04-25T10:27:43.279529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280670+0000","last_change":"2024-04-25T10:26:18.699084+0000","last_active":"2024-04-25T10:27:43.280670+0000","last_peered":"2024-04-25T10:27:43.280670+0000","last_clean":"2024-04-25T10:27:43.280670+0000","last_became_active":"2024-04-25T10:26:18.698625+0000","last_became_peered":"2024-04-25T10:26:18.698625+0000","last_unstale":"2024-04-25T10:27:43.280670+0000","last_undegraded":"2024-04-25T10:27:43.280670+0000","last_fullsized":"2024-04-25T10:27:43.280670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:44.112645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.281198+0000","last_change":"2024-04-25T10:25:37.170647+0000","last_active":"2024-04-25T10:27:43.281198+0000","last_peered":"2024-04-25T10:27:43.281198+0000","last_clean":"2024-04-25T10:27:43.281198+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:27:43.281198+0000","last_undegraded":"2024-04-25T10:27:43.281198+0000","last_fullsized":"2024-04-25T10:27:43.281198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781292+0000","last_change":"2024-04-25T10:25:37.196676+0000","last_active":"2024-04-25T10:27:42.781292+0000","last_peered":"2024-04-25T10:27:42.781292+0000","last_clean":"2024-04-25T10:27:42.781292+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:27:42.781292+0000","last_undegraded":"2024-04-25T10:27:42.781292+0000","last_fullsized":"2024-04-25T10:27:42.781292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280807+0000","last_change":"2024-04-25T10:25:37.186567+0000","last_active":"2024-04-25T10:27:43.280807+0000","last_peered":"2024-04-25T10:27:43.280807+0000","last_clean":"2024-04-25T10:27:43.280807+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:27:43.280807+0000","last_undegraded":"2024-04-25T10:27:43.280807+0000","last_fullsized":"2024-04-25T10:27:43.280807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282553+0000","last_change":"2024-04-25T10:25:37.184887+0000","last_active":"2024-04-25T10:27:43.282553+0000","last_peered":"2024-04-25T10:27:43.282553+0000","last_clean":"2024-04-25T10:27:43.282553+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:27:43.282553+0000","last_undegraded":"2024-04-25T10:27:43.282553+0000","last_fullsized":"2024-04-25T10:27:43.282553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279191+0000","last_change":"2024-04-25T10:25:37.196649+0000","last_active":"2024-04-25T10:27:43.279191+0000","last_peered":"2024-04-25T10:27:43.279191+0000","last_clean":"2024-04-25T10:27:43.279191+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:27:43.279191+0000","last_undegraded":"2024-04-25T10:27:43.279191+0000","last_fullsized":"2024-04-25T10:27:43.279191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428204+0000","last_change":"2024-04-25T10:25:37.192093+0000","last_active":"2024-04-25T10:27:42.428204+0000","last_peered":"2024-04-25T10:27:42.428204+0000","last_clean":"2024-04-25T10:27:42.428204+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:27:42.428204+0000","last_undegraded":"2024-04-25T10:27:42.428204+0000","last_fullsized":"2024-04-25T10:27:42.428204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278653+0000","last_change":"2024-04-25T10:25:37.184014+0000","last_active":"2024-04-25T10:27:43.278653+0000","last_peered":"2024-04-25T10:27:43.278653+0000","last_clean":"2024-04-25T10:27:43.278653+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:27:43.278653+0000","last_undegraded":"2024-04-25T10:27:43.278653+0000","last_fullsized":"2024-04-25T10:27:43.278653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:52.810612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195111+0000","last_change":"2024-04-25T10:25:37.187384+0000","last_active":"2024-04-25T10:27:43.195111+0000","last_peered":"2024-04-25T10:27:43.195111+0000","last_clean":"2024-04-25T10:27:43.195111+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:27:43.195111+0000","last_undegraded":"2024-04-25T10:27:43.195111+0000","last_fullsized":"2024-04-25T10:27:43.195111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284184+0000","last_change":"2024-04-25T10:25:37.195712+0000","last_active":"2024-04-25T10:27:43.284184+0000","last_peered":"2024-04-25T10:27:43.284184+0000","last_clean":"2024-04-25T10:27:43.284184+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:27:43.284184+0000","last_undegraded":"2024-04-25T10:27:43.284184+0000","last_fullsized":"2024-04-25T10:27:43.284184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:13.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426883+0000","last_change":"2024-04-25T10:25:37.198664+0000","last_active":"2024-04-25T10:27:42.426883+0000","last_peered":"2024-04-25T10:27:42.426883+0000","last_clean":"2024-04-25T10:27:42.426883+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:27:42.426883+0000","last_undegraded":"2024-04-25T10:27:42.426883+0000","last_fullsized":"2024-04-25T10:27:42.426883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284482+0000","last_change":"2024-04-25T10:25:37.203174+0000","last_active":"2024-04-25T10:27:43.284482+0000","last_peered":"2024-04-25T10:27:43.284482+0000","last_clean":"2024-04-25T10:27:43.284482+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:27:43.284482+0000","last_undegraded":"2024-04-25T10:27:43.284482+0000","last_fullsized":"2024-04-25T10:27:43.284482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:05.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282160+0000","last_change":"2024-04-25T10:25:37.199911+0000","last_active":"2024-04-25T10:27:43.282160+0000","last_peered":"2024-04-25T10:27:43.282160+0000","last_clean":"2024-04-25T10:27:43.282160+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:27:43.282160+0000","last_undegraded":"2024-04-25T10:27:43.282160+0000","last_fullsized":"2024-04-25T10:27:43.282160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:29.272654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278998+0000","last_change":"2024-04-25T10:25:37.177405+0000","last_active":"2024-04-25T10:27:43.278998+0000","last_peered":"2024-04-25T10:27:43.278998+0000","last_clean":"2024-04-25T10:27:43.278998+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:27:43.278998+0000","last_undegraded":"2024-04-25T10:27:43.278998+0000","last_fullsized":"2024-04-25T10:27:43.278998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.634145+0000","last_change":"2024-04-25T10:25:37.167752+0000","last_active":"2024-04-25T10:27:59.634145+0000","last_peered":"2024-04-25T10:27:59.634145+0000","last_clean":"2024-04-25T10:27:59.634145+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:27:59.634145+0000","last_undegraded":"2024-04-25T10:27:59.634145+0000","last_fullsized":"2024-04-25T10:27:59.634145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280308+0000","last_change":"2024-04-25T10:25:37.180781+0000","last_active":"2024-04-25T10:27:43.280308+0000","last_peered":"2024-04-25T10:27:43.280308+0000","last_clean":"2024-04-25T10:27:43.280308+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:27:43.280308+0000","last_undegraded":"2024-04-25T10:27:43.280308+0000","last_fullsized":"2024-04-25T10:27:43.280308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194792+0000","last_change":"2024-04-25T10:25:37.192759+0000","last_active":"2024-04-25T10:27:43.194792+0000","last_peered":"2024-04-25T10:27:43.194792+0000","last_clean":"2024-04-25T10:27:43.194792+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:27:43.194792+0000","last_undegraded":"2024-04-25T10:27:43.194792+0000","last_fullsized":"2024-04-25T10:27:43.194792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195256+0000","last_change":"2024-04-25T10:25:37.195532+0000","last_active":"2024-04-25T10:27:43.195256+0000","last_peered":"2024-04-25T10:27:43.195256+0000","last_clean":"2024-04-25T10:27:43.195256+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:27:43.195256+0000","last_undegraded":"2024-04-25T10:27:43.195256+0000","last_fullsized":"2024-04-25T10:27:43.195256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194446+0000","last_change":"2024-04-25T10:25:37.200331+0000","last_active":"2024-04-25T10:27:43.194446+0000","last_peered":"2024-04-25T10:27:43.194446+0000","last_clean":"2024-04-25T10:27:43.194446+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:27:43.194446+0000","last_undegraded":"2024-04-25T10:27:43.194446+0000","last_fullsized":"2024-04-25T10:27:43.194446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.429870+0000","last_change":"2024-04-25T10:25:37.194514+0000","last_active":"2024-04-25T10:27:42.429870+0000","last_peered":"2024-04-25T10:27:42.429870+0000","last_clean":"2024-04-25T10:27:42.429870+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:27:42.429870+0000","last_undegraded":"2024-04-25T10:27:42.429870+0000","last_fullsized":"2024-04-25T10:27:42.429870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279230+0000","last_change":"2024-04-25T10:25:37.177730+0000","last_active":"2024-04-25T10:27:43.279230+0000","last_peered":"2024-04-25T10:27:43.279230+0000","last_clean":"2024-04-25T10:27:43.279230+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:27:43.279230+0000","last_undegraded":"2024-04-25T10:27:43.279230+0000","last_fullsized":"2024-04-25T10:27:43.279230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.193851+0000","last_change":"2024-04-25T10:25:37.173419+0000","last_active":"2024-04-25T10:27:43.193851+0000","last_peered":"2024-04-25T10:27:43.193851+0000","last_clean":"2024-04-25T10:27:43.193851+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:27:43.193851+0000","last_undegraded":"2024-04-25T10:27:43.193851+0000","last_fullsized":"2024-04-25T10:27:43.193851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780611+0000","last_change":"2024-04-25T10:25:37.182871+0000","last_active":"2024-04-25T10:27:42.780611+0000","last_peered":"2024-04-25T10:27:42.780611+0000","last_clean":"2024-04-25T10:27:42.780611+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:27:42.780611+0000","last_undegraded":"2024-04-25T10:27:42.780611+0000","last_fullsized":"2024-04-25T10:27:42.780611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194479+0000","last_change":"2024-04-25T10:25:37.173983+0000","last_active":"2024-04-25T10:27:43.194479+0000","last_peered":"2024-04-25T10:27:43.194479+0000","last_clean":"2024-04-25T10:27:43.194479+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:27:43.194479+0000","last_undegraded":"2024-04-25T10:27:43.194479+0000","last_fullsized":"2024-04-25T10:27:43.194479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781241+0000","last_change":"2024-04-25T10:25:37.182178+0000","last_active":"2024-04-25T10:27:42.781241+0000","last_peered":"2024-04-25T10:27:42.781241+0000","last_clean":"2024-04-25T10:27:42.781241+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:27:42.781241+0000","last_undegraded":"2024-04-25T10:27:42.781241+0000","last_fullsized":"2024-04-25T10:27:42.781241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280171+0000","last_change":"2024-04-25T10:25:37.170383+0000","last_active":"2024-04-25T10:27:43.280171+0000","last_peered":"2024-04-25T10:27:43.280171+0000","last_clean":"2024-04-25T10:27:43.280171+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:27:43.280171+0000","last_undegraded":"2024-04-25T10:27:43.280171+0000","last_fullsized":"2024-04-25T10:27:43.280171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280501+0000","last_change":"2024-04-25T10:25:37.167687+0000","last_active":"2024-04-25T10:27:43.280501+0000","last_peered":"2024-04-25T10:27:43.280501+0000","last_clean":"2024-04-25T10:27:43.280501+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:27:43.280501+0000","last_undegraded":"2024-04-25T10:27:43.280501+0000","last_fullsized":"2024-04-25T10:27:43.280501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195171+0000","last_change":"2024-04-25T10:25:37.196591+0000","last_active":"2024-04-25T10:27:43.195171+0000","last_peered":"2024-04-25T10:27:43.195171+0000","last_clean":"2024-04-25T10:27:43.195171+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:27:43.195171+0000","last_undegraded":"2024-04-25T10:27:43.195171+0000","last_fullsized":"2024-04-25T10:27:43.195171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":36863,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":75,"num_read_kb":78,"num_write":160,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":73726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":121998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":712262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":155491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":153957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":892928,"data_stored":711408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":33077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":34611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:28:51.429 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T10:28:51.430 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:28:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.748+0000 7f6798a00640 1 Processor -- start 2024-04-25T10:28:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.748+0000 7f6798a00640 1 -- start start 2024-04-25T10:28:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.751+0000 7f6798a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67940c2640 0x7f67940c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.751+0000 7f6798a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67940c8340 con 0x7f67940c2a50 2024-04-25T10:28:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.751+0000 7f6798a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f679415c680 con 0x7f67941532c0 2024-04-25T10:28:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.751+0000 7f6798a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f67940c9dc0 con 0x7f67940c2640 2024-04-25T10:28:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.751+0000 7f6793400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f67941532c0 0x7f6794072ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:48988/0 (socket says 172.21.15.19:48988) 2024-04-25T10:28:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.751+0000 7f6793400640 1 -- 172.21.15.19:0/2519829765 learned_addr learned my addr 172.21.15.19:0/2519829765 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.751+0000 7f678be00640 1 --2- 172.21.15.19:0/2519829765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67940c2640 0x7f67940c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.752+0000 7f6792a00640 1 -- 172.21.15.19:0/2519829765 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074029340 0 0) 0x7f67940c8340 con 0x7f67940c2a50 2024-04-25T10:28:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.752+0000 7f6792a00640 1 -- 172.21.15.19:0/2519829765 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6778003520 con 0x7f67940c2a50 2024-04-25T10:28:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.752+0000 7f6792a00640 1 -- 172.21.15.19:0/2519829765 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103691847 0 0) 0x7f679415c680 con 0x7f67941532c0 2024-04-25T10:28:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.752+0000 7f6792a00640 1 -- 172.21.15.19:0/2519829765 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67940c8340 con 0x7f67941532c0 2024-04-25T10:28:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.752+0000 7f678be00640 1 -- 172.21.15.19:0/2519829765 >> v1:172.21.15.112:6789/0 conn(0x7f67941532c0 legacy=0x7f6794072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.752+0000 7f678be00640 1 -- 172.21.15.19:0/2519829765 >> v1:172.21.15.19:6789/0 conn(0x7f67940c2a50 legacy=0x7f6794163950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.752+0000 7f678be00640 1 -- 172.21.15.19:0/2519829765 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679415c960 con 0x7f67940c2640 2024-04-25T10:28:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.753+0000 7f678be00640 1 --2- 172.21.15.19:0/2519829765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67940c2640 0x7f67940c2fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f677c0097d0 tx=0x7f677c02a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f9fc99ea85d6986 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.754+0000 7f6792a00640 1 -- 172.21.15.19:0/2519829765 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c037070 con 0x7f67940c2640 2024-04-25T10:28:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.754+0000 7f6792a00640 1 -- 172.21.15.19:0/2519829765 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677c032440 con 0x7f67940c2640 2024-04-25T10:28:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.754+0000 7f6792a00640 1 -- 172.21.15.19:0/2519829765 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c0327f0 con 0x7f67940c2640 2024-04-25T10:28:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.754+0000 7f6798a00640 1 -- 172.21.15.19:0/2519829765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67940c2640 msgr2=0x7f67940c2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.754+0000 7f6798a00640 1 --2- 172.21.15.19:0/2519829765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67940c2640 0x7f67940c2fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f677c0097d0 tx=0x7f677c02a200 comp rx=0 tx=0).stop 2024-04-25T10:28:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.754+0000 7f6798a00640 1 -- 172.21.15.19:0/2519829765 shutdown_connections 2024-04-25T10:28:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.754+0000 7f6798a00640 1 --2- 172.21.15.19:0/2519829765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67940c2640 0x7f67940c2fe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.754+0000 7f6798a00640 1 -- 172.21.15.19:0/2519829765 >> 172.21.15.19:0/2519829765 conn(0x7f67940cdbc0 msgr2=0x7f67940ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.755+0000 7f6798a00640 1 -- 172.21.15.19:0/2519829765 shutdown_connections 2024-04-25T10:28:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.755+0000 7f6798a00640 1 -- 172.21.15.19:0/2519829765 wait complete. 2024-04-25T10:28:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.757+0000 7f6798a00640 1 Processor -- start 2024-04-25T10:28:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.757+0000 7f6798a00640 1 -- start start 2024-04-25T10:28:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6798a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67940c2640 0x7f6794159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6798a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67940c2a50 0x7f6794073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6798a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67941532c0 0x7f679414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6798a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f679415d440 con 0x7f67940c2640 2024-04-25T10:28:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6798a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f679415cf20 con 0x7f67940c2a50 2024-04-25T10:28:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6798a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f67940c8620 con 0x7f67941532c0 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6793400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67940c2640 0x7f6794159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6793400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67940c2640 0x7f6794159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59726/0 (socket says 172.21.15.19:59726) 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6793400640 1 -- 172.21.15.19:0/4183833337 learned_addr learned my addr 172.21.15.19:0/4183833337 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f678be00640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67940c2a50 0x7f6794073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6793e00640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67941532c0 0x7f679414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6793400640 1 -- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67941532c0 msgr2=0x7f679414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6793400640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67941532c0 0x7f679414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.759+0000 7f6793400640 1 -- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67940c2a50 msgr2=0x7f6794073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.760+0000 7f6793400640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67940c2a50 0x7f6794073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.760+0000 7f6793400640 1 -- 172.21.15.19:0/4183833337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679415b210 con 0x7f67940c2640 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.760+0000 7f678be00640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67940c2a50 0x7f6794073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.760+0000 7f6793400640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67940c2640 0x7f6794159910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f678400c430 tx=0x7f678400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.760+0000 7f678b400640 1 -- 172.21.15.19:0/4183833337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6784017070 con 0x7f67940c2640 2024-04-25T10:28:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.760+0000 7f678b400640 1 -- 172.21.15.19:0/4183833337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6784005ce0 con 0x7f67940c2640 2024-04-25T10:28:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.760+0000 7f6798a00640 1 -- 172.21.15.19:0/4183833337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679414cf00 con 0x7f67940c2640 2024-04-25T10:28:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.760+0000 7f678b400640 1 -- 172.21.15.19:0/4183833337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6784007310 con 0x7f67940c2640 2024-04-25T10:28:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.760+0000 7f6798a00640 1 -- 172.21.15.19:0/4183833337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67940c74f0 con 0x7f67940c2640 2024-04-25T10:28:51.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.761+0000 7f6798a00640 1 -- 172.21.15.19:0/4183833337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6794050740 con 0x7f67940c2640 2024-04-25T10:28:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.763+0000 7f678b400640 1 -- 172.21.15.19:0/4183833337 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f678401a070 con 0x7f67940c2640 2024-04-25T10:28:51.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.764+0000 7f678b400640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67700744b0 0x7f67700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:51.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.764+0000 7f678b400640 1 -- 172.21.15.19:0/4183833337 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f6784094dc0 con 0x7f67940c2640 2024-04-25T10:28:51.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.765+0000 7f678be00640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67700744b0 0x7f67700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.765+0000 7f678be00640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67700744b0 0x7f67700769c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f677c034000 tx=0x7f677c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:51.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.768+0000 7f678b400640 1 -- 172.21.15.19:0/4183833337 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6784021020 con 0x7f67940c2640 2024-04-25T10:28:51.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.974+0000 7f6798a00640 1 -- 172.21.15.19:0/4183833337 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f679406a430 con 0x7f67700744b0 2024-04-25T10:28:51.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.985+0000 7f678b400640 1 -- 172.21.15.19:0/4183833337 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332692 (secure 0 0 0) 0x7f679406a430 con 0x7f67700744b0 2024-04-25T10:28:51.992 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:28:51.994 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:28:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.992+0000 7f6798a00640 1 -- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67700744b0 msgr2=0x7f67700769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.992+0000 7f6798a00640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67700744b0 0x7f67700769c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f677c034000 tx=0x7f677c02e000 comp rx=0 tx=0).stop 2024-04-25T10:28:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.992+0000 7f6798a00640 1 -- 172.21.15.19:0/4183833337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67940c2640 msgr2=0x7f6794159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.992+0000 7f6798a00640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67940c2640 0x7f6794159910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f678400c430 tx=0x7f678400c8f0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.992+0000 7f6798a00640 1 -- 172.21.15.19:0/4183833337 shutdown_connections 2024-04-25T10:28:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.992+0000 7f6798a00640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67700744b0 0x7f67700769c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.992+0000 7f6798a00640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67941532c0 0x7f679414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.992+0000 7f6798a00640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67940c2a50 0x7f6794073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.992+0000 7f6798a00640 1 --2- 172.21.15.19:0/4183833337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67940c2640 0x7f6794159910 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:51.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.992+0000 7f6798a00640 1 -- 172.21.15.19:0/4183833337 >> 172.21.15.19:0/4183833337 conn(0x7f67940cdbc0 msgr2=0x7f6794075b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:51.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.992+0000 7f6798a00640 1 -- 172.21.15.19:0/4183833337 shutdown_connections 2024-04-25T10:28:51.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:51.993+0000 7f6798a00640 1 -- 172.21.15.19:0/4183833337 wait complete. 2024-04-25T10:28:52.026 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-04-25T10:28:50.633407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627231,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":141,"num_read_kb":133,"num_write":263,"num_write_kb":1718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219784,"kb_used_data":3656,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754936,"statfs":{"total":773094113280,"available":772869054464,"internally_reserved":0,"allocated":3743744,"data_stored":2221502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25346,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003425"},"pg_stats":[{"pgid":"2.1f","version":"27'10","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.734369+0000","last_change":"2024-04-25T10:25:36.182605+0000","last_active":"2024-04-25T10:28:07.734369+0000","last_peered":"2024-04-25T10:28:07.734369+0000","last_clean":"2024-04-25T10:28:07.734369+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:28:07.734369+0000","last_undegraded":"2024-04-25T10:28:07.734369+0000","last_fullsized":"2024-04-25T10:28:07.734369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280577+0000","last_change":"2024-04-25T10:25:37.199467+0000","last_active":"2024-04-25T10:27:43.280577+0000","last_peered":"2024-04-25T10:27:43.280577+0000","last_clean":"2024-04-25T10:27:43.280577+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:27:43.280577+0000","last_undegraded":"2024-04-25T10:27:43.280577+0000","last_fullsized":"2024-04-25T10:27:43.280577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426008+0000","last_change":"2024-04-25T10:25:41.234657+0000","last_active":"2024-04-25T10:27:42.426008+0000","last_peered":"2024-04-25T10:27:42.426008+0000","last_clean":"2024-04-25T10:27:42.426008+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:27:42.426008+0000","last_undegraded":"2024-04-25T10:27:42.426008+0000","last_fullsized":"2024-04-25T10:27:42.426008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:56.869031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280765+0000","last_change":"2024-04-25T10:25:36.166548+0000","last_active":"2024-04-25T10:27:43.280765+0000","last_peered":"2024-04-25T10:27:43.280765+0000","last_clean":"2024-04-25T10:27:43.280765+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:27:43.280765+0000","last_undegraded":"2024-04-25T10:27:43.280765+0000","last_fullsized":"2024-04-25T10:27:43.280765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280925+0000","last_change":"2024-04-25T10:25:37.179746+0000","last_active":"2024-04-25T10:27:43.280925+0000","last_peered":"2024-04-25T10:27:43.280925+0000","last_clean":"2024-04-25T10:27:43.280925+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:27:43.280925+0000","last_undegraded":"2024-04-25T10:27:43.280925+0000","last_fullsized":"2024-04-25T10:27:43.280925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780202+0000","last_change":"2024-04-25T10:25:41.232828+0000","last_active":"2024-04-25T10:27:42.780202+0000","last_peered":"2024-04-25T10:27:42.780202+0000","last_clean":"2024-04-25T10:27:42.780202+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:27:42.780202+0000","last_undegraded":"2024-04-25T10:27:42.780202+0000","last_fullsized":"2024-04-25T10:27:42.780202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:01.782881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:09.656041+0000","last_change":"2024-04-25T10:25:36.190035+0000","last_active":"2024-04-25T10:28:09.656041+0000","last_peered":"2024-04-25T10:28:09.656041+0000","last_clean":"2024-04-25T10:28:09.656041+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:28:09.656041+0000","last_undegraded":"2024-04-25T10:28:09.656041+0000","last_fullsized":"2024-04-25T10:28:09.656041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":7,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.429329+0000","last_change":"2024-04-25T10:25:37.191742+0000","last_active":"2024-04-25T10:27:42.429329+0000","last_peered":"2024-04-25T10:27:42.429329+0000","last_clean":"2024-04-25T10:27:42.429329+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:27:42.429329+0000","last_undegraded":"2024-04-25T10:27:42.429329+0000","last_fullsized":"2024-04-25T10:27:42.429329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780246+0000","last_change":"2024-04-25T10:25:41.242444+0000","last_active":"2024-04-25T10:27:42.780246+0000","last_peered":"2024-04-25T10:27:42.780246+0000","last_clean":"2024-04-25T10:27:42.780246+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:27:42.780246+0000","last_undegraded":"2024-04-25T10:27:42.780246+0000","last_fullsized":"2024-04-25T10:27:42.780246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195642+0000","last_change":"2024-04-25T10:25:36.190527+0000","last_active":"2024-04-25T10:27:43.195642+0000","last_peered":"2024-04-25T10:27:43.195642+0000","last_clean":"2024-04-25T10:27:43.195642+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:27:43.195642+0000","last_undegraded":"2024-04-25T10:27:43.195642+0000","last_fullsized":"2024-04-25T10:27:43.195642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283453+0000","last_change":"2024-04-25T10:25:37.204468+0000","last_active":"2024-04-25T10:27:43.283453+0000","last_peered":"2024-04-25T10:27:43.283453+0000","last_clean":"2024-04-25T10:27:43.283453+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:27:43.283453+0000","last_undegraded":"2024-04-25T10:27:43.283453+0000","last_fullsized":"2024-04-25T10:27:43.283453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780091+0000","last_change":"2024-04-25T10:25:41.236518+0000","last_active":"2024-04-25T10:27:42.780091+0000","last_peered":"2024-04-25T10:27:42.780091+0000","last_clean":"2024-04-25T10:27:42.780091+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:27:42.780091+0000","last_undegraded":"2024-04-25T10:27:42.780091+0000","last_fullsized":"2024-04-25T10:27:42.780091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282642+0000","last_change":"2024-04-25T10:25:37.194114+0000","last_active":"2024-04-25T10:27:43.282642+0000","last_peered":"2024-04-25T10:27:43.282642+0000","last_clean":"2024-04-25T10:27:43.282642+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:27:43.282642+0000","last_undegraded":"2024-04-25T10:27:43.282642+0000","last_fullsized":"2024-04-25T10:27:43.282642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:40.192156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.656892+0000","last_change":"2024-04-25T10:25:36.188266+0000","last_active":"2024-04-25T10:27:54.656892+0000","last_peered":"2024-04-25T10:27:54.656892+0000","last_clean":"2024-04-25T10:27:54.656892+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:27:54.656892+0000","last_undegraded":"2024-04-25T10:27:54.656892+0000","last_fullsized":"2024-04-25T10:27:54.656892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.845953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283091+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:27:43.283091+0000","last_peered":"2024-04-25T10:27:43.283091+0000","last_clean":"2024-04-25T10:27:43.283091+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:27:43.283091+0000","last_undegraded":"2024-04-25T10:27:43.283091+0000","last_fullsized":"2024-04-25T10:27:43.283091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:13.684019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426239+0000","last_change":"2024-04-25T10:25:37.166002+0000","last_active":"2024-04-25T10:27:42.426239+0000","last_peered":"2024-04-25T10:27:42.426239+0000","last_clean":"2024-04-25T10:27:42.426239+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:27:42.426239+0000","last_undegraded":"2024-04-25T10:27:42.426239+0000","last_fullsized":"2024-04-25T10:27:42.426239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279806+0000","last_change":"2024-04-25T10:25:36.168204+0000","last_active":"2024-04-25T10:27:43.279806+0000","last_peered":"2024-04-25T10:27:43.279806+0000","last_clean":"2024-04-25T10:27:43.279806+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:27:43.279806+0000","last_undegraded":"2024-04-25T10:27:43.279806+0000","last_fullsized":"2024-04-25T10:27:43.279806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.907635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195061+0000","last_change":"2024-04-25T10:25:41.257264+0000","last_active":"2024-04-25T10:27:43.195061+0000","last_peered":"2024-04-25T10:27:43.195061+0000","last_clean":"2024-04-25T10:27:43.195061+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:27:43.195061+0000","last_undegraded":"2024-04-25T10:27:43.195061+0000","last_fullsized":"2024-04-25T10:27:43.195061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278490+0000","last_change":"2024-04-25T10:25:37.158884+0000","last_active":"2024-04-25T10:27:43.278490+0000","last_peered":"2024-04-25T10:27:43.278490+0000","last_clean":"2024-04-25T10:27:43.278490+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:27:43.278490+0000","last_undegraded":"2024-04-25T10:27:43.278490+0000","last_fullsized":"2024-04-25T10:27:43.278490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278949+0000","last_change":"2024-04-25T10:25:36.173499+0000","last_active":"2024-04-25T10:27:43.278949+0000","last_peered":"2024-04-25T10:27:43.278949+0000","last_clean":"2024-04-25T10:27:43.278949+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:27:43.278949+0000","last_undegraded":"2024-04-25T10:27:43.278949+0000","last_fullsized":"2024-04-25T10:27:43.278949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426750+0000","last_change":"2024-04-25T10:25:41.239990+0000","last_active":"2024-04-25T10:27:42.426750+0000","last_peered":"2024-04-25T10:27:42.426750+0000","last_clean":"2024-04-25T10:27:42.426750+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:27:42.426750+0000","last_undegraded":"2024-04-25T10:27:42.426750+0000","last_fullsized":"2024-04-25T10:27:42.426750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:15.055786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282179+0000","last_change":"2024-04-25T10:25:37.193560+0000","last_active":"2024-04-25T10:27:43.282179+0000","last_peered":"2024-04-25T10:27:43.282179+0000","last_clean":"2024-04-25T10:27:43.282179+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:27:43.282179+0000","last_undegraded":"2024-04-25T10:27:43.282179+0000","last_fullsized":"2024-04-25T10:27:43.282179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.193166+0000","last_change":"2024-04-25T10:25:36.174077+0000","last_active":"2024-04-25T10:27:43.193166+0000","last_peered":"2024-04-25T10:27:43.193166+0000","last_clean":"2024-04-25T10:27:43.193166+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:27:43.193166+0000","last_undegraded":"2024-04-25T10:27:43.193166+0000","last_fullsized":"2024-04-25T10:27:43.193166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781240+0000","last_change":"2024-04-25T10:25:41.262158+0000","last_active":"2024-04-25T10:27:42.781240+0000","last_peered":"2024-04-25T10:27:42.781240+0000","last_clean":"2024-04-25T10:27:42.781240+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:27:42.781240+0000","last_undegraded":"2024-04-25T10:27:42.781240+0000","last_fullsized":"2024-04-25T10:27:42.781240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279955+0000","last_change":"2024-04-25T10:25:37.159876+0000","last_active":"2024-04-25T10:27:43.279955+0000","last_peered":"2024-04-25T10:27:43.279955+0000","last_clean":"2024-04-25T10:27:43.279955+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:27:43.279955+0000","last_undegraded":"2024-04-25T10:27:43.279955+0000","last_fullsized":"2024-04-25T10:27:43.279955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284548+0000","last_change":"2024-04-25T10:25:36.194275+0000","last_active":"2024-04-25T10:27:43.284548+0000","last_peered":"2024-04-25T10:27:43.284548+0000","last_clean":"2024-04-25T10:27:43.284548+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:27:43.284548+0000","last_undegraded":"2024-04-25T10:27:43.284548+0000","last_fullsized":"2024-04-25T10:27:43.284548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780250+0000","last_change":"2024-04-25T10:25:41.261185+0000","last_active":"2024-04-25T10:27:42.780250+0000","last_peered":"2024-04-25T10:27:42.780250+0000","last_clean":"2024-04-25T10:27:42.780250+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:27:42.780250+0000","last_undegraded":"2024-04-25T10:27:42.780250+0000","last_fullsized":"2024-04-25T10:27:42.780250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280158+0000","last_change":"2024-04-25T10:25:37.165436+0000","last_active":"2024-04-25T10:27:43.280158+0000","last_peered":"2024-04-25T10:27:43.280158+0000","last_clean":"2024-04-25T10:27:43.280158+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:27:43.280158+0000","last_undegraded":"2024-04-25T10:27:43.280158+0000","last_fullsized":"2024-04-25T10:27:43.280158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:57.724462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'11","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.494095+0000","last_change":"2024-04-25T10:25:36.181966+0000","last_active":"2024-04-25T10:28:46.494095+0000","last_peered":"2024-04-25T10:28:46.494095+0000","last_clean":"2024-04-25T10:28:46.494095+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:28:46.494095+0000","last_undegraded":"2024-04-25T10:28:46.494095+0000","last_fullsized":"2024-04-25T10:28:46.494095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:54.925540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278487+0000","last_change":"2024-04-25T10:25:41.246715+0000","last_active":"2024-04-25T10:27:43.278487+0000","last_peered":"2024-04-25T10:27:43.278487+0000","last_clean":"2024-04-25T10:27:43.278487+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:27:43.278487+0000","last_undegraded":"2024-04-25T10:27:43.278487+0000","last_fullsized":"2024-04-25T10:27:43.278487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:03.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280786+0000","last_change":"2024-04-25T10:25:37.170738+0000","last_active":"2024-04-25T10:27:43.280786+0000","last_peered":"2024-04-25T10:27:43.280786+0000","last_clean":"2024-04-25T10:27:43.280786+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:27:43.280786+0000","last_undegraded":"2024-04-25T10:27:43.280786+0000","last_fullsized":"2024-04-25T10:27:43.280786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:43.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284276+0000","last_change":"2024-04-25T10:25:36.186052+0000","last_active":"2024-04-25T10:27:43.284276+0000","last_peered":"2024-04-25T10:27:43.284276+0000","last_clean":"2024-04-25T10:27:43.284276+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:27:43.284276+0000","last_undegraded":"2024-04-25T10:27:43.284276+0000","last_fullsized":"2024-04-25T10:27:43.284276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:42.615541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279843+0000","last_change":"2024-04-25T10:25:41.244909+0000","last_active":"2024-04-25T10:27:43.279843+0000","last_peered":"2024-04-25T10:27:43.279843+0000","last_clean":"2024-04-25T10:27:43.279843+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:27:43.279843+0000","last_undegraded":"2024-04-25T10:27:43.279843+0000","last_fullsized":"2024-04-25T10:27:43.279843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781028+0000","last_change":"2024-04-25T10:25:37.181614+0000","last_active":"2024-04-25T10:27:42.781028+0000","last_peered":"2024-04-25T10:27:42.781028+0000","last_clean":"2024-04-25T10:27:42.781028+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:27:42.781028+0000","last_undegraded":"2024-04-25T10:27:42.781028+0000","last_fullsized":"2024-04-25T10:27:42.781028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280145+0000","last_change":"2024-04-25T10:25:36.166395+0000","last_active":"2024-04-25T10:27:43.280145+0000","last_peered":"2024-04-25T10:27:43.280145+0000","last_clean":"2024-04-25T10:27:43.280145+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:27:43.280145+0000","last_undegraded":"2024-04-25T10:27:43.280145+0000","last_fullsized":"2024-04-25T10:27:43.280145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279527+0000","last_change":"2024-04-25T10:25:41.237175+0000","last_active":"2024-04-25T10:27:43.279527+0000","last_peered":"2024-04-25T10:27:43.279527+0000","last_clean":"2024-04-25T10:27:43.279527+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:27:43.279527+0000","last_undegraded":"2024-04-25T10:27:43.279527+0000","last_fullsized":"2024-04-25T10:27:43.279527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194409+0000","last_change":"2024-04-25T10:25:37.192638+0000","last_active":"2024-04-25T10:27:43.194409+0000","last_peered":"2024-04-25T10:27:43.194409+0000","last_clean":"2024-04-25T10:27:43.194409+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:27:43.194409+0000","last_undegraded":"2024-04-25T10:27:43.194409+0000","last_fullsized":"2024-04-25T10:27:43.194409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:44.654592+0000","last_change":"2024-04-25T10:25:36.182126+0000","last_active":"2024-04-25T10:27:44.654592+0000","last_peered":"2024-04-25T10:27:44.654592+0000","last_clean":"2024-04-25T10:27:44.654592+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:27:44.654592+0000","last_undegraded":"2024-04-25T10:27:44.654592+0000","last_fullsized":"2024-04-25T10:27:44.654592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:50.385012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280453+0000","last_change":"2024-04-25T10:25:41.247504+0000","last_active":"2024-04-25T10:27:43.280453+0000","last_peered":"2024-04-25T10:27:43.280453+0000","last_clean":"2024-04-25T10:27:43.280453+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:27:43.280453+0000","last_undegraded":"2024-04-25T10:27:43.280453+0000","last_fullsized":"2024-04-25T10:27:43.280453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279226+0000","last_change":"2024-04-25T10:25:37.171962+0000","last_active":"2024-04-25T10:27:43.279226+0000","last_peered":"2024-04-25T10:27:43.279226+0000","last_clean":"2024-04-25T10:27:43.279226+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:27:43.279226+0000","last_undegraded":"2024-04-25T10:27:43.279226+0000","last_fullsized":"2024-04-25T10:27:43.279226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.499878+0000","last_change":"2024-04-25T10:25:36.167914+0000","last_active":"2024-04-25T10:28:46.499878+0000","last_peered":"2024-04-25T10:28:46.499878+0000","last_clean":"2024-04-25T10:28:46.499878+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:28:46.499878+0000","last_undegraded":"2024-04-25T10:28:46.499878+0000","last_fullsized":"2024-04-25T10:28:46.499878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.281110+0000","last_change":"2024-04-25T10:25:41.250414+0000","last_active":"2024-04-25T10:27:43.281110+0000","last_peered":"2024-04-25T10:27:43.281110+0000","last_clean":"2024-04-25T10:27:43.281110+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:27:43.281110+0000","last_undegraded":"2024-04-25T10:27:43.281110+0000","last_fullsized":"2024-04-25T10:27:43.281110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279484+0000","last_change":"2024-04-25T10:25:37.179610+0000","last_active":"2024-04-25T10:27:43.279484+0000","last_peered":"2024-04-25T10:27:43.279484+0000","last_clean":"2024-04-25T10:27:43.279484+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:27:43.279484+0000","last_undegraded":"2024-04-25T10:27:43.279484+0000","last_fullsized":"2024-04-25T10:27:43.279484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:22.862181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.727049+0000","last_change":"2024-04-25T10:25:36.187683+0000","last_active":"2024-04-25T10:28:07.727049+0000","last_peered":"2024-04-25T10:28:07.727049+0000","last_clean":"2024-04-25T10:28:07.727049+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:28:07.727049+0000","last_undegraded":"2024-04-25T10:28:07.727049+0000","last_fullsized":"2024-04-25T10:28:07.727049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279929+0000","last_change":"2024-04-25T10:25:41.239687+0000","last_active":"2024-04-25T10:27:43.279929+0000","last_peered":"2024-04-25T10:27:43.279929+0000","last_clean":"2024-04-25T10:27:43.279929+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:27:43.279929+0000","last_undegraded":"2024-04-25T10:27:43.279929+0000","last_fullsized":"2024-04-25T10:27:43.279929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.061875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278799+0000","last_change":"2024-04-25T10:25:37.172981+0000","last_active":"2024-04-25T10:27:43.278799+0000","last_peered":"2024-04-25T10:27:43.278799+0000","last_clean":"2024-04-25T10:27:43.278799+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:27:43.278799+0000","last_undegraded":"2024-04-25T10:27:43.278799+0000","last_fullsized":"2024-04-25T10:27:43.278799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:44.654627+0000","last_change":"2024-04-25T10:25:36.186586+0000","last_active":"2024-04-25T10:27:44.654627+0000","last_peered":"2024-04-25T10:27:44.654627+0000","last_clean":"2024-04-25T10:27:44.654627+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:27:44.654627+0000","last_undegraded":"2024-04-25T10:27:44.654627+0000","last_fullsized":"2024-04-25T10:27:44.654627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:00.696356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428150+0000","last_change":"2024-04-25T10:25:25.811918+0000","last_active":"2024-04-25T10:27:42.428150+0000","last_peered":"2024-04-25T10:27:42.428150+0000","last_clean":"2024-04-25T10:27:42.428150+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:27:42.428150+0000","last_undegraded":"2024-04-25T10:27:42.428150+0000","last_fullsized":"2024-04-25T10:27:42.428150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:24.774439+0000","last_clean_scrub_stamp":"2024-04-25T10:25:24.774439+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:46.603072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283902+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:27:43.283902+0000","last_peered":"2024-04-25T10:27:43.283902+0000","last_clean":"2024-04-25T10:27:43.283902+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:27:43.283902+0000","last_undegraded":"2024-04-25T10:27:43.283902+0000","last_fullsized":"2024-04-25T10:27:43.283902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:56.121358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283710+0000","last_change":"2024-04-25T10:25:37.187670+0000","last_active":"2024-04-25T10:27:43.283710+0000","last_peered":"2024-04-25T10:27:43.283710+0000","last_clean":"2024-04-25T10:27:43.283710+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:27:43.283710+0000","last_undegraded":"2024-04-25T10:27:43.283710+0000","last_fullsized":"2024-04-25T10:27:43.283710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:09.567527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.729957+0000","last_change":"2024-04-25T10:25:36.190434+0000","last_active":"2024-04-25T10:28:07.729957+0000","last_peered":"2024-04-25T10:28:07.729957+0000","last_clean":"2024-04-25T10:28:07.729957+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:28:07.729957+0000","last_undegraded":"2024-04-25T10:28:07.729957+0000","last_fullsized":"2024-04-25T10:28:07.729957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780176+0000","last_change":"2024-04-25T10:25:41.249210+0000","last_active":"2024-04-25T10:27:42.780176+0000","last_peered":"2024-04-25T10:27:42.780176+0000","last_clean":"2024-04-25T10:27:42.780176+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:27:42.780176+0000","last_undegraded":"2024-04-25T10:27:42.780176+0000","last_fullsized":"2024-04-25T10:27:42.780176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195593+0000","last_change":"2024-04-25T10:25:37.176608+0000","last_active":"2024-04-25T10:27:43.195593+0000","last_peered":"2024-04-25T10:27:43.195593+0000","last_clean":"2024-04-25T10:27:43.195593+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:27:43.195593+0000","last_undegraded":"2024-04-25T10:27:43.195593+0000","last_fullsized":"2024-04-25T10:27:43.195593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:05.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280330+0000","last_change":"2024-04-25T10:25:36.175833+0000","last_active":"2024-04-25T10:27:43.280330+0000","last_peered":"2024-04-25T10:27:43.280330+0000","last_clean":"2024-04-25T10:27:43.280330+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:27:43.280330+0000","last_undegraded":"2024-04-25T10:27:43.280330+0000","last_fullsized":"2024-04-25T10:27:43.280330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279397+0000","last_change":"2024-04-25T10:25:41.256600+0000","last_active":"2024-04-25T10:27:43.279397+0000","last_peered":"2024-04-25T10:27:43.279397+0000","last_clean":"2024-04-25T10:27:43.279397+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:27:43.279397+0000","last_undegraded":"2024-04-25T10:27:43.279397+0000","last_fullsized":"2024-04-25T10:27:43.279397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:26.653641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195181+0000","last_change":"2024-04-25T10:25:37.185203+0000","last_active":"2024-04-25T10:27:43.195181+0000","last_peered":"2024-04-25T10:27:43.195181+0000","last_clean":"2024-04-25T10:27:43.195181+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:27:43.195181+0000","last_undegraded":"2024-04-25T10:27:43.195181+0000","last_fullsized":"2024-04-25T10:27:43.195181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:59.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279990+0000","last_change":"2024-04-25T10:25:36.168542+0000","last_active":"2024-04-25T10:27:43.279990+0000","last_peered":"2024-04-25T10:27:43.279990+0000","last_clean":"2024-04-25T10:27:43.279990+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:27:43.279990+0000","last_undegraded":"2024-04-25T10:27:43.279990+0000","last_fullsized":"2024-04-25T10:27:43.279990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.281759+0000","last_change":"2024-04-25T10:25:41.242053+0000","last_active":"2024-04-25T10:27:43.281759+0000","last_peered":"2024-04-25T10:27:43.281759+0000","last_clean":"2024-04-25T10:27:43.281759+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:27:43.281759+0000","last_undegraded":"2024-04-25T10:27:43.281759+0000","last_fullsized":"2024-04-25T10:27:43.281759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:05.200696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781697+0000","last_change":"2024-04-25T10:25:37.198952+0000","last_active":"2024-04-25T10:27:42.781697+0000","last_peered":"2024-04-25T10:27:42.781697+0000","last_clean":"2024-04-25T10:27:42.781697+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:27:42.781697+0000","last_undegraded":"2024-04-25T10:27:42.781697+0000","last_fullsized":"2024-04-25T10:27:42.781697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:51.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.653232+0000","last_change":"2024-04-25T10:25:36.179694+0000","last_active":"2024-04-25T10:27:54.653232+0000","last_peered":"2024-04-25T10:27:54.653232+0000","last_clean":"2024-04-25T10:27:54.653232+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:27:54.653232+0000","last_undegraded":"2024-04-25T10:27:54.653232+0000","last_fullsized":"2024-04-25T10:27:54.653232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:02.258358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428298+0000","last_change":"2024-04-25T10:25:41.251379+0000","last_active":"2024-04-25T10:27:42.428298+0000","last_peered":"2024-04-25T10:27:42.428298+0000","last_clean":"2024-04-25T10:27:42.428298+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:27:42.428298+0000","last_undegraded":"2024-04-25T10:27:42.428298+0000","last_fullsized":"2024-04-25T10:27:42.428298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:47.690188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282183+0000","last_change":"2024-04-25T10:25:37.202390+0000","last_active":"2024-04-25T10:27:43.282183+0000","last_peered":"2024-04-25T10:27:43.282183+0000","last_clean":"2024-04-25T10:27:43.282183+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:27:43.282183+0000","last_undegraded":"2024-04-25T10:27:43.282183+0000","last_fullsized":"2024-04-25T10:27:43.282183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'16","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.731880+0000","last_change":"2024-04-25T10:25:36.154879+0000","last_active":"2024-04-25T10:28:07.731880+0000","last_peered":"2024-04-25T10:28:07.731880+0000","last_clean":"2024-04-25T10:28:07.731880+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:28:07.731880+0000","last_undegraded":"2024-04-25T10:28:07.731880+0000","last_fullsized":"2024-04-25T10:28:07.731880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:15.409114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280514+0000","last_change":"2024-04-25T10:25:41.239631+0000","last_active":"2024-04-25T10:27:43.280514+0000","last_peered":"2024-04-25T10:27:43.280514+0000","last_clean":"2024-04-25T10:27:43.280514+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:27:43.280514+0000","last_undegraded":"2024-04-25T10:27:43.280514+0000","last_fullsized":"2024-04-25T10:27:43.280514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:17.684623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428678+0000","last_change":"2024-04-25T10:25:37.181525+0000","last_active":"2024-04-25T10:27:42.428678+0000","last_peered":"2024-04-25T10:27:42.428678+0000","last_clean":"2024-04-25T10:27:42.428678+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:27:42.428678+0000","last_undegraded":"2024-04-25T10:27:42.428678+0000","last_fullsized":"2024-04-25T10:27:42.428678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:47.435073+0000","last_change":"2024-04-25T10:25:36.192797+0000","last_active":"2024-04-25T10:27:47.435073+0000","last_peered":"2024-04-25T10:27:47.435073+0000","last_clean":"2024-04-25T10:27:47.435073+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:27:47.435073+0000","last_undegraded":"2024-04-25T10:27:47.435073+0000","last_fullsized":"2024-04-25T10:27:47.435073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:51.887274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280869+0000","last_change":"2024-04-25T10:25:41.244618+0000","last_active":"2024-04-25T10:27:43.280869+0000","last_peered":"2024-04-25T10:27:43.280869+0000","last_clean":"2024-04-25T10:27:43.280869+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:27:43.280869+0000","last_undegraded":"2024-04-25T10:27:43.280869+0000","last_fullsized":"2024-04-25T10:27:43.280869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:13.625947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284116+0000","last_change":"2024-04-25T10:25:37.208984+0000","last_active":"2024-04-25T10:27:43.284116+0000","last_peered":"2024-04-25T10:27:43.284116+0000","last_clean":"2024-04-25T10:27:43.284116+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:27:43.284116+0000","last_undegraded":"2024-04-25T10:27:43.284116+0000","last_fullsized":"2024-04-25T10:27:43.284116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.658061+0000","last_change":"2024-04-25T10:25:36.185689+0000","last_active":"2024-04-25T10:27:59.658061+0000","last_peered":"2024-04-25T10:27:59.658061+0000","last_clean":"2024-04-25T10:27:59.658061+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:27:59.658061+0000","last_undegraded":"2024-04-25T10:27:59.658061+0000","last_fullsized":"2024-04-25T10:27:59.658061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:35.671970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280314+0000","last_change":"2024-04-25T10:25:41.247314+0000","last_active":"2024-04-25T10:27:43.280314+0000","last_peered":"2024-04-25T10:27:43.280314+0000","last_clean":"2024-04-25T10:27:43.280314+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:27:43.280314+0000","last_undegraded":"2024-04-25T10:27:43.280314+0000","last_fullsized":"2024-04-25T10:27:43.280314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279734+0000","last_change":"2024-04-25T10:25:37.193696+0000","last_active":"2024-04-25T10:27:43.279734+0000","last_peered":"2024-04-25T10:27:43.279734+0000","last_clean":"2024-04-25T10:27:43.279734+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:27:43.279734+0000","last_undegraded":"2024-04-25T10:27:43.279734+0000","last_fullsized":"2024-04-25T10:27:43.279734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.728571+0000","last_change":"2024-04-25T10:25:36.181843+0000","last_active":"2024-04-25T10:28:07.728571+0000","last_peered":"2024-04-25T10:28:07.728571+0000","last_clean":"2024-04-25T10:28:07.728571+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:28:07.728571+0000","last_undegraded":"2024-04-25T10:28:07.728571+0000","last_fullsized":"2024-04-25T10:28:07.728571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283282+0000","last_change":"2024-04-25T10:25:41.247061+0000","last_active":"2024-04-25T10:27:43.283282+0000","last_peered":"2024-04-25T10:27:43.283282+0000","last_clean":"2024-04-25T10:27:43.283282+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:27:43.283282+0000","last_undegraded":"2024-04-25T10:27:43.283282+0000","last_fullsized":"2024-04-25T10:27:43.283282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.491573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195370+0000","last_change":"2024-04-25T10:25:37.185402+0000","last_active":"2024-04-25T10:27:43.195370+0000","last_peered":"2024-04-25T10:27:43.195370+0000","last_clean":"2024-04-25T10:27:43.195370+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:27:43.195370+0000","last_undegraded":"2024-04-25T10:27:43.195370+0000","last_fullsized":"2024-04-25T10:27:43.195370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:52.497384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'23","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.497836+0000","last_change":"2024-04-25T10:25:36.166998+0000","last_active":"2024-04-25T10:28:46.497836+0000","last_peered":"2024-04-25T10:28:46.497836+0000","last_clean":"2024-04-25T10:28:46.497836+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:28:46.497836+0000","last_undegraded":"2024-04-25T10:28:46.497836+0000","last_fullsized":"2024-04-25T10:28:46.497836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:25.145233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33043,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:43.157048+0000","last_change":"2024-04-25T10:25:41.248522+0000","last_active":"2024-04-25T10:28:43.157048+0000","last_peered":"2024-04-25T10:28:43.157048+0000","last_clean":"2024-04-25T10:28:43.157048+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:28:43.157048+0000","last_undegraded":"2024-04-25T10:28:43.157048+0000","last_fullsized":"2024-04-25T10:28:43.157048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:51.139406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282916+0000","last_change":"2024-04-25T10:25:37.196588+0000","last_active":"2024-04-25T10:27:43.282916+0000","last_peered":"2024-04-25T10:27:43.282916+0000","last_clean":"2024-04-25T10:27:43.282916+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:27:43.282916+0000","last_undegraded":"2024-04-25T10:27:43.282916+0000","last_fullsized":"2024-04-25T10:27:43.282916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:00.003456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.494929+0000","last_change":"2024-04-25T10:25:36.156630+0000","last_active":"2024-04-25T10:28:46.494929+0000","last_peered":"2024-04-25T10:28:46.494929+0000","last_clean":"2024-04-25T10:28:46.494929+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:28:46.494929+0000","last_undegraded":"2024-04-25T10:28:46.494929+0000","last_fullsized":"2024-04-25T10:28:46.494929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780922+0000","last_change":"2024-04-25T10:26:18.708803+0000","last_active":"2024-04-25T10:27:42.780922+0000","last_peered":"2024-04-25T10:27:42.780922+0000","last_clean":"2024-04-25T10:27:42.780922+0000","last_became_active":"2024-04-25T10:26:18.708320+0000","last_became_peered":"2024-04-25T10:26:18.708320+0000","last_unstale":"2024-04-25T10:27:42.780922+0000","last_undegraded":"2024-04-25T10:27:42.780922+0000","last_fullsized":"2024-04-25T10:27:42.780922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:09.714453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,7],"acting":[2,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280982+0000","last_change":"2024-04-25T10:25:37.187575+0000","last_active":"2024-04-25T10:27:43.280982+0000","last_peered":"2024-04-25T10:27:43.280982+0000","last_clean":"2024-04-25T10:27:43.280982+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:27:43.280982+0000","last_undegraded":"2024-04-25T10:27:43.280982+0000","last_fullsized":"2024-04-25T10:27:43.280982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194905+0000","last_change":"2024-04-25T10:25:36.183582+0000","last_active":"2024-04-25T10:27:43.194905+0000","last_peered":"2024-04-25T10:27:43.194905+0000","last_clean":"2024-04-25T10:27:43.194905+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:27:43.194905+0000","last_undegraded":"2024-04-25T10:27:43.194905+0000","last_fullsized":"2024-04-25T10:27:43.194905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:40.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.425916+0000","last_change":"2024-04-25T10:25:41.238488+0000","last_active":"2024-04-25T10:27:42.425916+0000","last_peered":"2024-04-25T10:27:42.425916+0000","last_clean":"2024-04-25T10:27:42.425916+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:27:42.425916+0000","last_undegraded":"2024-04-25T10:27:42.425916+0000","last_fullsized":"2024-04-25T10:27:42.425916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:05.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781685+0000","last_change":"2024-04-25T10:25:37.192707+0000","last_active":"2024-04-25T10:27:42.781685+0000","last_peered":"2024-04-25T10:27:42.781685+0000","last_clean":"2024-04-25T10:27:42.781685+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:27:42.781685+0000","last_undegraded":"2024-04-25T10:27:42.781685+0000","last_fullsized":"2024-04-25T10:27:42.781685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:04.655214+0000","last_change":"2024-04-25T10:25:36.173755+0000","last_active":"2024-04-25T10:28:04.655214+0000","last_peered":"2024-04-25T10:28:04.655214+0000","last_clean":"2024-04-25T10:28:04.655214+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:28:04.655214+0000","last_undegraded":"2024-04-25T10:28:04.655214+0000","last_fullsized":"2024-04-25T10:28:04.655214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278627+0000","last_change":"2024-04-25T10:25:41.248983+0000","last_active":"2024-04-25T10:27:43.278627+0000","last_peered":"2024-04-25T10:27:43.278627+0000","last_clean":"2024-04-25T10:27:43.278627+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:27:43.278627+0000","last_undegraded":"2024-04-25T10:27:43.278627+0000","last_fullsized":"2024-04-25T10:27:43.278627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.880608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279809+0000","last_change":"2024-04-25T10:25:41.246692+0000","last_active":"2024-04-25T10:27:43.279809+0000","last_peered":"2024-04-25T10:27:43.279809+0000","last_clean":"2024-04-25T10:27:43.279809+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:27:43.279809+0000","last_undegraded":"2024-04-25T10:27:43.279809+0000","last_fullsized":"2024-04-25T10:27:43.279809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:44.250576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278814+0000","last_change":"2024-04-25T10:25:37.178691+0000","last_active":"2024-04-25T10:27:43.278814+0000","last_peered":"2024-04-25T10:27:43.278814+0000","last_clean":"2024-04-25T10:27:43.278814+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:27:43.278814+0000","last_undegraded":"2024-04-25T10:27:43.278814+0000","last_fullsized":"2024-04-25T10:27:43.278814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282596+0000","last_change":"2024-04-25T10:25:36.191338+0000","last_active":"2024-04-25T10:27:43.282596+0000","last_peered":"2024-04-25T10:27:43.282596+0000","last_clean":"2024-04-25T10:27:43.282596+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:27:43.282596+0000","last_undegraded":"2024-04-25T10:27:43.282596+0000","last_fullsized":"2024-04-25T10:27:43.282596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:26.145222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.283891+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:27:43.283891+0000","last_peered":"2024-04-25T10:27:43.283891+0000","last_clean":"2024-04-25T10:27:43.283891+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:27:43.283891+0000","last_undegraded":"2024-04-25T10:27:43.283891+0000","last_fullsized":"2024-04-25T10:27:43.283891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:21.254459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279373+0000","last_change":"2024-04-25T10:25:37.170931+0000","last_active":"2024-04-25T10:27:43.279373+0000","last_peered":"2024-04-25T10:27:43.279373+0000","last_clean":"2024-04-25T10:27:43.279373+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:27:43.279373+0000","last_undegraded":"2024-04-25T10:27:43.279373+0000","last_fullsized":"2024-04-25T10:27:43.279373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.731321+0000","last_change":"2024-04-25T10:25:36.173721+0000","last_active":"2024-04-25T10:28:07.731321+0000","last_peered":"2024-04-25T10:28:07.731321+0000","last_clean":"2024-04-25T10:28:07.731321+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:28:07.731321+0000","last_undegraded":"2024-04-25T10:28:07.731321+0000","last_fullsized":"2024-04-25T10:28:07.731321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:42.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.738163+0000","last_change":"2024-04-25T10:25:36.195499+0000","last_active":"2024-04-25T10:28:07.738163+0000","last_peered":"2024-04-25T10:28:07.738163+0000","last_clean":"2024-04-25T10:28:07.738163+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:28:07.738163+0000","last_undegraded":"2024-04-25T10:28:07.738163+0000","last_fullsized":"2024-04-25T10:28:07.738163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:05.600702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278821+0000","last_change":"2024-04-25T10:25:37.180896+0000","last_active":"2024-04-25T10:27:43.278821+0000","last_peered":"2024-04-25T10:27:43.278821+0000","last_clean":"2024-04-25T10:27:43.278821+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:27:43.278821+0000","last_undegraded":"2024-04-25T10:27:43.278821+0000","last_fullsized":"2024-04-25T10:27:43.278821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279711+0000","last_change":"2024-04-25T10:25:41.231793+0000","last_active":"2024-04-25T10:27:43.279711+0000","last_peered":"2024-04-25T10:27:43.279711+0000","last_clean":"2024-04-25T10:27:43.279711+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:27:43.279711+0000","last_undegraded":"2024-04-25T10:27:43.279711+0000","last_fullsized":"2024-04-25T10:27:43.279711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:33.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279659+0000","last_change":"2024-04-25T10:25:36.166742+0000","last_active":"2024-04-25T10:27:43.279659+0000","last_peered":"2024-04-25T10:27:43.279659+0000","last_clean":"2024-04-25T10:27:43.279659+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:27:43.279659+0000","last_undegraded":"2024-04-25T10:27:43.279659+0000","last_fullsized":"2024-04-25T10:27:43.279659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428380+0000","last_change":"2024-04-25T10:25:37.185699+0000","last_active":"2024-04-25T10:27:42.428380+0000","last_peered":"2024-04-25T10:27:42.428380+0000","last_clean":"2024-04-25T10:27:42.428380+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:27:42.428380+0000","last_undegraded":"2024-04-25T10:27:42.428380+0000","last_fullsized":"2024-04-25T10:27:42.428380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426354+0000","last_change":"2024-04-25T10:25:41.258191+0000","last_active":"2024-04-25T10:27:42.426354+0000","last_peered":"2024-04-25T10:27:42.426354+0000","last_clean":"2024-04-25T10:27:42.426354+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:27:42.426354+0000","last_undegraded":"2024-04-25T10:27:42.426354+0000","last_fullsized":"2024-04-25T10:27:42.426354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.479785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780838+0000","last_change":"2024-04-25T10:25:37.183192+0000","last_active":"2024-04-25T10:27:42.780838+0000","last_peered":"2024-04-25T10:27:42.780838+0000","last_clean":"2024-04-25T10:27:42.780838+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:27:42.780838+0000","last_undegraded":"2024-04-25T10:27:42.780838+0000","last_fullsized":"2024-04-25T10:27:42.780838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:16.425341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426068+0000","last_change":"2024-04-25T10:25:37.180242+0000","last_active":"2024-04-25T10:27:42.426068+0000","last_peered":"2024-04-25T10:27:42.426068+0000","last_clean":"2024-04-25T10:27:42.426068+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:27:42.426068+0000","last_undegraded":"2024-04-25T10:27:42.426068+0000","last_fullsized":"2024-04-25T10:27:42.426068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282478+0000","last_change":"2024-04-25T10:25:37.187312+0000","last_active":"2024-04-25T10:27:43.282478+0000","last_peered":"2024-04-25T10:27:43.282478+0000","last_clean":"2024-04-25T10:27:43.282478+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:27:43.282478+0000","last_undegraded":"2024-04-25T10:27:43.282478+0000","last_fullsized":"2024-04-25T10:27:43.282478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:22.595222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279529+0000","last_change":"2024-04-25T10:25:37.166351+0000","last_active":"2024-04-25T10:27:43.279529+0000","last_peered":"2024-04-25T10:27:43.279529+0000","last_clean":"2024-04-25T10:27:43.279529+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:27:43.279529+0000","last_undegraded":"2024-04-25T10:27:43.279529+0000","last_fullsized":"2024-04-25T10:27:43.279529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:43.950141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280670+0000","last_change":"2024-04-25T10:26:18.699084+0000","last_active":"2024-04-25T10:27:43.280670+0000","last_peered":"2024-04-25T10:27:43.280670+0000","last_clean":"2024-04-25T10:27:43.280670+0000","last_became_active":"2024-04-25T10:26:18.698625+0000","last_became_peered":"2024-04-25T10:26:18.698625+0000","last_unstale":"2024-04-25T10:27:43.280670+0000","last_undegraded":"2024-04-25T10:27:43.280670+0000","last_fullsized":"2024-04-25T10:27:43.280670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:44.112645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.281198+0000","last_change":"2024-04-25T10:25:37.170647+0000","last_active":"2024-04-25T10:27:43.281198+0000","last_peered":"2024-04-25T10:27:43.281198+0000","last_clean":"2024-04-25T10:27:43.281198+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:27:43.281198+0000","last_undegraded":"2024-04-25T10:27:43.281198+0000","last_fullsized":"2024-04-25T10:27:43.281198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781292+0000","last_change":"2024-04-25T10:25:37.196676+0000","last_active":"2024-04-25T10:27:42.781292+0000","last_peered":"2024-04-25T10:27:42.781292+0000","last_clean":"2024-04-25T10:27:42.781292+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:27:42.781292+0000","last_undegraded":"2024-04-25T10:27:42.781292+0000","last_fullsized":"2024-04-25T10:27:42.781292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280807+0000","last_change":"2024-04-25T10:25:37.186567+0000","last_active":"2024-04-25T10:27:43.280807+0000","last_peered":"2024-04-25T10:27:43.280807+0000","last_clean":"2024-04-25T10:27:43.280807+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:27:43.280807+0000","last_undegraded":"2024-04-25T10:27:43.280807+0000","last_fullsized":"2024-04-25T10:27:43.280807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282553+0000","last_change":"2024-04-25T10:25:37.184887+0000","last_active":"2024-04-25T10:27:43.282553+0000","last_peered":"2024-04-25T10:27:43.282553+0000","last_clean":"2024-04-25T10:27:43.282553+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:27:43.282553+0000","last_undegraded":"2024-04-25T10:27:43.282553+0000","last_fullsized":"2024-04-25T10:27:43.282553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279191+0000","last_change":"2024-04-25T10:25:37.196649+0000","last_active":"2024-04-25T10:27:43.279191+0000","last_peered":"2024-04-25T10:27:43.279191+0000","last_clean":"2024-04-25T10:27:43.279191+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:27:43.279191+0000","last_undegraded":"2024-04-25T10:27:43.279191+0000","last_fullsized":"2024-04-25T10:27:43.279191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:13.421366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.428204+0000","last_change":"2024-04-25T10:25:37.192093+0000","last_active":"2024-04-25T10:27:42.428204+0000","last_peered":"2024-04-25T10:27:42.428204+0000","last_clean":"2024-04-25T10:27:42.428204+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:27:42.428204+0000","last_undegraded":"2024-04-25T10:27:42.428204+0000","last_fullsized":"2024-04-25T10:27:42.428204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278653+0000","last_change":"2024-04-25T10:25:37.184014+0000","last_active":"2024-04-25T10:27:43.278653+0000","last_peered":"2024-04-25T10:27:43.278653+0000","last_clean":"2024-04-25T10:27:43.278653+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:27:43.278653+0000","last_undegraded":"2024-04-25T10:27:43.278653+0000","last_fullsized":"2024-04-25T10:27:43.278653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:52.810612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195111+0000","last_change":"2024-04-25T10:25:37.187384+0000","last_active":"2024-04-25T10:27:43.195111+0000","last_peered":"2024-04-25T10:27:43.195111+0000","last_clean":"2024-04-25T10:27:43.195111+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:27:43.195111+0000","last_undegraded":"2024-04-25T10:27:43.195111+0000","last_fullsized":"2024-04-25T10:27:43.195111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:03.942449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284184+0000","last_change":"2024-04-25T10:25:37.195712+0000","last_active":"2024-04-25T10:27:43.284184+0000","last_peered":"2024-04-25T10:27:43.284184+0000","last_clean":"2024-04-25T10:27:43.284184+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:27:43.284184+0000","last_undegraded":"2024-04-25T10:27:43.284184+0000","last_fullsized":"2024-04-25T10:27:43.284184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:13.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426883+0000","last_change":"2024-04-25T10:25:37.198664+0000","last_active":"2024-04-25T10:27:42.426883+0000","last_peered":"2024-04-25T10:27:42.426883+0000","last_clean":"2024-04-25T10:27:42.426883+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:27:42.426883+0000","last_undegraded":"2024-04-25T10:27:42.426883+0000","last_fullsized":"2024-04-25T10:27:42.426883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.284482+0000","last_change":"2024-04-25T10:25:37.203174+0000","last_active":"2024-04-25T10:27:43.284482+0000","last_peered":"2024-04-25T10:27:43.284482+0000","last_clean":"2024-04-25T10:27:43.284482+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:27:43.284482+0000","last_undegraded":"2024-04-25T10:27:43.284482+0000","last_fullsized":"2024-04-25T10:27:43.284482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:05.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.282160+0000","last_change":"2024-04-25T10:25:37.199911+0000","last_active":"2024-04-25T10:27:43.282160+0000","last_peered":"2024-04-25T10:27:43.282160+0000","last_clean":"2024-04-25T10:27:43.282160+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:27:43.282160+0000","last_undegraded":"2024-04-25T10:27:43.282160+0000","last_fullsized":"2024-04-25T10:27:43.282160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:29.272654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.278998+0000","last_change":"2024-04-25T10:25:37.177405+0000","last_active":"2024-04-25T10:27:43.278998+0000","last_peered":"2024-04-25T10:27:43.278998+0000","last_clean":"2024-04-25T10:27:43.278998+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:27:43.278998+0000","last_undegraded":"2024-04-25T10:27:43.278998+0000","last_fullsized":"2024-04-25T10:27:43.278998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:10.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.634145+0000","last_change":"2024-04-25T10:25:37.167752+0000","last_active":"2024-04-25T10:27:59.634145+0000","last_peered":"2024-04-25T10:27:59.634145+0000","last_clean":"2024-04-25T10:27:59.634145+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:27:59.634145+0000","last_undegraded":"2024-04-25T10:27:59.634145+0000","last_fullsized":"2024-04-25T10:27:59.634145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280308+0000","last_change":"2024-04-25T10:25:37.180781+0000","last_active":"2024-04-25T10:27:43.280308+0000","last_peered":"2024-04-25T10:27:43.280308+0000","last_clean":"2024-04-25T10:27:43.280308+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:27:43.280308+0000","last_undegraded":"2024-04-25T10:27:43.280308+0000","last_fullsized":"2024-04-25T10:27:43.280308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194792+0000","last_change":"2024-04-25T10:25:37.192759+0000","last_active":"2024-04-25T10:27:43.194792+0000","last_peered":"2024-04-25T10:27:43.194792+0000","last_clean":"2024-04-25T10:27:43.194792+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:27:43.194792+0000","last_undegraded":"2024-04-25T10:27:43.194792+0000","last_fullsized":"2024-04-25T10:27:43.194792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:36.256620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195256+0000","last_change":"2024-04-25T10:25:37.195532+0000","last_active":"2024-04-25T10:27:43.195256+0000","last_peered":"2024-04-25T10:27:43.195256+0000","last_clean":"2024-04-25T10:27:43.195256+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:27:43.195256+0000","last_undegraded":"2024-04-25T10:27:43.195256+0000","last_fullsized":"2024-04-25T10:27:43.195256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:47.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194446+0000","last_change":"2024-04-25T10:25:37.200331+0000","last_active":"2024-04-25T10:27:43.194446+0000","last_peered":"2024-04-25T10:27:43.194446+0000","last_clean":"2024-04-25T10:27:43.194446+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:27:43.194446+0000","last_undegraded":"2024-04-25T10:27:43.194446+0000","last_fullsized":"2024-04-25T10:27:43.194446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:26.287592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.429870+0000","last_change":"2024-04-25T10:25:37.194514+0000","last_active":"2024-04-25T10:27:42.429870+0000","last_peered":"2024-04-25T10:27:42.429870+0000","last_clean":"2024-04-25T10:27:42.429870+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:27:42.429870+0000","last_undegraded":"2024-04-25T10:27:42.429870+0000","last_fullsized":"2024-04-25T10:27:42.429870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279230+0000","last_change":"2024-04-25T10:25:37.177730+0000","last_active":"2024-04-25T10:27:43.279230+0000","last_peered":"2024-04-25T10:27:43.279230+0000","last_clean":"2024-04-25T10:27:43.279230+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:27:43.279230+0000","last_undegraded":"2024-04-25T10:27:43.279230+0000","last_fullsized":"2024-04-25T10:27:43.279230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:27.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.193851+0000","last_change":"2024-04-25T10:25:37.173419+0000","last_active":"2024-04-25T10:27:43.193851+0000","last_peered":"2024-04-25T10:27:43.193851+0000","last_clean":"2024-04-25T10:27:43.193851+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:27:43.193851+0000","last_undegraded":"2024-04-25T10:27:43.193851+0000","last_fullsized":"2024-04-25T10:27:43.193851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.780611+0000","last_change":"2024-04-25T10:25:37.182871+0000","last_active":"2024-04-25T10:27:42.780611+0000","last_peered":"2024-04-25T10:27:42.780611+0000","last_clean":"2024-04-25T10:27:42.780611+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:27:42.780611+0000","last_undegraded":"2024-04-25T10:27:42.780611+0000","last_fullsized":"2024-04-25T10:27:42.780611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.194479+0000","last_change":"2024-04-25T10:25:37.173983+0000","last_active":"2024-04-25T10:27:43.194479+0000","last_peered":"2024-04-25T10:27:43.194479+0000","last_clean":"2024-04-25T10:27:43.194479+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:27:43.194479+0000","last_undegraded":"2024-04-25T10:27:43.194479+0000","last_fullsized":"2024-04-25T10:27:43.194479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.781241+0000","last_change":"2024-04-25T10:25:37.182178+0000","last_active":"2024-04-25T10:27:42.781241+0000","last_peered":"2024-04-25T10:27:42.781241+0000","last_clean":"2024-04-25T10:27:42.781241+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:27:42.781241+0000","last_undegraded":"2024-04-25T10:27:42.781241+0000","last_fullsized":"2024-04-25T10:27:42.781241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280171+0000","last_change":"2024-04-25T10:25:37.170383+0000","last_active":"2024-04-25T10:27:43.280171+0000","last_peered":"2024-04-25T10:27:43.280171+0000","last_clean":"2024-04-25T10:27:43.280171+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:27:43.280171+0000","last_undegraded":"2024-04-25T10:27:43.280171+0000","last_fullsized":"2024-04-25T10:27:43.280171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:43.199723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280501+0000","last_change":"2024-04-25T10:25:37.167687+0000","last_active":"2024-04-25T10:27:43.280501+0000","last_peered":"2024-04-25T10:27:43.280501+0000","last_clean":"2024-04-25T10:27:43.280501+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:27:43.280501+0000","last_undegraded":"2024-04-25T10:27:43.280501+0000","last_fullsized":"2024-04-25T10:27:43.280501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:14.427987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.195171+0000","last_change":"2024-04-25T10:25:37.196591+0000","last_active":"2024-04-25T10:27:43.195171+0000","last_peered":"2024-04-25T10:27:43.195171+0000","last_clean":"2024-04-25T10:27:43.195171+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:27:43.195171+0000","last_undegraded":"2024-04-25T10:27:43.195171+0000","last_fullsized":"2024-04-25T10:27:43.195171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:12.331416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":36863,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":75,"num_read_kb":78,"num_write":160,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":73726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":121998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":712262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":155491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":153957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":892928,"data_stored":711408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":33077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":34611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:28:52.031 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:28:52.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.342+0000 7ff565c00640 1 Processor -- start 2024-04-25T10:28:52.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.342+0000 7ff565c00640 1 -- start start 2024-04-25T10:28:52.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.345+0000 7ff565c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff56015a370 0x7ff560070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:52.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.345+0000 7ff565c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff560073d20 0x7ff560154060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:52.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.345+0000 7ff565c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff56015a8b0 con 0x7ff5600c7f90 2024-04-25T10:28:52.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.345+0000 7ff565c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff560072ea0 con 0x7ff560073d20 2024-04-25T10:28:52.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.345+0000 7ff565c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff560073180 con 0x7ff56015a370 2024-04-25T10:28:52.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.345+0000 7ff557e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff5600c7f90 0x7ff560073610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35330/0 (socket says 172.21.15.19:35330) 2024-04-25T10:28:52.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.345+0000 7ff557e00640 1 -- 172.21.15.19:0/2860035983 learned_addr learned my addr 172.21.15.19:0/2860035983 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:52.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.345+0000 7ff55fe00640 1 --2- 172.21.15.19:0/2860035983 >> v2:172.21.15.112:3300/0 conn(0x7ff56015a370 0x7ff560070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:52.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.345+0000 7ff565200640 1 --2- 172.21.15.19:0/2860035983 >> v2:172.21.15.19:3300/0 conn(0x7ff560073d20 0x7ff560154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.346+0000 7ff55f400640 1 -- 172.21.15.19:0/2860035983 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057111506 0 0) 0x7ff56015a8b0 con 0x7ff5600c7f90 2024-04-25T10:28:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.346+0000 7ff55fe00640 1 -- 172.21.15.19:0/2860035983 >> v2:172.21.15.19:3300/0 conn(0x7ff560073d20 msgr2=0x7ff560154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.346+0000 7ff55fe00640 1 --2- 172.21.15.19:0/2860035983 >> v2:172.21.15.19:3300/0 conn(0x7ff560073d20 0x7ff560154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.346+0000 7ff55fe00640 1 -- 172.21.15.19:0/2860035983 >> v1:172.21.15.19:6789/0 conn(0x7ff5600c7f90 legacy=0x7ff560073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.346+0000 7ff55fe00640 1 -- 172.21.15.19:0/2860035983 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56015ab70 con 0x7ff56015a370 2024-04-25T10:28:52.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.347+0000 7ff55fe00640 1 --2- 172.21.15.19:0/2860035983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff56015a370 0x7ff560070860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff560072950 tx=0x7ff55002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bae221793c81a682 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:52.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.347+0000 7ff55f400640 1 -- 172.21.15.19:0/2860035983 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550037070 con 0x7ff56015a370 2024-04-25T10:28:52.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.347+0000 7ff55f400640 1 -- 172.21.15.19:0/2860035983 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff550032440 con 0x7ff56015a370 2024-04-25T10:28:52.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.347+0000 7ff55f400640 1 -- 172.21.15.19:0/2860035983 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55002ae60 con 0x7ff56015a370 2024-04-25T10:28:52.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.348+0000 7ff565c00640 1 -- 172.21.15.19:0/2860035983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff56015a370 msgr2=0x7ff560070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:52.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.348+0000 7ff565c00640 1 --2- 172.21.15.19:0/2860035983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff56015a370 0x7ff560070860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff560072950 tx=0x7ff55002a110 comp rx=0 tx=0).stop 2024-04-25T10:28:52.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.348+0000 7ff565c00640 1 -- 172.21.15.19:0/2860035983 shutdown_connections 2024-04-25T10:28:52.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.348+0000 7ff565c00640 1 --2- 172.21.15.19:0/2860035983 >> v2:172.21.15.19:3300/0 conn(0x7ff560073d20 0x7ff560154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:52.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.348+0000 7ff565c00640 1 --2- 172.21.15.19:0/2860035983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff56015a370 0x7ff560070860 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:52.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.348+0000 7ff565c00640 1 -- 172.21.15.19:0/2860035983 >> 172.21.15.19:0/2860035983 conn(0x7ff5600cdbc0 msgr2=0x7ff5600ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:52.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.348+0000 7ff565c00640 1 -- 172.21.15.19:0/2860035983 shutdown_connections 2024-04-25T10:28:52.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.348+0000 7ff565c00640 1 -- 172.21.15.19:0/2860035983 wait complete. 2024-04-25T10:28:52.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.351+0000 7ff565c00640 1 Processor -- start 2024-04-25T10:28:52.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.351+0000 7ff565c00640 1 -- start start 2024-04-25T10:28:52.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.352+0000 7ff565c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5600c7f90 0x7ff5601e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.352+0000 7ff565c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56015a370 0x7ff560151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.352+0000 7ff565c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff56014ce30 0x7ff56014d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.352+0000 7ff565c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff5600c4b20 con 0x7ff56015a370 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.352+0000 7ff565c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff56015b130 con 0x7ff5600c7f90 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.352+0000 7ff565c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff560070da0 con 0x7ff56014ce30 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.353+0000 7ff55fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5600c7f90 0x7ff5601e2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.353+0000 7ff55fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5600c7f90 0x7ff5601e2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:55800/0 (socket says 172.21.15.19:55800) 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.353+0000 7ff55fe00640 1 -- 172.21.15.19:0/241473875 learned_addr learned my addr 172.21.15.19:0/241473875 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.353+0000 7ff565200640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff56014ce30 0x7ff56014d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.353+0000 7ff557e00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56015a370 0x7ff560151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.353+0000 7ff55fe00640 1 -- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff56014ce30 msgr2=0x7ff56014d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.353+0000 7ff55fe00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff56014ce30 0x7ff56014d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.353+0000 7ff55fe00640 1 -- 172.21.15.19:0/241473875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56015a370 msgr2=0x7ff560151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:52.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.353+0000 7ff55fe00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56015a370 0x7ff560151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:52.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.353+0000 7ff55fe00640 1 -- 172.21.15.19:0/241473875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5601e3340 con 0x7ff5600c7f90 2024-04-25T10:28:52.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.353+0000 7ff557e00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56015a370 0x7ff560151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:28:52.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.354+0000 7ff55fe00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5600c7f90 0x7ff5601e2e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff550009890 tx=0x7ff5500046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:52.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.354+0000 7ff55cc00640 1 -- 172.21.15.19:0/241473875 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550037040 con 0x7ff5600c7f90 2024-04-25T10:28:52.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.354+0000 7ff55cc00640 1 -- 172.21.15.19:0/241473875 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff550042070 con 0x7ff5600c7f90 2024-04-25T10:28:52.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.354+0000 7ff55cc00640 1 -- 172.21.15.19:0/241473875 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550030920 con 0x7ff5600c7f90 2024-04-25T10:28:52.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.354+0000 7ff565c00640 1 -- 172.21.15.19:0/241473875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5601e3e20 con 0x7ff5600c7f90 2024-04-25T10:28:52.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.354+0000 7ff565c00640 1 -- 172.21.15.19:0/241473875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5601e40c0 con 0x7ff5600c7f90 2024-04-25T10:28:52.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.355+0000 7ff565c00640 1 -- 172.21.15.19:0/241473875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5600727e0 con 0x7ff5600c7f90 2024-04-25T10:28:52.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.357+0000 7ff55cc00640 1 -- 172.21.15.19:0/241473875 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff550030ac0 con 0x7ff5600c7f90 2024-04-25T10:28:52.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.358+0000 7ff55cc00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff53c0744b0 0x7ff53c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:52.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.358+0000 7ff55cc00640 1 -- 172.21.15.19:0/241473875 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7ff5500b5d50 con 0x7ff5600c7f90 2024-04-25T10:28:52.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.358+0000 7ff557e00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff53c0744b0 0x7ff53c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:52.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.359+0000 7ff557e00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff53c0744b0 0x7ff53c0769c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff548000f60 tx=0x7ff548007cc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.363+0000 7ff55cc00640 1 -- 172.21.15.19:0/241473875 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff5600727e0 con 0x7ff5600c7f90 2024-04-25T10:28:52.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.572+0000 7ff565c00640 1 -- 172.21.15.19:0/241473875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5600c97e0 con 0x7ff5600c7f90 2024-04-25T10:28:52.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.574+0000 7ff55cc00640 1 -- 172.21.15.19:0/241473875 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18745 (secure 0 0 0) 0x7ff5600c97e0 con 0x7ff5600c7f90 2024-04-25T10:28:52.576 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:28:52.576 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:27:42.417364+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/3008138931":"2024-04-26T10:27:42.417214+0000","172.21.15.112:6836/3008138931":"2024-04-26T10:27:42.417214+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 -- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff53c0744b0 msgr2=0x7ff53c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff53c0744b0 0x7ff53c0769c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff548000f60 tx=0x7ff548007cc0 comp rx=0 tx=0).stop 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 -- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5600c7f90 msgr2=0x7ff5601e2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5600c7f90 0x7ff5601e2e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff550009890 tx=0x7ff5500046c0 comp rx=0 tx=0).stop 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 -- 172.21.15.19:0/241473875 shutdown_connections 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff53c0744b0 0x7ff53c0769c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff56014ce30 0x7ff56014d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56015a370 0x7ff560151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 --2- 172.21.15.19:0/241473875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5600c7f90 0x7ff5601e2e00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 -- 172.21.15.19:0/241473875 >> 172.21.15.19:0/241473875 conn(0x7ff5600cdbc0 msgr2=0x7ff560153100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 -- 172.21.15.19:0/241473875 shutdown_connections 2024-04-25T10:28:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:52.577+0000 7ff565c00640 1 -- 172.21.15.19:0/241473875 wait complete. 2024-04-25T10:28:53.607 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T10:28:53.608 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:28:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.879+0000 7f94c8e00640 1 Processor -- start 2024-04-25T10:28:53.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.880+0000 7f94c8e00640 1 -- start start 2024-04-25T10:28:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.882+0000 7f94c8e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94c4154500 0x7f94c4072f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.882+0000 7f94c8e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94c40c8160 0x7f94c40ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.882+0000 7f94c8e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94c40c8680 con 0x7f94c40c7d50 2024-04-25T10:28:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.882+0000 7f94c8e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f94c40c8940 con 0x7f94c4154500 2024-04-25T10:28:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.882+0000 7f94c8e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f94c40c8c20 con 0x7f94c40c8160 2024-04-25T10:28:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.882+0000 7f94c3400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94c4154500 0x7f94c4072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.882+0000 7f94baa00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f94c40c7d50 0x7f94c415a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:48998/0 (socket says 172.21.15.19:48998) 2024-04-25T10:28:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.882+0000 7f94c3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94c40c8160 0x7f94c40ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.882+0000 7f94baa00640 1 -- 172.21.15.19:0/3645637252 learned_addr learned my addr 172.21.15.19:0/3645637252 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.883+0000 7f94c3400640 1 -- 172.21.15.19:0/3645637252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94c40c8160 msgr2=0x7f94c40ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.883+0000 7f94c3400640 1 --2- 172.21.15.19:0/3645637252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94c40c8160 0x7f94c40ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.883+0000 7f94c3400640 1 -- 172.21.15.19:0/3645637252 >> v1:172.21.15.112:6789/0 conn(0x7f94c40c7d50 legacy=0x7f94c415a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.883+0000 7f94c3400640 1 -- 172.21.15.19:0/3645637252 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c40c8f00 con 0x7f94c4154500 2024-04-25T10:28:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.884+0000 7f94c3400640 1 --2- 172.21.15.19:0/3645637252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94c4154500 0x7f94c4072f40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009d90 tx=0x7f94b402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=576b295a9b24a3ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.884+0000 7f94c2a00640 1 -- 172.21.15.19:0/3645637252 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4007740 con 0x7f94c4154500 2024-04-25T10:28:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.884+0000 7f94c2a00640 1 -- 172.21.15.19:0/3645637252 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b40078e0 con 0x7f94c4154500 2024-04-25T10:28:53.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.884+0000 7f94c2a00640 1 -- 172.21.15.19:0/3645637252 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4007cb0 con 0x7f94c4154500 2024-04-25T10:28:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.885+0000 7f94c8e00640 1 -- 172.21.15.19:0/3645637252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94c4154500 msgr2=0x7f94c4072f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.885+0000 7f94c8e00640 1 --2- 172.21.15.19:0/3645637252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94c4154500 0x7f94c4072f40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009d90 tx=0x7f94b402a6f0 comp rx=0 tx=0).stop 2024-04-25T10:28:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.885+0000 7f94c8e00640 1 -- 172.21.15.19:0/3645637252 shutdown_connections 2024-04-25T10:28:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.885+0000 7f94c8e00640 1 --2- 172.21.15.19:0/3645637252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94c40c8160 0x7f94c40ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.885+0000 7f94c8e00640 1 --2- 172.21.15.19:0/3645637252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94c4154500 0x7f94c4072f40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:53.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.885+0000 7f94c8e00640 1 -- 172.21.15.19:0/3645637252 >> 172.21.15.19:0/3645637252 conn(0x7f94c4070d10 msgr2=0x7f94c4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.885+0000 7f94c8e00640 1 -- 172.21.15.19:0/3645637252 shutdown_connections 2024-04-25T10:28:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.885+0000 7f94c8e00640 1 -- 172.21.15.19:0/3645637252 wait complete. 2024-04-25T10:28:53.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.888+0000 7f94c8e00640 1 Processor -- start 2024-04-25T10:28:53.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.889+0000 7f94c8e00640 1 -- start start 2024-04-25T10:28:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.891+0000 7f94c8e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94c40c7d50 0x7f94c414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:53.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.891+0000 7f94c8e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94c4154500 0x7f94c41ee330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.891+0000 7f94c8e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94c40cb150 0x7f94c41e4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.891+0000 7f94c8e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f94c415af10 con 0x7f94c40c7d50 2024-04-25T10:28:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.891+0000 7f94c8e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f94c4073480 con 0x7f94c40cb150 2024-04-25T10:28:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.891+0000 7f94c8e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f94c415b090 con 0x7f94c4154500 2024-04-25T10:28:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.891+0000 7f94c3400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94c40c7d50 0x7f94c414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.891+0000 7f94c3400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94c40c7d50 0x7f94c414e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59744/0 (socket says 172.21.15.19:59744) 2024-04-25T10:28:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.891+0000 7f94c3400640 1 -- 172.21.15.19:0/2554207130 learned_addr learned my addr 172.21.15.19:0/2554207130 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.891+0000 7f94c3e00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94c40cb150 0x7f94c41e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:53.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.891+0000 7f94baa00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94c4154500 0x7f94c41ee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94baa00640 1 -- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94c40cb150 msgr2=0x7f94c41e4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94baa00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94c40cb150 0x7f94c41e4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94baa00640 1 -- 172.21.15.19:0/2554207130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94c40c7d50 msgr2=0x7f94c414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94baa00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94c40c7d50 0x7f94c414e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94baa00640 1 -- 172.21.15.19:0/2554207130 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c414edf0 con 0x7f94c4154500 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94c3400640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94c40c7d50 0x7f94c414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94baa00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94c4154500 0x7f94c41ee330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f94ac000f60 tx=0x7f94ac00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94bbe00640 1 -- 172.21.15.19:0/2554207130 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac017070 con 0x7f94c4154500 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94bbe00640 1 -- 172.21.15.19:0/2554207130 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ac005ce0 con 0x7f94c4154500 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94c8e00640 1 -- 172.21.15.19:0/2554207130 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c414de10 con 0x7f94c4154500 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94bbe00640 1 -- 172.21.15.19:0/2554207130 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac007310 con 0x7f94c4154500 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.892+0000 7f94c8e00640 1 -- 172.21.15.19:0/2554207130 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c414e0b0 con 0x7f94c4154500 2024-04-25T10:28:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.893+0000 7f94c8e00640 1 -- 172.21.15.19:0/2554207130 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94c4151bd0 con 0x7f94c4154500 2024-04-25T10:28:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.895+0000 7f94bbe00640 1 -- 172.21.15.19:0/2554207130 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f94ac01a070 con 0x7f94c4154500 2024-04-25T10:28:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.896+0000 7f94bbe00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f94a00744b0 0x7f94a00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.896+0000 7f94bbe00640 1 -- 172.21.15.19:0/2554207130 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f94ac094fd0 con 0x7f94c4154500 2024-04-25T10:28:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.897+0000 7f94bbe00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] conn(0x7f94a007ddc0 0x7f94a0080290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.897+0000 7f94bbe00640 1 -- 172.21.15.19:0/2554207130 --> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94ac01dec0 con 0x7f94a007ddc0 2024-04-25T10:28:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.897+0000 7f94bbe00640 1 -- 172.21.15.19:0/2554207130 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f94ac095380 con 0x7f94c4154500 2024-04-25T10:28:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.897+0000 7f94c3400640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f94a00744b0 0x7f94a00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.897+0000 7f94c3e00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] conn(0x7f94a007ddc0 0x7f94a0080290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.897+0000 7f94c3400640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f94a00744b0 0x7f94a00769c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f94b4000f80 tx=0x7f94b402f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.898+0000 7f94c3e00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] conn(0x7f94a007ddc0 0x7f94a0080290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:53.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.899+0000 7f94bbe00640 1 -- 172.21.15.19:0/2554207130 <== osd.0 v2:172.21.15.19:6824/3943322367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f94ac01dec0 con 0x7f94a007ddc0 2024-04-25T10:28:53.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.914+0000 7f94c8e00640 1 -- 172.21.15.19:0/2554207130 --> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f94c41eece0 con 0x7f94a007ddc0 2024-04-25T10:28:53.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.915+0000 7f94bbe00640 1 -- 172.21.15.19:0/2554207130 <== osd.0 v2:172.21.15.19:6824/3943322367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f94c41eece0 con 0x7f94a007ddc0 2024-04-25T10:28:53.919 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:28:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:28:53.919 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:28:53.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.915+0000 7f94c8e00640 1 -- 172.21.15.19:0/2554207130 >> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] conn(0x7f94a007ddc0 msgr2=0x7f94a0080290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:53.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.915+0000 7f94c8e00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.19:6824/3943322367,v1:172.21.15.19:6825/3943322367] conn(0x7f94a007ddc0 0x7f94a0080290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:53.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.915+0000 7f94c8e00640 1 -- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f94a00744b0 msgr2=0x7f94a00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:53.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.915+0000 7f94c8e00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f94a00744b0 0x7f94a00769c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f94b4000f80 tx=0x7f94b402f000 comp rx=0 tx=0).stop 2024-04-25T10:28:53.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.915+0000 7f94c8e00640 1 -- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94c4154500 msgr2=0x7f94c41ee330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:53.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.915+0000 7f94c8e00640 1 --2- 172.21.15.19:0/2554207130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f94c4154500 0x7f94c41ee330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f94ac000f60 tx=0x7f94ac00c760 comp rx=0 tx=0).stop 2024-04-25T10:28:53.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.916+0000 7f94c3e00640 1 -- 172.21.15.19:0/2554207130 reap_dead start 2024-04-25T10:28:53.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.916+0000 7f94c8e00640 1 -- 172.21.15.19:0/2554207130 shutdown_connections 2024-04-25T10:28:53.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.916+0000 7f94c8e00640 1 -- 172.21.15.19:0/2554207130 >> 172.21.15.19:0/2554207130 conn(0x7f94c4070d10 msgr2=0x7f94c4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:53.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.916+0000 7f94c8e00640 1 -- 172.21.15.19:0/2554207130 shutdown_connections 2024-04-25T10:28:53.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:53.916+0000 7f94c8e00640 1 -- 172.21.15.19:0/2554207130 wait complete. 2024-04-25T10:28:53.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T10:28:54.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.230+0000 7f296a000640 1 Processor -- start 2024-04-25T10:28:54.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.230+0000 7f296a000640 1 -- start start 2024-04-25T10:28:54.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.232+0000 7f296a000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f29640c4930 0x7f29641534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.233+0000 7f296a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2964159b80 0x7f2964159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.233+0000 7f296a000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29640b07c0 con 0x7f29640742c0 2024-04-25T10:28:54.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.233+0000 7f296a000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f29641596f0 con 0x7f29640c4930 2024-04-25T10:28:54.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.233+0000 7f296a000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f29640b2600 con 0x7f2964159b80 2024-04-25T10:28:54.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.233+0000 7f2963400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f29640c4930 0x7f29641534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.233+0000 7f2963400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f29640c4930 0x7f29641534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59758/0 (socket says 172.21.15.19:59758) 2024-04-25T10:28:54.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.233+0000 7f2962a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2964159b80 0x7f2964159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.233+0000 7f2963400640 1 -- 172.21.15.19:0/2401112025 learned_addr learned my addr 172.21.15.19:0/2401112025 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:54.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.233+0000 7f2963e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f29640742c0 0x7f29640c2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35334/0 (socket says 172.21.15.19:35334) 2024-04-25T10:28:54.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.233+0000 7f2962a00640 1 -- 172.21.15.19:0/2401112025 >> v2:172.21.15.19:3300/0 conn(0x7f29640c4930 msgr2=0x7f29641534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:54.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.233+0000 7f2962a00640 1 --2- 172.21.15.19:0/2401112025 >> v2:172.21.15.19:3300/0 conn(0x7f29640c4930 0x7f29641534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.234+0000 7f2962a00640 1 -- 172.21.15.19:0/2401112025 >> v1:172.21.15.19:6789/0 conn(0x7f29640742c0 legacy=0x7f29640c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.234+0000 7f2962a00640 1 -- 172.21.15.19:0/2401112025 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29640b28e0 con 0x7f2964159b80 2024-04-25T10:28:54.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.235+0000 7f2962a00640 1 --2- 172.21.15.19:0/2401112025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2964159b80 0x7f2964159f90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f294c009d90 tx=0x7f294c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98552ea79f81dc5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:54.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.235+0000 7f2962000640 1 -- 172.21.15.19:0/2401112025 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c007740 con 0x7f2964159b80 2024-04-25T10:28:54.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.235+0000 7f2962000640 1 -- 172.21.15.19:0/2401112025 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294c0078e0 con 0x7f2964159b80 2024-04-25T10:28:54.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.235+0000 7f2962000640 1 -- 172.21.15.19:0/2401112025 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c007cb0 con 0x7f2964159b80 2024-04-25T10:28:54.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.236+0000 7f296a000640 1 -- 172.21.15.19:0/2401112025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2964159b80 msgr2=0x7f2964159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.236+0000 7f296a000640 1 --2- 172.21.15.19:0/2401112025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2964159b80 0x7f2964159f90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f294c009d90 tx=0x7f294c02a660 comp rx=0 tx=0).stop 2024-04-25T10:28:54.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.236+0000 7f296a000640 1 -- 172.21.15.19:0/2401112025 shutdown_connections 2024-04-25T10:28:54.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.236+0000 7f296a000640 1 --2- 172.21.15.19:0/2401112025 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2964159b80 0x7f2964159f90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.236+0000 7f296a000640 1 --2- 172.21.15.19:0/2401112025 >> v2:172.21.15.19:3300/0 conn(0x7f29640c4930 0x7f29641534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.236+0000 7f296a000640 1 -- 172.21.15.19:0/2401112025 >> 172.21.15.19:0/2401112025 conn(0x7f296406f1f0 msgr2=0x7f296406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:54.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.236+0000 7f296a000640 1 -- 172.21.15.19:0/2401112025 shutdown_connections 2024-04-25T10:28:54.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.236+0000 7f296a000640 1 -- 172.21.15.19:0/2401112025 wait complete. 2024-04-25T10:28:54.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.238+0000 7f296a000640 1 Processor -- start 2024-04-25T10:28:54.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.239+0000 7f296a000640 1 -- start start 2024-04-25T10:28:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.240+0000 7f296a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29640742c0 0x7f296415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.240+0000 7f296a000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29640c4930 0x7f296414af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.240+0000 7f296a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2964159b80 0x7f29641e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.240+0000 7f296a000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f296415c900 con 0x7f29640c4930 2024-04-25T10:28:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.240+0000 7f296a000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f29640b2ea0 con 0x7f29640742c0 2024-04-25T10:28:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.240+0000 7f296a000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2964153a30 con 0x7f2964159b80 2024-04-25T10:28:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.240+0000 7f2962a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29640c4930 0x7f296414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.240+0000 7f2962a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29640c4930 0x7f296414af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59774/0 (socket says 172.21.15.19:59774) 2024-04-25T10:28:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.240+0000 7f2962a00640 1 -- 172.21.15.19:0/20782727 learned_addr learned my addr 172.21.15.19:0/20782727 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.240+0000 7f2963400640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29640742c0 0x7f296415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.240+0000 7f2963e00640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2964159b80 0x7f29641e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.241+0000 7f2962a00640 1 -- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2964159b80 msgr2=0x7f29641e4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.241+0000 7f2962a00640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2964159b80 0x7f29641e4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.241+0000 7f2962a00640 1 -- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29640742c0 msgr2=0x7f296415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.241+0000 7f2962a00640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29640742c0 0x7f296415ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.241+0000 7f2962a00640 1 -- 172.21.15.19:0/20782727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296415b320 con 0x7f29640c4930 2024-04-25T10:28:54.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.241+0000 7f2963400640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29640742c0 0x7f296415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:54.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.241+0000 7f2962a00640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29640c4930 0x7f296414af90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f294c009eb0 tx=0x7f294c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:54.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.242+0000 7f295b400640 1 -- 172.21.15.19:0/20782727 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c03f070 con 0x7f29640c4930 2024-04-25T10:28:54.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.242+0000 7f295b400640 1 -- 172.21.15.19:0/20782727 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294c031c40 con 0x7f29640c4930 2024-04-25T10:28:54.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.242+0000 7f296a000640 1 -- 172.21.15.19:0/20782727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f296414bca0 con 0x7f29640c4930 2024-04-25T10:28:54.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.242+0000 7f295b400640 1 -- 172.21.15.19:0/20782727 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c009450 con 0x7f29640c4930 2024-04-25T10:28:54.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.242+0000 7f296a000640 1 -- 172.21.15.19:0/20782727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2964158120 con 0x7f29640c4930 2024-04-25T10:28:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.243+0000 7f296a000640 1 -- 172.21.15.19:0/20782727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2964076520 con 0x7f29640c4930 2024-04-25T10:28:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.244+0000 7f295b400640 1 -- 172.21.15.19:0/20782727 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f294c044460 con 0x7f29640c4930 2024-04-25T10:28:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.245+0000 7f295b400640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f29400744e0 0x7f29400769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.245+0000 7f295b400640 1 -- 172.21.15.19:0/20782727 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f294c0b6cb0 con 0x7f29640c4930 2024-04-25T10:28:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.246+0000 7f2963400640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f29400744e0 0x7f29400769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.246+0000 7f2963400640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f29400744e0 0x7f29400769f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f295400bfd0 tx=0x7f295400b450 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:54.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.251+0000 7f295b400640 1 -- 172.21.15.19:0/20782727 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f294c080980 con 0x7f29640c4930 2024-04-25T10:28:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.457+0000 7f296a000640 1 -- 172.21.15.19:0/20782727 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f29641501b0 con 0x7f29400744e0 2024-04-25T10:28:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.458+0000 7f295b400640 1 -- 172.21.15.19:0/20782727 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f29641501b0 con 0x7f29400744e0 2024-04-25T10:28:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T10:28:54.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.460+0000 7f296a000640 1 -- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f29400744e0 msgr2=0x7f29400769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.460+0000 7f296a000640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f29400744e0 0x7f29400769f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f295400bfd0 tx=0x7f295400b450 comp rx=0 tx=0).stop 2024-04-25T10:28:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.461+0000 7f296a000640 1 -- 172.21.15.19:0/20782727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29640c4930 msgr2=0x7f296414af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.461+0000 7f296a000640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29640c4930 0x7f296414af90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f294c009eb0 tx=0x7f294c004a40 comp rx=0 tx=0).stop 2024-04-25T10:28:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.461+0000 7f296a000640 1 -- 172.21.15.19:0/20782727 shutdown_connections 2024-04-25T10:28:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.461+0000 7f296a000640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f29400744e0 0x7f29400769f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.461+0000 7f296a000640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2964159b80 0x7f29641e4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.461+0000 7f296a000640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29640c4930 0x7f296414af90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.461+0000 7f296a000640 1 --2- 172.21.15.19:0/20782727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29640742c0 0x7f296415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.461+0000 7f296a000640 1 -- 172.21.15.19:0/20782727 >> 172.21.15.19:0/20782727 conn(0x7f296406f1f0 msgr2=0x7f2964073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.461+0000 7f296a000640 1 -- 172.21.15.19:0/20782727 shutdown_connections 2024-04-25T10:28:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.461+0000 7f296a000640 1 -- 172.21.15.19:0/20782727 wait complete. 2024-04-25T10:28:54.492 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T10:28:54.492 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:28:54.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.780+0000 7f3cafe00640 1 Processor -- start 2024-04-25T10:28:54.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.781+0000 7f3cafe00640 1 -- start start 2024-04-25T10:28:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.783+0000 7f3cafe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cb00c2640 0x7f3cb00c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.783+0000 7f3cafe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cb00ca090 0x7f3cb00ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.783+0000 7f3cafe00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb015d030 con 0x7f3cb01568d0 2024-04-25T10:28:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.783+0000 7f3cafe00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb00c4550 con 0x7f3cb00ca090 2024-04-25T10:28:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.783+0000 7f3cafe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb0074230 con 0x7f3cb00c2640 2024-04-25T10:28:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.783+0000 7f3caf400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cb00ca090 0x7f3cb00ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.783+0000 7f3caf400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cb00ca090 0x7f3cb00ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59790/0 (socket says 172.21.15.19:59790) 2024-04-25T10:28:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.783+0000 7f3caf400640 1 -- 172.21.15.19:0/2347124158 learned_addr learned my addr 172.21.15.19:0/2347124158 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.784+0000 7f3ca7e00640 1 --2- 172.21.15.19:0/2347124158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cb00c2640 0x7f3cb00c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.784+0000 7f3caf400640 1 -- 172.21.15.19:0/2347124158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cb00c2640 msgr2=0x7f3cb00c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:54.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.784+0000 7f3caf400640 1 --2- 172.21.15.19:0/2347124158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cb00c2640 0x7f3cb00c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.784+0000 7f3caf400640 1 -- 172.21.15.19:0/2347124158 >> v1:172.21.15.19:6789/0 conn(0x7f3cb01568d0 legacy=0x7f3cb00c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.784+0000 7f3caf400640 1 -- 172.21.15.19:0/2347124158 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb015d2d0 con 0x7f3cb00ca090 2024-04-25T10:28:54.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.784+0000 7f3cae000640 1 -- 172.21.15.19:0/2347124158 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2386495386 0 0) 0x7f3cb015d030 con 0x7f3cb01568d0 2024-04-25T10:28:54.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.785+0000 7f3caf400640 1 --2- 172.21.15.19:0/2347124158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb00ca090 0x7f3cb00ca4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009e50 tx=0x7f3ca802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0c001e1d8a1301 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:54.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.786+0000 7f3cae000640 1 -- 172.21.15.19:0/2347124158 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8036070 con 0x7f3cb00ca090 2024-04-25T10:28:54.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.786+0000 7f3cae000640 1 -- 172.21.15.19:0/2347124158 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca8031600 con 0x7f3cb00ca090 2024-04-25T10:28:54.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.786+0000 7f3cae000640 1 -- 172.21.15.19:0/2347124158 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80319d0 con 0x7f3cb00ca090 2024-04-25T10:28:54.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.786+0000 7f3cafe00640 1 -- 172.21.15.19:0/2347124158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb00ca090 msgr2=0x7f3cb00ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.786+0000 7f3cafe00640 1 --2- 172.21.15.19:0/2347124158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb00ca090 0x7f3cb00ca4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009e50 tx=0x7f3ca802a6a0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.786+0000 7f3cafe00640 1 -- 172.21.15.19:0/2347124158 shutdown_connections 2024-04-25T10:28:54.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.786+0000 7f3cafe00640 1 --2- 172.21.15.19:0/2347124158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb00ca090 0x7f3cb00ca4a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.786+0000 7f3cafe00640 1 --2- 172.21.15.19:0/2347124158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cb00c2640 0x7f3cb00c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.787+0000 7f3cafe00640 1 -- 172.21.15.19:0/2347124158 >> 172.21.15.19:0/2347124158 conn(0x7f3cb0070d10 msgr2=0x7f3cb0071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:54.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.787+0000 7f3cafe00640 1 -- 172.21.15.19:0/2347124158 shutdown_connections 2024-04-25T10:28:54.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.787+0000 7f3cafe00640 1 -- 172.21.15.19:0/2347124158 wait complete. 2024-04-25T10:28:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.789+0000 7f3cafe00640 1 Processor -- start 2024-04-25T10:28:54.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.789+0000 7f3cafe00640 1 -- start start 2024-04-25T10:28:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3cafe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb00c2640 0x7f3cb01f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3cafe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cb00ca090 0x7f3cb0160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3cafe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cb01568d0 0x7f3cb0152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3cafe00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb00c9510 con 0x7f3cb00c2640 2024-04-25T10:28:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3cafe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0073f50 con 0x7f3cb01568d0 2024-04-25T10:28:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3cafe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb00c9a30 con 0x7f3cb00ca090 2024-04-25T10:28:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3caea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb00c2640 0x7f3cb01f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3caea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb00c2640 0x7f3cb01f2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59798/0 (socket says 172.21.15.19:59798) 2024-04-25T10:28:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3caea00640 1 -- 172.21.15.19:0/2943169532 learned_addr learned my addr 172.21.15.19:0/2943169532 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:54.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3ca7e00640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cb00ca090 0x7f3cb0160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3caf400640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cb01568d0 0x7f3cb0152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3caea00640 1 -- 172.21.15.19:0/2943169532 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cb00ca090 msgr2=0x7f3cb0160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3caea00640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3cb00ca090 0x7f3cb0160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3caea00640 1 -- 172.21.15.19:0/2943169532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cb01568d0 msgr2=0x7f3cb0152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3caea00640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cb01568d0 0x7f3cb0152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.791+0000 7f3caea00640 1 -- 172.21.15.19:0/2943169532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb01f24b0 con 0x7f3cb00c2640 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.792+0000 7f3caea00640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb00c2640 0x7f3cb01f2970 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3ca000c410 tx=0x7f3ca000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.792+0000 7f3ca6a00640 1 -- 172.21.15.19:0/2943169532 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0017070 con 0x7f3cb00c2640 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.792+0000 7f3ca6a00640 1 -- 172.21.15.19:0/2943169532 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca00052d0 con 0x7f3cb00c2640 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.792+0000 7f3cafe00640 1 -- 172.21.15.19:0/2943169532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb01f2eb0 con 0x7f3cb00c2640 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.792+0000 7f3ca6a00640 1 -- 172.21.15.19:0/2943169532 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0003810 con 0x7f3cb00c2640 2024-04-25T10:28:54.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.792+0000 7f3cafe00640 1 -- 172.21.15.19:0/2943169532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb00ccd10 con 0x7f3cb00c2640 2024-04-25T10:28:54.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.793+0000 7f3cafe00640 1 -- 172.21.15.19:0/2943169532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3cb0050740 con 0x7f3cb00c2640 2024-04-25T10:28:54.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.795+0000 7f3ca6a00640 1 -- 172.21.15.19:0/2943169532 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3ca001a070 con 0x7f3cb00c2640 2024-04-25T10:28:54.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.796+0000 7f3ca6a00640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3c8c0744b0 0x7f3c8c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.796+0000 7f3ca6a00640 1 -- 172.21.15.19:0/2943169532 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f3ca0094fe0 con 0x7f3cb00c2640 2024-04-25T10:28:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.797+0000 7f3ca7e00640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3c8c0744b0 0x7f3c8c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.797+0000 7f3ca6a00640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] conn(0x7f3c8c07ddc0 0x7f3c8c080290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.797+0000 7f3ca6a00640 1 -- 172.21.15.19:0/2943169532 --> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ca001dec0 con 0x7f3c8c07ddc0 2024-04-25T10:28:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.797+0000 7f3ca6a00640 1 -- 172.21.15.19:0/2943169532 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3ca0095470 con 0x7f3cb00c2640 2024-04-25T10:28:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.797+0000 7f3caf400640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] conn(0x7f3c8c07ddc0 0x7f3c8c080290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.797+0000 7f3ca7e00640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3c8c0744b0 0x7f3c8c0769c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3cb01609d0 tx=0x7f3c98009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:54.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.798+0000 7f3caf400640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] conn(0x7f3c8c07ddc0 0x7f3c8c080290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.799+0000 7f3ca6a00640 1 -- 172.21.15.19:0/2943169532 <== osd.1 v2:172.21.15.19:6808/2909216045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ca001dec0 con 0x7f3c8c07ddc0 2024-04-25T10:28:54.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.814+0000 7f3cafe00640 1 -- 172.21.15.19:0/2943169532 --> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3cb01554f0 con 0x7f3c8c07ddc0 2024-04-25T10:28:54.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.814+0000 7f3ca6a00640 1 -- 172.21.15.19:0/2943169532 <== osd.1 v2:172.21.15.19:6808/2909216045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3cb01554f0 con 0x7f3c8c07ddc0 2024-04-25T10:28:54.816 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:28:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:28:54.816 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:28:54.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.814+0000 7f3cafe00640 1 -- 172.21.15.19:0/2943169532 >> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] conn(0x7f3c8c07ddc0 msgr2=0x7f3c8c080290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.814+0000 7f3cafe00640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.19:6808/2909216045,v1:172.21.15.19:6809/2909216045] conn(0x7f3c8c07ddc0 0x7f3c8c080290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.815+0000 7f3cafe00640 1 -- 172.21.15.19:0/2943169532 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3c8c0744b0 msgr2=0x7f3c8c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.815+0000 7f3cafe00640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f3c8c0744b0 0x7f3c8c0769c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3cb01609d0 tx=0x7f3c98009190 comp rx=0 tx=0).stop 2024-04-25T10:28:54.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.815+0000 7f3cafe00640 1 -- 172.21.15.19:0/2943169532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb00c2640 msgr2=0x7f3cb01f2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:54.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.815+0000 7f3cafe00640 1 --2- 172.21.15.19:0/2943169532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb00c2640 0x7f3cb01f2970 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3ca000c410 tx=0x7f3ca000c8d0 comp rx=0 tx=0).stop 2024-04-25T10:28:54.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.815+0000 7f3caf400640 1 -- 172.21.15.19:0/2943169532 reap_dead start 2024-04-25T10:28:54.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.815+0000 7f3cafe00640 1 -- 172.21.15.19:0/2943169532 shutdown_connections 2024-04-25T10:28:54.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.815+0000 7f3cafe00640 1 -- 172.21.15.19:0/2943169532 >> 172.21.15.19:0/2943169532 conn(0x7f3cb0070d10 msgr2=0x7f3cb01549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:54.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.815+0000 7f3cafe00640 1 -- 172.21.15.19:0/2943169532 shutdown_connections 2024-04-25T10:28:54.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:54.815+0000 7f3cafe00640 1 -- 172.21.15.19:0/2943169532 wait complete. 2024-04-25T10:28:54.842 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T10:28:55.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.127+0000 7ff763e00640 1 Processor -- start 2024-04-25T10:28:55.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.127+0000 7ff763e00640 1 -- start start 2024-04-25T10:28:55.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.130+0000 7ff763e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff7641603f0 0x7ff76406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.130+0000 7ff763e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 0x7ff7640709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.130+0000 7ff763e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff76415f990 con 0x7ff7640c9520 2024-04-25T10:28:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.130+0000 7ff763e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff7640c8100 con 0x7ff7641603f0 2024-04-25T10:28:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.130+0000 7ff763e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff76406ed60 con 0x7ff76406fa10 2024-04-25T10:28:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.130+0000 7ff762000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff7641603f0 0x7ff76406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.130+0000 7ff762000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff7641603f0 0x7ff76406f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59812/0 (socket says 172.21.15.19:59812) 2024-04-25T10:28:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.130+0000 7ff762000640 1 -- 172.21.15.19:0/3310406842 learned_addr learned my addr 172.21.15.19:0/3310406842 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.130+0000 7ff763400640 1 --2- 172.21.15.19:0/3310406842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 0x7ff7640709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.131+0000 7ff762000640 1 -- 172.21.15.19:0/3310406842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 msgr2=0x7ff7640709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:55.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.131+0000 7ff762000640 1 --2- 172.21.15.19:0/3310406842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 0x7ff7640709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.131+0000 7ff762000640 1 -- 172.21.15.19:0/3310406842 >> v1:172.21.15.112:6789/0 conn(0x7ff7640c9520 legacy=0x7ff764073010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.131+0000 7ff762000640 1 -- 172.21.15.19:0/3310406842 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7640749d0 con 0x7ff7641603f0 2024-04-25T10:28:55.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.132+0000 7ff762000640 1 --2- 172.21.15.19:0/3310406842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641603f0 0x7ff76406f4d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009870 tx=0x7ff74c02a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44eb0726b09a11eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:55.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.132+0000 7ff761600640 1 -- 172.21.15.19:0/3310406842 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c037070 con 0x7ff7641603f0 2024-04-25T10:28:55.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.132+0000 7ff761600640 1 -- 172.21.15.19:0/3310406842 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74c032440 con 0x7ff7641603f0 2024-04-25T10:28:55.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.132+0000 7ff761600640 1 -- 172.21.15.19:0/3310406842 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c032810 con 0x7ff7641603f0 2024-04-25T10:28:55.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.133+0000 7ff763e00640 1 -- 172.21.15.19:0/3310406842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641603f0 msgr2=0x7ff76406f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.133+0000 7ff763e00640 1 --2- 172.21.15.19:0/3310406842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641603f0 0x7ff76406f4d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009870 tx=0x7ff74c02a1d0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.133+0000 7ff763e00640 1 -- 172.21.15.19:0/3310406842 shutdown_connections 2024-04-25T10:28:55.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.133+0000 7ff763e00640 1 --2- 172.21.15.19:0/3310406842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 0x7ff7640709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.133+0000 7ff763e00640 1 --2- 172.21.15.19:0/3310406842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641603f0 0x7ff76406f4d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.133+0000 7ff763e00640 1 -- 172.21.15.19:0/3310406842 >> 172.21.15.19:0/3310406842 conn(0x7ff76406d120 msgr2=0x7ff7640cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:55.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.133+0000 7ff763e00640 1 -- 172.21.15.19:0/3310406842 shutdown_connections 2024-04-25T10:28:55.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.133+0000 7ff763e00640 1 -- 172.21.15.19:0/3310406842 wait complete. 2024-04-25T10:28:55.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.136+0000 7ff763e00640 1 Processor -- start 2024-04-25T10:28:55.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.136+0000 7ff763e00640 1 -- start start 2024-04-25T10:28:55.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.137+0000 7ff763e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 0x7ff76415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.137+0000 7ff763e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7640c9520 0x7ff764156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.137+0000 7ff763e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641603f0 0x7ff76415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.137+0000 7ff763e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff76406efb0 con 0x7ff7641603f0 2024-04-25T10:28:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.137+0000 7ff763e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff7640c8630 con 0x7ff7640c9520 2024-04-25T10:28:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.137+0000 7ff763e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff764160800 con 0x7ff76406fa10 2024-04-25T10:28:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.138+0000 7ff763400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641603f0 0x7ff76415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.138+0000 7ff762a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 0x7ff76415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.138+0000 7ff762a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 0x7ff76415b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:48370/0 (socket says 172.21.15.19:48370) 2024-04-25T10:28:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.138+0000 7ff762a00640 1 -- 172.21.15.19:0/765292959 learned_addr learned my addr 172.21.15.19:0/765292959 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.138+0000 7ff762000640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7640c9520 0x7ff764156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.138+0000 7ff762a00640 1 -- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7640c9520 msgr2=0x7ff764156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.138+0000 7ff762a00640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7640c9520 0x7ff764156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.138+0000 7ff762a00640 1 -- 172.21.15.19:0/765292959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641603f0 msgr2=0x7ff76415cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.138+0000 7ff762a00640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641603f0 0x7ff76415cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.138+0000 7ff762a00640 1 -- 172.21.15.19:0/765292959 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff764157480 con 0x7ff76406fa10 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.139+0000 7ff762a00640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 0x7ff76415b210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff75400c6c0 tx=0x7ff75400cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.139+0000 7ff75aa00640 1 -- 172.21.15.19:0/765292959 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754003b90 con 0x7ff76406fa10 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.139+0000 7ff75aa00640 1 -- 172.21.15.19:0/765292959 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff754003d30 con 0x7ff76406fa10 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.139+0000 7ff75aa00640 1 -- 172.21.15.19:0/765292959 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754005310 con 0x7ff76406fa10 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.139+0000 7ff763e00640 1 -- 172.21.15.19:0/765292959 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7641f5c20 con 0x7ff76406fa10 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.139+0000 7ff763e00640 1 -- 172.21.15.19:0/765292959 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7641f61e0 con 0x7ff76406fa10 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.140+0000 7ff763e00640 1 -- 172.21.15.19:0/765292959 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff764076520 con 0x7ff76406fa10 2024-04-25T10:28:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.142+0000 7ff75aa00640 1 -- 172.21.15.19:0/765292959 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff7540054b0 con 0x7ff76406fa10 2024-04-25T10:28:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.143+0000 7ff75aa00640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff7400744b0 0x7ff7400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.143+0000 7ff75aa00640 1 -- 172.21.15.19:0/765292959 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7ff754095430 con 0x7ff76406fa10 2024-04-25T10:28:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.143+0000 7ff762000640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff7400744b0 0x7ff7400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.144+0000 7ff762000640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff7400744b0 0x7ff7400769c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff74c034000 tx=0x7ff74c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.148+0000 7ff75aa00640 1 -- 172.21.15.19:0/765292959 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff75405f100 con 0x7ff76406fa10 2024-04-25T10:28:55.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.352+0000 7ff763e00640 1 -- 172.21.15.19:0/765292959 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7ff764156d90 con 0x7ff7400744b0 2024-04-25T10:28:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.353+0000 7ff75aa00640 1 -- 172.21.15.19:0/765292959 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff764156d90 con 0x7ff7400744b0 2024-04-25T10:28:55.355 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T10:28:55.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 -- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff7400744b0 msgr2=0x7ff7400769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff7400744b0 0x7ff7400769c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff74c034000 tx=0x7ff74c02e000 comp rx=0 tx=0).stop 2024-04-25T10:28:55.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 -- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 msgr2=0x7ff76415b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 0x7ff76415b210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff75400c6c0 tx=0x7ff75400cb80 comp rx=0 tx=0).stop 2024-04-25T10:28:55.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 -- 172.21.15.19:0/765292959 shutdown_connections 2024-04-25T10:28:55.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641603f0 0x7ff76415cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7640c9520 0x7ff764156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff7400744b0 0x7ff7400769c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 --2- 172.21.15.19:0/765292959 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff76406fa10 0x7ff76415b210 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 -- 172.21.15.19:0/765292959 >> 172.21.15.19:0/765292959 conn(0x7ff76406d120 msgr2=0x7ff76415d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:55.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 -- 172.21.15.19:0/765292959 shutdown_connections 2024-04-25T10:28:55.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.356+0000 7ff763e00640 1 -- 172.21.15.19:0/765292959 wait complete. 2024-04-25T10:28:55.384 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T10:28:55.385 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:28:55.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.678+0000 7f4925a00640 1 Processor -- start 2024-04-25T10:28:55.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.678+0000 7f4925a00640 1 -- start start 2024-04-25T10:28:55.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.680+0000 7f4925a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49200c4930 0x7f49201534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.680+0000 7f4925a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4920159b80 0x7f4920159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.680+0000 7f4925a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49200b07c0 con 0x7f49200742c0 2024-04-25T10:28:55.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.680+0000 7f4925a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f49201596f0 con 0x7f49200c4930 2024-04-25T10:28:55.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.680+0000 7f4925a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f49200b2600 con 0x7f4920159b80 2024-04-25T10:28:55.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.680+0000 7f491ea00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49200c4930 0x7f49201534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.680+0000 7f491e000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4920159b80 0x7f4920159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.680+0000 7f491ea00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49200c4930 0x7f49201534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59822/0 (socket says 172.21.15.19:59822) 2024-04-25T10:28:55.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.680+0000 7f491ea00640 1 -- 172.21.15.19:0/3172695647 learned_addr learned my addr 172.21.15.19:0/3172695647 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:55.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.681+0000 7f491ea00640 1 -- 172.21.15.19:0/3172695647 >> v2:172.21.15.112:3300/0 conn(0x7f4920159b80 msgr2=0x7f4920159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:55.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.681+0000 7f491ea00640 1 --2- 172.21.15.19:0/3172695647 >> v2:172.21.15.112:3300/0 conn(0x7f4920159b80 0x7f4920159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.681+0000 7f491ea00640 1 -- 172.21.15.19:0/3172695647 >> v1:172.21.15.19:6789/0 conn(0x7f49200742c0 legacy=0x7f49200c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.681+0000 7f491ea00640 1 -- 172.21.15.19:0/3172695647 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49200b28e0 con 0x7f49200c4930 2024-04-25T10:28:55.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.681+0000 7f491d600640 1 -- 172.21.15.19:0/3172695647 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822955449 0 0) 0x7f49200b07c0 con 0x7f49200742c0 2024-04-25T10:28:55.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.682+0000 7f491ea00640 1 --2- 172.21.15.19:0/3172695647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49200c4930 0x7f49201534f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f49200affa0 tx=0x7f491002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f632d832af58666b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:55.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.682+0000 7f491d600640 1 -- 172.21.15.19:0/3172695647 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4910036070 con 0x7f49200c4930 2024-04-25T10:28:55.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.682+0000 7f491d600640 1 -- 172.21.15.19:0/3172695647 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4910031600 con 0x7f49200c4930 2024-04-25T10:28:55.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.682+0000 7f491d600640 1 -- 172.21.15.19:0/3172695647 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49100319d0 con 0x7f49200c4930 2024-04-25T10:28:55.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.683+0000 7f4925a00640 1 -- 172.21.15.19:0/3172695647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49200c4930 msgr2=0x7f49201534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.683+0000 7f4925a00640 1 --2- 172.21.15.19:0/3172695647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49200c4930 0x7f49201534f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f49200affa0 tx=0x7f491002a730 comp rx=0 tx=0).stop 2024-04-25T10:28:55.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.683+0000 7f4925a00640 1 -- 172.21.15.19:0/3172695647 shutdown_connections 2024-04-25T10:28:55.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.683+0000 7f4925a00640 1 --2- 172.21.15.19:0/3172695647 >> v2:172.21.15.112:3300/0 conn(0x7f4920159b80 0x7f4920159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.683+0000 7f4925a00640 1 --2- 172.21.15.19:0/3172695647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49200c4930 0x7f49201534f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.683+0000 7f4925a00640 1 -- 172.21.15.19:0/3172695647 >> 172.21.15.19:0/3172695647 conn(0x7f492006f1f0 msgr2=0x7f492006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:55.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.683+0000 7f4925a00640 1 -- 172.21.15.19:0/3172695647 shutdown_connections 2024-04-25T10:28:55.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.683+0000 7f4925a00640 1 -- 172.21.15.19:0/3172695647 wait complete. 2024-04-25T10:28:55.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.686+0000 7f4925a00640 1 Processor -- start 2024-04-25T10:28:55.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.686+0000 7f4925a00640 1 -- start start 2024-04-25T10:28:55.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.687+0000 7f4925a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49200742c0 0x7f49201f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.687+0000 7f4925a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4920159b80 0x7f49201e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.687+0000 7f4925a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4920158c40 0x7f4920151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.687+0000 7f4925a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f492015c900 con 0x7f4920158c40 2024-04-25T10:28:55.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.687+0000 7f4925a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f49200b2ea0 con 0x7f49200742c0 2024-04-25T10:28:55.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.687+0000 7f4925a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4920153a30 con 0x7f4920159b80 2024-04-25T10:28:55.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.688+0000 7f491f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4920158c40 0x7f4920151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.688+0000 7f491ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49200742c0 0x7f49201f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.688+0000 7f491f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4920158c40 0x7f4920151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59832/0 (socket says 172.21.15.19:59832) 2024-04-25T10:28:55.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.688+0000 7f491f400640 1 -- 172.21.15.19:0/3341040283 learned_addr learned my addr 172.21.15.19:0/3341040283 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:55.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.688+0000 7f491e000640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4920159b80 0x7f49201e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.688+0000 7f491f400640 1 -- 172.21.15.19:0/3341040283 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4920159b80 msgr2=0x7f49201e70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.688+0000 7f491f400640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4920159b80 0x7f49201e70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.688+0000 7f491f400640 1 -- 172.21.15.19:0/3341040283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49200742c0 msgr2=0x7f49201f3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.688+0000 7f491f400640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49200742c0 0x7f49201f3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.688+0000 7f491f400640 1 -- 172.21.15.19:0/3341040283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49201e7630 con 0x7f4920158c40 2024-04-25T10:28:55.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.688+0000 7f491f400640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4920158c40 0x7f4920151be0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f491800c410 tx=0x7f491800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:55.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.689+0000 7f4916a00640 1 -- 172.21.15.19:0/3341040283 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4918017070 con 0x7f4920158c40 2024-04-25T10:28:55.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.689+0000 7f4916a00640 1 -- 172.21.15.19:0/3341040283 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49180035f0 con 0x7f4920158c40 2024-04-25T10:28:55.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.689+0000 7f4916a00640 1 -- 172.21.15.19:0/3341040283 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49180039c0 con 0x7f4920158c40 2024-04-25T10:28:55.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.689+0000 7f4925a00640 1 -- 172.21.15.19:0/3341040283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4920157ee0 con 0x7f4920158c40 2024-04-25T10:28:55.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.689+0000 7f4925a00640 1 -- 172.21.15.19:0/3341040283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49201e68f0 con 0x7f4920158c40 2024-04-25T10:28:55.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.690+0000 7f4925a00640 1 -- 172.21.15.19:0/3341040283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4920158670 con 0x7f4920158c40 2024-04-25T10:28:55.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.691+0000 7f4916a00640 1 -- 172.21.15.19:0/3341040283 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f491801a070 con 0x7f4920158c40 2024-04-25T10:28:55.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.692+0000 7f4916a00640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f48fc0744e0 0x7f48fc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.692+0000 7f4916a00640 1 -- 172.21.15.19:0/3341040283 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f49180948f0 con 0x7f4920158c40 2024-04-25T10:28:55.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.693+0000 7f4916a00640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] conn(0x7f48fc07ddf0 0x7f48fc0802c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:55.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.693+0000 7f4916a00640 1 -- 172.21.15.19:0/3341040283 --> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48fc080990 con 0x7f48fc07ddf0 2024-04-25T10:28:55.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.693+0000 7f4916a00640 1 -- 172.21.15.19:0/3341040283 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f49180992a0 con 0x7f4920158c40 2024-04-25T10:28:55.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.693+0000 7f491ea00640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f48fc0744e0 0x7f48fc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.693+0000 7f491e000640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] conn(0x7f48fc07ddf0 0x7f48fc0802c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:55.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.694+0000 7f491ea00640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f48fc0744e0 0x7f48fc0769f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4910033000 tx=0x7f4910009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:55.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.694+0000 7f491e000640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] conn(0x7f48fc07ddf0 0x7f48fc0802c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:55.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.695+0000 7f4916a00640 1 -- 172.21.15.19:0/3341040283 <== osd.2 v2:172.21.15.19:6816/1878337170 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48fc080990 con 0x7f48fc07ddf0 2024-04-25T10:28:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.709+0000 7f4925a00640 1 -- 172.21.15.19:0/3341040283 --> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4920157c90 con 0x7f48fc07ddf0 2024-04-25T10:28:55.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.710+0000 7f4916a00640 1 -- 172.21.15.19:0/3341040283 <== osd.2 v2:172.21.15.19:6816/1878337170 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4920157c90 con 0x7f48fc07ddf0 2024-04-25T10:28:55.712 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:28:55.712 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:28:55.712 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:28:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.711+0000 7f4925a00640 1 -- 172.21.15.19:0/3341040283 >> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] conn(0x7f48fc07ddf0 msgr2=0x7f48fc0802c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.711+0000 7f4925a00640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.19:6816/1878337170,v1:172.21.15.19:6817/1878337170] conn(0x7f48fc07ddf0 0x7f48fc0802c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.711+0000 7f4925a00640 1 -- 172.21.15.19:0/3341040283 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f48fc0744e0 msgr2=0x7f48fc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.711+0000 7f4925a00640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f48fc0744e0 0x7f48fc0769f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4910033000 tx=0x7f4910009000 comp rx=0 tx=0).stop 2024-04-25T10:28:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.711+0000 7f4925a00640 1 -- 172.21.15.19:0/3341040283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4920158c40 msgr2=0x7f4920151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.711+0000 7f4925a00640 1 --2- 172.21.15.19:0/3341040283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4920158c40 0x7f4920151be0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f491800c410 tx=0x7f491800c8d0 comp rx=0 tx=0).stop 2024-04-25T10:28:55.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.711+0000 7f491f400640 1 -- 172.21.15.19:0/3341040283 reap_dead start 2024-04-25T10:28:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.711+0000 7f4925a00640 1 -- 172.21.15.19:0/3341040283 shutdown_connections 2024-04-25T10:28:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.711+0000 7f4925a00640 1 -- 172.21.15.19:0/3341040283 >> 172.21.15.19:0/3341040283 conn(0x7f492006f1f0 msgr2=0x7f49200af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.711+0000 7f4925a00640 1 -- 172.21.15.19:0/3341040283 shutdown_connections 2024-04-25T10:28:55.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:55.711+0000 7f4925a00640 1 -- 172.21.15.19:0/3341040283 wait complete. 2024-04-25T10:28:55.740 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T10:28:56.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.013+0000 7f6726000640 1 Processor -- start 2024-04-25T10:28:56.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.014+0000 7f6726000640 1 -- start start 2024-04-25T10:28:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.016+0000 7f6726000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 0x7f6720154340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.016+0000 7f6726000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f67200c8100 0x7f672015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.016+0000 7f6726000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6720073770 con 0x7f67200c8510 2024-04-25T10:28:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.016+0000 7f6726000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f67200c9200 con 0x7f67200c8100 2024-04-25T10:28:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.016+0000 7f6726000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6720071450 con 0x7f6720074780 2024-04-25T10:28:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.017+0000 7f671fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f67200c8100 0x7f672015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.017+0000 7f6725600640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f67200c8510 0x7f6720073b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:49010/0 (socket says 172.21.15.19:49010) 2024-04-25T10:28:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.017+0000 7f671fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f67200c8100 0x7f672015a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:55872/0 (socket says 172.21.15.19:55872) 2024-04-25T10:28:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.017+0000 7f6724c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 0x7f6720154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.017+0000 7f6725600640 1 -- 172.21.15.19:0/2318234482 learned_addr learned my addr 172.21.15.19:0/2318234482 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.017+0000 7f671fe00640 1 -- 172.21.15.19:0/2318234482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 msgr2=0x7f6720154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.017+0000 7f671fe00640 1 --2- 172.21.15.19:0/2318234482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 0x7f6720154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.017+0000 7f671fe00640 1 -- 172.21.15.19:0/2318234482 >> v1:172.21.15.112:6789/0 conn(0x7f67200c8510 legacy=0x7f6720073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.017+0000 7f671fe00640 1 -- 172.21.15.19:0/2318234482 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67200731b0 con 0x7f67200c8100 2024-04-25T10:28:56.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.018+0000 7f671fe00640 1 --2- 172.21.15.19:0/2318234482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67200c8100 0x7f672015a1f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f670c0097a0 tx=0x7f670c02a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbb3505a43f6fb82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:56.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.019+0000 7f671f400640 1 -- 172.21.15.19:0/2318234482 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c037070 con 0x7f67200c8100 2024-04-25T10:28:56.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.019+0000 7f671f400640 1 -- 172.21.15.19:0/2318234482 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f670c02ad10 con 0x7f67200c8100 2024-04-25T10:28:56.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.019+0000 7f671f400640 1 -- 172.21.15.19:0/2318234482 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c032660 con 0x7f67200c8100 2024-04-25T10:28:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.019+0000 7f6726000640 1 -- 172.21.15.19:0/2318234482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67200c8100 msgr2=0x7f672015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.019+0000 7f6726000640 1 --2- 172.21.15.19:0/2318234482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67200c8100 0x7f672015a1f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f670c0097a0 tx=0x7f670c02a080 comp rx=0 tx=0).stop 2024-04-25T10:28:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.020+0000 7f6726000640 1 -- 172.21.15.19:0/2318234482 shutdown_connections 2024-04-25T10:28:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.020+0000 7f6726000640 1 --2- 172.21.15.19:0/2318234482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67200c8100 0x7f672015a1f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.020+0000 7f6726000640 1 --2- 172.21.15.19:0/2318234482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 0x7f6720154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.020+0000 7f6726000640 1 -- 172.21.15.19:0/2318234482 >> 172.21.15.19:0/2318234482 conn(0x7f672006d120 msgr2=0x7f67200cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.020+0000 7f6726000640 1 -- 172.21.15.19:0/2318234482 shutdown_connections 2024-04-25T10:28:56.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.020+0000 7f6726000640 1 -- 172.21.15.19:0/2318234482 wait complete. 2024-04-25T10:28:56.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.022+0000 7f6726000640 1 Processor -- start 2024-04-25T10:28:56.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.022+0000 7f6726000640 1 -- start start 2024-04-25T10:28:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f6726000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 0x7f6720158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f6726000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67200c8100 0x7f67200c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f6726000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67201e60b0 0x7f672014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f6726000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f67200c8e90 con 0x7f67201e60b0 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f6726000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f67200c8bb0 con 0x7f67200c8100 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f6726000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6720154880 con 0x7f6720074780 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f6725600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67201e60b0 0x7f672014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f6724c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 0x7f6720158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f671fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67200c8100 0x7f67200c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f6724c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 0x7f6720158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:48398/0 (socket says 172.21.15.19:48398) 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f6724c00640 1 -- 172.21.15.19:0/920046408 learned_addr learned my addr 172.21.15.19:0/920046408 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f671fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67200c8100 0x7f67200c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:55888/0 (socket says 172.21.15.19:55888) 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.024+0000 7f6725600640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67201e60b0 0x7f672014eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59838/0 (socket says 172.21.15.19:59838) 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.025+0000 7f6724c00640 1 -- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67200c8100 msgr2=0x7f67200c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.025+0000 7f6724c00640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67200c8100 0x7f67200c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.025+0000 7f6724c00640 1 -- 172.21.15.19:0/920046408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67201e60b0 msgr2=0x7f672014eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.025+0000 7f6724c00640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67201e60b0 0x7f672014eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.025+0000 7f6724c00640 1 -- 172.21.15.19:0/920046408 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6720158bd0 con 0x7f6720074780 2024-04-25T10:28:56.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.025+0000 7f671fe00640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67200c8100 0x7f67200c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:56.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.025+0000 7f6724c00640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 0x7f6720158690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f671400e8a0 tx=0x7f671400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:56.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.025+0000 7f671cc00640 1 -- 172.21.15.19:0/920046408 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714017070 con 0x7f6720074780 2024-04-25T10:28:56.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.025+0000 7f671cc00640 1 -- 172.21.15.19:0/920046408 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f671400c940 con 0x7f6720074780 2024-04-25T10:28:56.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.025+0000 7f6726000640 1 -- 172.21.15.19:0/920046408 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6720157ed0 con 0x7f6720074780 2024-04-25T10:28:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.025+0000 7f671cc00640 1 -- 172.21.15.19:0/920046408 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671400cd30 con 0x7f6720074780 2024-04-25T10:28:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.026+0000 7f6726000640 1 -- 172.21.15.19:0/920046408 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6720158170 con 0x7f6720074780 2024-04-25T10:28:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.027+0000 7f6726000640 1 -- 172.21.15.19:0/920046408 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6720076520 con 0x7f6720074780 2024-04-25T10:28:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.028+0000 7f671cc00640 1 -- 172.21.15.19:0/920046408 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f671401a070 con 0x7f6720074780 2024-04-25T10:28:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.029+0000 7f671cc00640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67000744b0 0x7f67000769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.029+0000 7f671cc00640 1 -- 172.21.15.19:0/920046408 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f6714095520 con 0x7f6720074780 2024-04-25T10:28:56.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.029+0000 7f671fe00640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67000744b0 0x7f67000769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.030+0000 7f671fe00640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67000744b0 0x7f67000769c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f670c034000 tx=0x7f670c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:56.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.035+0000 7f671cc00640 1 -- 172.21.15.19:0/920046408 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f671405f1f0 con 0x7f6720074780 2024-04-25T10:28:56.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.244+0000 7f6726000640 1 -- 172.21.15.19:0/920046408 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f6720073940 con 0x7f67000744b0 2024-04-25T10:28:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.245+0000 7f671cc00640 1 -- 172.21.15.19:0/920046408 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6720073940 con 0x7f67000744b0 2024-04-25T10:28:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T10:28:56.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.248+0000 7f6726000640 1 -- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67000744b0 msgr2=0x7f67000769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.249+0000 7f6726000640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67000744b0 0x7f67000769c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f670c034000 tx=0x7f670c02e000 comp rx=0 tx=0).stop 2024-04-25T10:28:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.249+0000 7f6726000640 1 -- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 msgr2=0x7f6720158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.249+0000 7f6726000640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 0x7f6720158690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f671400e8a0 tx=0x7f671400ed60 comp rx=0 tx=0).stop 2024-04-25T10:28:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.249+0000 7f6726000640 1 -- 172.21.15.19:0/920046408 shutdown_connections 2024-04-25T10:28:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.249+0000 7f6726000640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67201e60b0 0x7f672014eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.249+0000 7f6726000640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67200c8100 0x7f67200c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.249+0000 7f6726000640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f67000744b0 0x7f67000769c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.249+0000 7f6726000640 1 --2- 172.21.15.19:0/920046408 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6720074780 0x7f6720158690 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.249+0000 7f6726000640 1 -- 172.21.15.19:0/920046408 >> 172.21.15.19:0/920046408 conn(0x7f672006d120 msgr2=0x7f67200cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.249+0000 7f6726000640 1 -- 172.21.15.19:0/920046408 shutdown_connections 2024-04-25T10:28:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.249+0000 7f6726000640 1 -- 172.21.15.19:0/920046408 wait complete. 2024-04-25T10:28:56.277 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T10:28:56.277 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:28:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.566+0000 7f0b47a00640 1 Processor -- start 2024-04-25T10:28:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.566+0000 7f0b47a00640 1 -- start start 2024-04-25T10:28:56.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.568+0000 7f0b47a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0b40159f90 0x7f0b400c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.568+0000 7f0b47a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b400b07c0 con 0x7f0b400c4930 2024-04-25T10:28:56.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.569+0000 7f0b47a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b400b2600 con 0x7f0b40159b80 2024-04-25T10:28:56.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.569+0000 7f0b47a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0b401596f0 con 0x7f0b40159f90 2024-04-25T10:28:56.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.569+0000 7f0b45000640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0b400c4930 0x7f0b401534f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35354/0 (socket says 172.21.15.19:35354) 2024-04-25T10:28:56.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.569+0000 7f0b45000640 1 -- 172.21.15.19:0/3953093133 learned_addr learned my addr 172.21.15.19:0/3953093133 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:56.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.569+0000 7f0b45a00640 1 --2- 172.21.15.19:0/3953093133 >> v2:172.21.15.112:3300/0 conn(0x7f0b40159f90 0x7f0b400c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.569+0000 7f0b3f400640 1 -- 172.21.15.19:0/3953093133 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 891490602 0 0) 0x7f0b400b07c0 con 0x7f0b400c4930 2024-04-25T10:28:56.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.569+0000 7f0b3f400640 1 -- 172.21.15.19:0/3953093133 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b24003520 con 0x7f0b400c4930 2024-04-25T10:28:56.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.569+0000 7f0b45a00640 1 -- 172.21.15.19:0/3953093133 >> v1:172.21.15.112:6789/0 conn(0x7f0b40159b80 legacy=0x7f0b400742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.569+0000 7f0b45a00640 1 -- 172.21.15.19:0/3953093133 >> v1:172.21.15.19:6789/0 conn(0x7f0b400c4930 legacy=0x7f0b401534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.569+0000 7f0b45a00640 1 -- 172.21.15.19:0/3953093133 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b400b28e0 con 0x7f0b40159f90 2024-04-25T10:28:56.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.571+0000 7f0b45a00640 1 --2- 172.21.15.19:0/3953093133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b40159f90 0x7f0b400c2a10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009d90 tx=0x7f0b3802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c65453f07b57b0f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:56.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.571+0000 7f0b3f400640 1 -- 172.21.15.19:0/3953093133 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38007740 con 0x7f0b40159f90 2024-04-25T10:28:56.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.571+0000 7f0b3f400640 1 -- 172.21.15.19:0/3953093133 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b380078e0 con 0x7f0b40159f90 2024-04-25T10:28:56.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.571+0000 7f0b3f400640 1 -- 172.21.15.19:0/3953093133 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38007cb0 con 0x7f0b40159f90 2024-04-25T10:28:56.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.572+0000 7f0b47a00640 1 -- 172.21.15.19:0/3953093133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b40159f90 msgr2=0x7f0b400c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.572+0000 7f0b47a00640 1 --2- 172.21.15.19:0/3953093133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b40159f90 0x7f0b400c2a10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009d90 tx=0x7f0b3802a6f0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.572+0000 7f0b47a00640 1 -- 172.21.15.19:0/3953093133 shutdown_connections 2024-04-25T10:28:56.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.572+0000 7f0b47a00640 1 --2- 172.21.15.19:0/3953093133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b40159f90 0x7f0b400c2a10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.572+0000 7f0b47a00640 1 -- 172.21.15.19:0/3953093133 >> 172.21.15.19:0/3953093133 conn(0x7f0b4006f1f0 msgr2=0x7f0b4006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:56.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.572+0000 7f0b47a00640 1 -- 172.21.15.19:0/3953093133 shutdown_connections 2024-04-25T10:28:56.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.572+0000 7f0b47a00640 1 -- 172.21.15.19:0/3953093133 wait complete. 2024-04-25T10:28:56.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.574+0000 7f0b47a00640 1 Processor -- start 2024-04-25T10:28:56.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.574+0000 7f0b47a00640 1 -- start start 2024-04-25T10:28:56.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.576+0000 7f0b47a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b400c4930 0x7f0b401f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.576+0000 7f0b47a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b40159b80 0x7f0b400cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.576+0000 7f0b47a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b40159f90 0x7f0b401e3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.576+0000 7f0b47a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4015c900 con 0x7f0b40159f90 2024-04-25T10:28:56.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.576+0000 7f0b47a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0b400b2ea0 con 0x7f0b400c4930 2024-04-25T10:28:56.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.576+0000 7f0b47a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0b40159330 con 0x7f0b40159b80 2024-04-25T10:28:56.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.576+0000 7f0b45a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b40159f90 0x7f0b401e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.576+0000 7f0b45000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b400c4930 0x7f0b401f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.576+0000 7f0b45a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b40159f90 0x7f0b401e3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59848/0 (socket says 172.21.15.19:59848) 2024-04-25T10:28:56.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.576+0000 7f0b45a00640 1 -- 172.21.15.19:0/725319441 learned_addr learned my addr 172.21.15.19:0/725319441 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:56.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.576+0000 7f0b3fe00640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b40159b80 0x7f0b400cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.577+0000 7f0b45a00640 1 -- 172.21.15.19:0/725319441 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b40159b80 msgr2=0x7f0b400cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.577+0000 7f0b45a00640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b40159b80 0x7f0b400cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.577+0000 7f0b45a00640 1 -- 172.21.15.19:0/725319441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b400c4930 msgr2=0x7f0b401f42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.577+0000 7f0b45a00640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b400c4930 0x7f0b401f42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.577+0000 7f0b45a00640 1 -- 172.21.15.19:0/725319441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b400cc210 con 0x7f0b40159f90 2024-04-25T10:28:56.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.577+0000 7f0b45000640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b400c4930 0x7f0b401f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:56.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.577+0000 7f0b45a00640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b40159f90 0x7f0b401e3560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009eb0 tx=0x7f0b38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:56.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.577+0000 7f0b3cc00640 1 -- 172.21.15.19:0/725319441 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3803f070 con 0x7f0b40159f90 2024-04-25T10:28:56.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.577+0000 7f0b3cc00640 1 -- 172.21.15.19:0/725319441 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b38031bc0 con 0x7f0b40159f90 2024-04-25T10:28:56.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.577+0000 7f0b3cc00640 1 -- 172.21.15.19:0/725319441 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38009450 con 0x7f0b40159f90 2024-04-25T10:28:56.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.577+0000 7f0b47a00640 1 -- 172.21.15.19:0/725319441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b401f0350 con 0x7f0b40159f90 2024-04-25T10:28:56.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.578+0000 7f0b47a00640 1 -- 172.21.15.19:0/725319441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b401f08f0 con 0x7f0b40159f90 2024-04-25T10:28:56.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.579+0000 7f0b47a00640 1 -- 172.21.15.19:0/725319441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b40156f80 con 0x7f0b40159f90 2024-04-25T10:28:56.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.580+0000 7f0b3cc00640 1 -- 172.21.15.19:0/725319441 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0b3803b410 con 0x7f0b40159f90 2024-04-25T10:28:56.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.581+0000 7f0b3cc00640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0b200744e0 0x7f0b200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.581+0000 7f0b3cc00640 1 -- 172.21.15.19:0/725319441 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f0b380b6bf0 con 0x7f0b40159f90 2024-04-25T10:28:56.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.581+0000 7f0b3cc00640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] conn(0x7f0b2007ddf0 0x7f0b200802c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.581+0000 7f0b3cc00640 1 -- 172.21.15.19:0/725319441 --> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b380020b0 con 0x7f0b2007ddf0 2024-04-25T10:28:56.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.581+0000 7f0b3cc00640 1 -- 172.21.15.19:0/725319441 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0b380bb2a0 con 0x7f0b40159f90 2024-04-25T10:28:56.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.581+0000 7f0b45000640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0b200744e0 0x7f0b200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.582+0000 7f0b3fe00640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] conn(0x7f0b2007ddf0 0x7f0b200802c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.582+0000 7f0b45000640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0b200744e0 0x7f0b200769f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0b300011e0 tx=0x7f0b30007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:56.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.582+0000 7f0b3fe00640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] conn(0x7f0b2007ddf0 0x7f0b200802c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:56.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.583+0000 7f0b3cc00640 1 -- 172.21.15.19:0/725319441 <== osd.3 v2:172.21.15.19:6800/2283064072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b380020b0 con 0x7f0b2007ddf0 2024-04-25T10:28:56.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.599+0000 7f0b47a00640 1 -- 172.21.15.19:0/725319441 --> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0b401f06a0 con 0x7f0b2007ddf0 2024-04-25T10:28:56.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.600+0000 7f0b3cc00640 1 -- 172.21.15.19:0/725319441 <== osd.3 v2:172.21.15.19:6800/2283064072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0b401f06a0 con 0x7f0b2007ddf0 2024-04-25T10:28:56.601 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:28:56.601 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:28:56.601 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:28:56.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.600+0000 7f0b47a00640 1 -- 172.21.15.19:0/725319441 >> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] conn(0x7f0b2007ddf0 msgr2=0x7f0b200802c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.600+0000 7f0b47a00640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.19:6800/2283064072,v1:172.21.15.19:6801/2283064072] conn(0x7f0b2007ddf0 0x7f0b200802c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.600+0000 7f0b47a00640 1 -- 172.21.15.19:0/725319441 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0b200744e0 msgr2=0x7f0b200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.600+0000 7f0b47a00640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0b200744e0 0x7f0b200769f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0b300011e0 tx=0x7f0b30007d30 comp rx=0 tx=0).stop 2024-04-25T10:28:56.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.600+0000 7f0b47a00640 1 -- 172.21.15.19:0/725319441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b40159f90 msgr2=0x7f0b401e3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.600+0000 7f0b47a00640 1 --2- 172.21.15.19:0/725319441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b40159f90 0x7f0b401e3560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009eb0 tx=0x7f0b38004a40 comp rx=0 tx=0).stop 2024-04-25T10:28:56.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.600+0000 7f0b45a00640 1 -- 172.21.15.19:0/725319441 reap_dead start 2024-04-25T10:28:56.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.601+0000 7f0b47a00640 1 -- 172.21.15.19:0/725319441 shutdown_connections 2024-04-25T10:28:56.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.601+0000 7f0b47a00640 1 -- 172.21.15.19:0/725319441 >> 172.21.15.19:0/725319441 conn(0x7f0b4006f1f0 msgr2=0x7f0b40151030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:56.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.601+0000 7f0b47a00640 1 -- 172.21.15.19:0/725319441 shutdown_connections 2024-04-25T10:28:56.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.601+0000 7f0b47a00640 1 -- 172.21.15.19:0/725319441 wait complete. 2024-04-25T10:28:56.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T10:28:56.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.909+0000 7f4f1cc00640 1 Processor -- start 2024-04-25T10:28:56.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.909+0000 7f4f1cc00640 1 -- start start 2024-04-25T10:28:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.911+0000 7f4f1cc00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f180c8c90 0x7f4f180c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.911+0000 7f4f1cc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f180c8100 0x7f4f180c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.911+0000 7f4f1cc00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f180c9a80 con 0x7f4f180c9390 2024-04-25T10:28:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.911+0000 7f4f1cc00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f4f180c2c50 con 0x7f4f180c8c90 2024-04-25T10:28:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.911+0000 7f4f1cc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4f180c9d60 con 0x7f4f180c8100 2024-04-25T10:28:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.912+0000 7f4f17400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4f180c9390 0x7f4f18153150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35366/0 (socket says 172.21.15.19:35366) 2024-04-25T10:28:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.912+0000 7f4f17400640 1 -- 172.21.15.19:0/699668700 learned_addr learned my addr 172.21.15.19:0/699668700 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.912+0000 7f4f0fe00640 1 --2- 172.21.15.19:0/699668700 >> v2:172.21.15.19:3300/0 conn(0x7f4f180c8c90 0x7f4f180c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.912+0000 7f4f17e00640 1 --2- 172.21.15.19:0/699668700 >> v2:172.21.15.112:3300/0 conn(0x7f4f180c8100 0x7f4f180c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.912+0000 7f4f16a00640 1 -- 172.21.15.19:0/699668700 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545465250 0 0) 0x7f4f180c9a80 con 0x7f4f180c9390 2024-04-25T10:28:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.912+0000 7f4f16a00640 1 -- 172.21.15.19:0/699668700 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ef8003520 con 0x7f4f180c9390 2024-04-25T10:28:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.912+0000 7f4f0fe00640 1 -- 172.21.15.19:0/699668700 >> v2:172.21.15.112:3300/0 conn(0x7f4f180c8100 msgr2=0x7f4f180c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.912+0000 7f4f0fe00640 1 --2- 172.21.15.19:0/699668700 >> v2:172.21.15.112:3300/0 conn(0x7f4f180c8100 0x7f4f180c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.912+0000 7f4f0fe00640 1 -- 172.21.15.19:0/699668700 >> v1:172.21.15.19:6789/0 conn(0x7f4f180c9390 legacy=0x7f4f18153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.912+0000 7f4f0fe00640 1 -- 172.21.15.19:0/699668700 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f180c28e0 con 0x7f4f180c8c90 2024-04-25T10:28:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.912+0000 7f4f17e00640 1 --2- 172.21.15.19:0/699668700 >> v2:172.21.15.112:3300/0 conn(0x7f4f180c8100 0x7f4f180c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.914+0000 7f4f0fe00640 1 --2- 172.21.15.19:0/699668700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f180c8c90 0x7f4f180c44f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f1815a130 tx=0x7f4f0002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6361b176b80e9df0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.914+0000 7f4f16a00640 1 -- 172.21.15.19:0/699668700 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f00037070 con 0x7f4f180c8c90 2024-04-25T10:28:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.914+0000 7f4f16a00640 1 -- 172.21.15.19:0/699668700 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f00032440 con 0x7f4f180c8c90 2024-04-25T10:28:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.914+0000 7f4f16a00640 1 -- 172.21.15.19:0/699668700 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f000327f0 con 0x7f4f180c8c90 2024-04-25T10:28:56.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.915+0000 7f4f1cc00640 1 -- 172.21.15.19:0/699668700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f180c8c90 msgr2=0x7f4f180c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.915+0000 7f4f1cc00640 1 --2- 172.21.15.19:0/699668700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f180c8c90 0x7f4f180c44f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f1815a130 tx=0x7f4f0002a250 comp rx=0 tx=0).stop 2024-04-25T10:28:56.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.915+0000 7f4f1cc00640 1 -- 172.21.15.19:0/699668700 shutdown_connections 2024-04-25T10:28:56.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.915+0000 7f4f1cc00640 1 --2- 172.21.15.19:0/699668700 >> v2:172.21.15.112:3300/0 conn(0x7f4f180c8100 0x7f4f180c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.915+0000 7f4f1cc00640 1 --2- 172.21.15.19:0/699668700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f180c8c90 0x7f4f180c44f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.915+0000 7f4f1cc00640 1 -- 172.21.15.19:0/699668700 >> 172.21.15.19:0/699668700 conn(0x7f4f1806d120 msgr2=0x7f4f180cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:56.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.915+0000 7f4f1cc00640 1 -- 172.21.15.19:0/699668700 shutdown_connections 2024-04-25T10:28:56.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.915+0000 7f4f1cc00640 1 -- 172.21.15.19:0/699668700 wait complete. 2024-04-25T10:28:56.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.917+0000 7f4f1cc00640 1 Processor -- start 2024-04-25T10:28:56.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.918+0000 7f4f1cc00640 1 -- start start 2024-04-25T10:28:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.919+0000 7f4f1cc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f180c8100 0x7f4f18151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.919+0000 7f4f1cc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f180c8c90 0x7f4f180ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.919+0000 7f4f1cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180c9390 0x7f4f18151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.919+0000 7f4f1cc00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f18159350 con 0x7f4f180c8c90 2024-04-25T10:28:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.919+0000 7f4f1cc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f181591d0 con 0x7f4f180c9390 2024-04-25T10:28:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.919+0000 7f4f1cc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4f181594d0 con 0x7f4f180c8100 2024-04-25T10:28:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.919+0000 7f4f0fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f180c8c90 0x7f4f180ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f17400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f180c8100 0x7f4f18151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f17e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180c9390 0x7f4f18151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f17e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180c9390 0x7f4f18151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:55924/0 (socket says 172.21.15.19:55924) 2024-04-25T10:28:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f17e00640 1 -- 172.21.15.19:0/4256461631 learned_addr learned my addr 172.21.15.19:0/4256461631 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f0fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f180c8c90 0x7f4f180ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59862/0 (socket says 172.21.15.19:59862) 2024-04-25T10:28:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f17400640 1 -- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180c9390 msgr2=0x7f4f18151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f17400640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180c9390 0x7f4f18151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f17400640 1 -- 172.21.15.19:0/4256461631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f180c8c90 msgr2=0x7f4f180ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f17400640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f180c8c90 0x7f4f180ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f17400640 1 -- 172.21.15.19:0/4256461631 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f18152340 con 0x7f4f180c8100 2024-04-25T10:28:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f0fe00640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f180c8c90 0x7f4f180ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.920+0000 7f4f17400640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f180c8100 0x7f4f18151e00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800c390 tx=0x7f4f08001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.921+0000 7f4f0f400640 1 -- 172.21.15.19:0/4256461631 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08017070 con 0x7f4f180c8100 2024-04-25T10:28:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.921+0000 7f4f0f400640 1 -- 172.21.15.19:0/4256461631 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f08005ce0 con 0x7f4f180c8100 2024-04-25T10:28:56.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.921+0000 7f4f1cc00640 1 -- 172.21.15.19:0/4256461631 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1814d600 con 0x7f4f180c8100 2024-04-25T10:28:56.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.921+0000 7f4f0f400640 1 -- 172.21.15.19:0/4256461631 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f080072f0 con 0x7f4f180c8100 2024-04-25T10:28:56.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.921+0000 7f4f1cc00640 1 -- 172.21.15.19:0/4256461631 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f1814ebd0 con 0x7f4f180c8100 2024-04-25T10:28:56.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.922+0000 7f4f1cc00640 1 -- 172.21.15.19:0/4256461631 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f18153480 con 0x7f4f180c8100 2024-04-25T10:28:56.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.923+0000 7f4f0f400640 1 -- 172.21.15.19:0/4256461631 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4f0801a070 con 0x7f4f180c8100 2024-04-25T10:28:56.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.924+0000 7f4f0f400640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ef40744e0 0x7f4ef40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:56.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.924+0000 7f4f0f400640 1 -- 172.21.15.19:0/4256461631 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f4f08094840 con 0x7f4f180c8100 2024-04-25T10:28:56.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.924+0000 7f4f0fe00640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ef40744e0 0x7f4ef40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:56.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.925+0000 7f4f0fe00640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ef40744e0 0x7f4ef40769f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f00034000 tx=0x7f4f0002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:56.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:56.929+0000 7f4f0f400640 1 -- 172.21.15.19:0/4256461631 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4f18153480 con 0x7f4f180c8100 2024-04-25T10:28:57.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.135+0000 7f4f1cc00640 1 -- 172.21.15.19:0/4256461631 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f4f18076520 con 0x7f4ef40744e0 2024-04-25T10:28:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.136+0000 7f4f0f400640 1 -- 172.21.15.19:0/4256461631 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4f18076520 con 0x7f4ef40744e0 2024-04-25T10:28:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T10:28:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 -- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ef40744e0 msgr2=0x7f4ef40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ef40744e0 0x7f4ef40769f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f00034000 tx=0x7f4f0002e000 comp rx=0 tx=0).stop 2024-04-25T10:28:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 -- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f180c8100 msgr2=0x7f4f18151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f180c8100 0x7f4f18151e00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800c390 tx=0x7f4f08001e70 comp rx=0 tx=0).stop 2024-04-25T10:28:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 -- 172.21.15.19:0/4256461631 shutdown_connections 2024-04-25T10:28:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180c9390 0x7f4f18151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f180c8c90 0x7f4f180ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ef40744e0 0x7f4ef40769f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 --2- 172.21.15.19:0/4256461631 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f180c8100 0x7f4f18151e00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 -- 172.21.15.19:0/4256461631 >> 172.21.15.19:0/4256461631 conn(0x7f4f1806d120 msgr2=0x7f4f1806ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:57.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 -- 172.21.15.19:0/4256461631 shutdown_connections 2024-04-25T10:28:57.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.139+0000 7f4f1cc00640 1 -- 172.21.15.19:0/4256461631 wait complete. 2024-04-25T10:28:57.169 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T10:28:57.169 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:28:57.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.456+0000 7f0d3b200640 1 Processor -- start 2024-04-25T10:28:57.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.456+0000 7f0d3b200640 1 -- start start 2024-04-25T10:28:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.458+0000 7f0d3b200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0d3c0c8e40 0x7f0d3c0c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.458+0000 7f0d3b200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d3c0ca090 0x7f0d3c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.458+0000 7f0d3b200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3c0c9b30 con 0x7f0d3c15ad80 2024-04-25T10:28:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.458+0000 7f0d3b200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0d3c161830 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.458+0000 7f0d3b200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c074080 con 0x7f0d3c0ca090 2024-04-25T10:28:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.459+0000 7f0d3a800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d3c0ca090 0x7f0d3c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.459+0000 7f0d39400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0d3c0c8e40 0x7f0d3c0c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.459+0000 7f0d39e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0d3c15ad80 0x7f0d3c0c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:49030/0 (socket says 172.21.15.19:49030) 2024-04-25T10:28:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.459+0000 7f0d39e00640 1 -- 172.21.15.19:0/1826921171 learned_addr learned my addr 172.21.15.19:0/1826921171 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.459+0000 7f0d39400640 1 -- 172.21.15.19:0/1826921171 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d3c0ca090 msgr2=0x7f0d3c0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.459+0000 7f0d39400640 1 --2- 172.21.15.19:0/1826921171 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d3c0ca090 0x7f0d3c0ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.459+0000 7f0d38a00640 1 -- 172.21.15.19:0/1826921171 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697172561 0 0) 0x7f0d3c0c9b30 con 0x7f0d3c15ad80 2024-04-25T10:28:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.459+0000 7f0d39400640 1 -- 172.21.15.19:0/1826921171 >> v1:172.21.15.112:6789/0 conn(0x7f0d3c15ad80 legacy=0x7f0d3c0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.459+0000 7f0d39400640 1 -- 172.21.15.19:0/1826921171 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c1612b0 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.459+0000 7f0d3a800640 1 --2- 172.21.15.19:0/1826921171 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d3c0ca090 0x7f0d3c0ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:57.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.460+0000 7f0d39400640 1 --2- 172.21.15.19:0/1826921171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3c0c8e40 0x7f0d3c0c2640 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c1619b0 tx=0x7f0d2c02a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fa3ab93661d7bd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:57.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.461+0000 7f0d38a00640 1 -- 172.21.15.19:0/1826921171 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c007740 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.461+0000 7f0d38a00640 1 -- 172.21.15.19:0/1826921171 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0078e0 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.461+0000 7f0d38a00640 1 -- 172.21.15.19:0/1826921171 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c007cb0 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.461+0000 7f0d3b200640 1 -- 172.21.15.19:0/1826921171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3c0c8e40 msgr2=0x7f0d3c0c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.461+0000 7f0d3b200640 1 --2- 172.21.15.19:0/1826921171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3c0c8e40 0x7f0d3c0c2640 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c1619b0 tx=0x7f0d2c02a6d0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.462+0000 7f0d3b200640 1 -- 172.21.15.19:0/1826921171 shutdown_connections 2024-04-25T10:28:57.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.462+0000 7f0d3b200640 1 --2- 172.21.15.19:0/1826921171 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d3c0ca090 0x7f0d3c0ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.462+0000 7f0d3b200640 1 --2- 172.21.15.19:0/1826921171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3c0c8e40 0x7f0d3c0c2640 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.462+0000 7f0d3b200640 1 -- 172.21.15.19:0/1826921171 >> 172.21.15.19:0/1826921171 conn(0x7f0d3c070d10 msgr2=0x7f0d3c071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:57.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.462+0000 7f0d3b200640 1 -- 172.21.15.19:0/1826921171 shutdown_connections 2024-04-25T10:28:57.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.462+0000 7f0d3b200640 1 -- 172.21.15.19:0/1826921171 wait complete. 2024-04-25T10:28:57.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.464+0000 7f0d3b200640 1 Processor -- start 2024-04-25T10:28:57.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.464+0000 7f0d3b200640 1 -- start start 2024-04-25T10:28:57.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d3b200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d3c0c8e40 0x7f0d3c1f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d3b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3c0ca090 0x7f0d3c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d3b200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d3c15ad80 0x7f0d3c1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d3b200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c0c4440 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d3b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c0c4160 con 0x7f0d3c0ca090 2024-04-25T10:28:57.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d3b200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c073d10 con 0x7f0d3c15ad80 2024-04-25T10:28:57.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d39e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d3c0c8e40 0x7f0d3c1f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d39400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3c0ca090 0x7f0d3c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d3a800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d3c15ad80 0x7f0d3c1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d39e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d3c0c8e40 0x7f0d3c1f7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59878/0 (socket says 172.21.15.19:59878) 2024-04-25T10:28:57.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d39e00640 1 -- 172.21.15.19:0/1656926295 learned_addr learned my addr 172.21.15.19:0/1656926295 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:57.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d39e00640 1 -- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d3c15ad80 msgr2=0x7f0d3c1506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d39e00640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d3c15ad80 0x7f0d3c1506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d39e00640 1 -- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3c0ca090 msgr2=0x7f0d3c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d39e00640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d3c0ca090 0x7f0d3c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d39e00640 1 -- 172.21.15.19:0/1656926295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c1f77a0 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.466+0000 7f0d3a800640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d3c15ad80 0x7f0d3c1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:57.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.467+0000 7f0d39e00640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d3c0c8e40 0x7f0d3c1f7260 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c460 tx=0x7f0d2400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:57.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.467+0000 7f0d32000640 1 -- 172.21.15.19:0/1656926295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d240074e0 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.467+0000 7f0d32000640 1 -- 172.21.15.19:0/1656926295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d240047e0 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.467+0000 7f0d3b200640 1 -- 172.21.15.19:0/1656926295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3c160770 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.467+0000 7f0d32000640 1 -- 172.21.15.19:0/1656926295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24004bd0 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.467+0000 7f0d3b200640 1 -- 172.21.15.19:0/1656926295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d3c15b390 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.468+0000 7f0d3b200640 1 -- 172.21.15.19:0/1656926295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d3c050740 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.470+0000 7f0d32000640 1 -- 172.21.15.19:0/1656926295 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0d24011070 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.471+0000 7f0d32000640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0d180744b0 0x7f0d180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.471+0000 7f0d32000640 1 -- 172.21.15.19:0/1656926295 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f0d24095910 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.471+0000 7f0d32000640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] conn(0x7f0d1807ddc0 0x7f0d18080290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.471+0000 7f0d32000640 1 -- 172.21.15.19:0/1656926295 --> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d18080960 con 0x7f0d1807ddc0 2024-04-25T10:28:57.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.471+0000 7f0d39400640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0d180744b0 0x7f0d180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.471+0000 7f0d32000640 1 -- 172.21.15.19:0/1656926295 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d24095da0 con 0x7f0d3c0c8e40 2024-04-25T10:28:57.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.471+0000 7f0d3a800640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] conn(0x7f0d1807ddc0 0x7f0d18080290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.472+0000 7f0d39400640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0d180744b0 0x7f0d180769c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c034000 tx=0x7f0d2c02f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:57.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.472+0000 7f0d3a800640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] conn(0x7f0d1807ddc0 0x7f0d18080290 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:57.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.473+0000 7f0d32000640 1 -- 172.21.15.19:0/1656926295 <== osd.4 v2:172.21.15.112:6800/2833374228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d18080960 con 0x7f0d1807ddc0 2024-04-25T10:28:57.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.487+0000 7f0d3b200640 1 -- 172.21.15.19:0/1656926295 --> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0d3c1f6ba0 con 0x7f0d1807ddc0 2024-04-25T10:28:57.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.488+0000 7f0d32000640 1 -- 172.21.15.19:0/1656926295 <== osd.4 v2:172.21.15.112:6800/2833374228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0d3c1f6ba0 con 0x7f0d1807ddc0 2024-04-25T10:28:57.490 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:28:57.490 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:28:57.490 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:28:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.489+0000 7f0d3b200640 1 -- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] conn(0x7f0d1807ddc0 msgr2=0x7f0d18080290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.489+0000 7f0d3b200640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:6800/2833374228,v1:172.21.15.112:6801/2833374228] conn(0x7f0d1807ddc0 0x7f0d18080290 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.489+0000 7f0d3b200640 1 -- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0d180744b0 msgr2=0x7f0d180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.489+0000 7f0d3b200640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f0d180744b0 0x7f0d180769c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c034000 tx=0x7f0d2c02f000 comp rx=0 tx=0).stop 2024-04-25T10:28:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.489+0000 7f0d3b200640 1 -- 172.21.15.19:0/1656926295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d3c0c8e40 msgr2=0x7f0d3c1f7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.489+0000 7f0d3b200640 1 --2- 172.21.15.19:0/1656926295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d3c0c8e40 0x7f0d3c1f7260 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c460 tx=0x7f0d2400c920 comp rx=0 tx=0).stop 2024-04-25T10:28:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.489+0000 7f0d3a800640 1 -- 172.21.15.19:0/1656926295 reap_dead start 2024-04-25T10:28:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.489+0000 7f0d3b200640 1 -- 172.21.15.19:0/1656926295 shutdown_connections 2024-04-25T10:28:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.489+0000 7f0d3b200640 1 -- 172.21.15.19:0/1656926295 >> 172.21.15.19:0/1656926295 conn(0x7f0d3c070d10 msgr2=0x7f0d3c0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.489+0000 7f0d3b200640 1 -- 172.21.15.19:0/1656926295 shutdown_connections 2024-04-25T10:28:57.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.489+0000 7f0d3b200640 1 -- 172.21.15.19:0/1656926295 wait complete. 2024-04-25T10:28:57.518 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T10:28:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.791+0000 7fbccd200640 1 Processor -- start 2024-04-25T10:28:57.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.791+0000 7fbccd200640 1 -- start start 2024-04-25T10:28:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.793+0000 7fbccd200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcc80c5fd0 0x7fbcc80cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.793+0000 7fbccd200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbcc80c5780 0x7fbcc80ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.793+0000 7fbccd200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc80cfab0 con 0x7fbcc80ca0d0 2024-04-25T10:28:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.793+0000 7fbccd200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fbcc806ea00 con 0x7fbcc80c5fd0 2024-04-25T10:28:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.793+0000 7fbccd200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbcc80cfd20 con 0x7fbcc80c5780 2024-04-25T10:28:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.793+0000 7fbcc7400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcc80c5fd0 0x7fbcc80cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.793+0000 7fbcc7400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcc80c5fd0 0x7fbcc80cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59886/0 (socket says 172.21.15.19:59886) 2024-04-25T10:28:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.793+0000 7fbcc7400640 1 -- 172.21.15.19:0/408401538 learned_addr learned my addr 172.21.15.19:0/408401538 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.793+0000 7fbcc7e00640 1 --2- 172.21.15.19:0/408401538 >> v2:172.21.15.112:3300/0 conn(0x7fbcc80c5780 0x7fbcc80ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.794+0000 7fbcc7400640 1 -- 172.21.15.19:0/408401538 >> v2:172.21.15.112:3300/0 conn(0x7fbcc80c5780 msgr2=0x7fbcc80ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.794+0000 7fbcc7400640 1 --2- 172.21.15.19:0/408401538 >> v2:172.21.15.112:3300/0 conn(0x7fbcc80c5780 0x7fbcc80ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.794+0000 7fbcc7400640 1 -- 172.21.15.19:0/408401538 >> v1:172.21.15.112:6789/0 conn(0x7fbcc80ca0d0 legacy=0x7fbcc80c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.794+0000 7fbcc7400640 1 -- 172.21.15.19:0/408401538 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc806e0d0 con 0x7fbcc80c5fd0 2024-04-25T10:28:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.794+0000 7fbcc7e00640 1 --2- 172.21.15.19:0/408401538 >> v2:172.21.15.112:3300/0 conn(0x7fbcc80c5780 0x7fbcc80ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.795+0000 7fbcc7400640 1 --2- 172.21.15.19:0/408401538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc80c5fd0 0x7fbcc80cf570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80c4ee0 tx=0x7fbcb802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a78b86a4d44dfa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.795+0000 7fbcc6000640 1 -- 172.21.15.19:0/408401538 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8037070 con 0x7fbcc80c5fd0 2024-04-25T10:28:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.795+0000 7fbcc6000640 1 -- 172.21.15.19:0/408401538 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb8032440 con 0x7fbcc80c5fd0 2024-04-25T10:28:57.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.795+0000 7fbcc6000640 1 -- 172.21.15.19:0/408401538 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8032810 con 0x7fbcc80c5fd0 2024-04-25T10:28:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.796+0000 7fbccd200640 1 -- 172.21.15.19:0/408401538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc80c5fd0 msgr2=0x7fbcc80cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.796+0000 7fbccd200640 1 --2- 172.21.15.19:0/408401538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc80c5fd0 0x7fbcc80cf570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80c4ee0 tx=0x7fbcb802a210 comp rx=0 tx=0).stop 2024-04-25T10:28:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.796+0000 7fbccd200640 1 -- 172.21.15.19:0/408401538 shutdown_connections 2024-04-25T10:28:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.796+0000 7fbccd200640 1 --2- 172.21.15.19:0/408401538 >> v2:172.21.15.112:3300/0 conn(0x7fbcc80c5780 0x7fbcc80ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.796+0000 7fbccd200640 1 --2- 172.21.15.19:0/408401538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc80c5fd0 0x7fbcc80cf570 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.796+0000 7fbccd200640 1 -- 172.21.15.19:0/408401538 >> 172.21.15.19:0/408401538 conn(0x7fbcc8071370 msgr2=0x7fbcc8068460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.796+0000 7fbccd200640 1 -- 172.21.15.19:0/408401538 shutdown_connections 2024-04-25T10:28:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.796+0000 7fbccd200640 1 -- 172.21.15.19:0/408401538 wait complete. 2024-04-25T10:28:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.799+0000 7fbccd200640 1 Processor -- start 2024-04-25T10:28:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.799+0000 7fbccd200640 1 -- start start 2024-04-25T10:28:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.800+0000 7fbccd200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc80c5780 0x7fbcc81f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.800+0000 7fbccd200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcc80c5fd0 0x7fbcc80cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbccd200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcc80ca0d0 0x7fbcc815fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbccd200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc81569b0 con 0x7fbcc80c5780 2024-04-25T10:28:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbccd200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc806e690 con 0x7fbcc80c5fd0 2024-04-25T10:28:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbccd200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc8156b30 con 0x7fbcc80ca0d0 2024-04-25T10:28:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbcc7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc80c5780 0x7fbcc81f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbcc7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc80c5780 0x7fbcc81f6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59894/0 (socket says 172.21.15.19:59894) 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbcc7400640 1 -- 172.21.15.19:0/3484021242 learned_addr learned my addr 172.21.15.19:0/3484021242 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbcc6a00640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcc80c5fd0 0x7fbcc80cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbcc7e00640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcc80ca0d0 0x7fbcc815fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbcc7400640 1 -- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcc80ca0d0 msgr2=0x7fbcc815fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbcc7400640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcc80ca0d0 0x7fbcc815fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbcc7400640 1 -- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcc80c5fd0 msgr2=0x7fbcc80cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbcc7400640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcc80c5fd0 0x7fbcc80cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.801+0000 7fbcc7400640 1 -- 172.21.15.19:0/3484021242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc80cf230 con 0x7fbcc80c5780 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.802+0000 7fbcc7400640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc80c5780 0x7fbcc81f6d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbcb802a250 tx=0x7fbcb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.802+0000 7fbcbf400640 1 -- 172.21.15.19:0/3484021242 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8037040 con 0x7fbcc80c5780 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.802+0000 7fbcbf400640 1 -- 172.21.15.19:0/3484021242 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb8004250 con 0x7fbcc80c5780 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.802+0000 7fbcbf400640 1 -- 172.21.15.19:0/3484021242 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8003610 con 0x7fbcc80c5780 2024-04-25T10:28:57.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.802+0000 7fbccd200640 1 -- 172.21.15.19:0/3484021242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc80cd4d0 con 0x7fbcc80c5780 2024-04-25T10:28:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.802+0000 7fbccd200640 1 -- 172.21.15.19:0/3484021242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc80b45e0 con 0x7fbcc80c5780 2024-04-25T10:28:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.803+0000 7fbccd200640 1 -- 172.21.15.19:0/3484021242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc8076520 con 0x7fbcc80c5780 2024-04-25T10:28:57.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.804+0000 7fbcbf400640 1 -- 172.21.15.19:0/3484021242 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbcb80037b0 con 0x7fbcc80c5780 2024-04-25T10:28:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.805+0000 7fbcbf400640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbca80744e0 0x7fbca80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.806+0000 7fbcbf400640 1 -- 172.21.15.19:0/3484021242 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7fbcb80b5d80 con 0x7fbcc80c5780 2024-04-25T10:28:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.806+0000 7fbcc6a00640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbca80744e0 0x7fbca80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:57.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.807+0000 7fbcc6a00640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbca80744e0 0x7fbca80769f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbcc81f7400 tx=0x7fbcb4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:57.811+0000 7fbcbf400640 1 -- 172.21.15.19:0/3484021242 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbcb80800a0 con 0x7fbcc80c5780 2024-04-25T10:28:58.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.019+0000 7fbccd200640 1 -- 172.21.15.19:0/3484021242 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fbcc8154ac0 con 0x7fbca80744e0 2024-04-25T10:28:58.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.020+0000 7fbcbf400640 1 -- 172.21.15.19:0/3484021242 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbcc8154ac0 con 0x7fbca80744e0 2024-04-25T10:28:58.021 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T10:28:58.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.022+0000 7fbccd200640 1 -- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbca80744e0 msgr2=0x7fbca80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.022+0000 7fbccd200640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbca80744e0 0x7fbca80769f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbcc81f7400 tx=0x7fbcb4009040 comp rx=0 tx=0).stop 2024-04-25T10:28:58.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.022+0000 7fbccd200640 1 -- 172.21.15.19:0/3484021242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc80c5780 msgr2=0x7fbcc81f6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.022+0000 7fbccd200640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc80c5780 0x7fbcc81f6d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbcb802a250 tx=0x7fbcb80046c0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.022+0000 7fbccd200640 1 -- 172.21.15.19:0/3484021242 shutdown_connections 2024-04-25T10:28:58.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.022+0000 7fbccd200640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbca80744e0 0x7fbca80769f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.022+0000 7fbccd200640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcc80ca0d0 0x7fbcc815fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.022+0000 7fbccd200640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcc80c5fd0 0x7fbcc80cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.022+0000 7fbccd200640 1 --2- 172.21.15.19:0/3484021242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc80c5780 0x7fbcc81f6d50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.022+0000 7fbccd200640 1 -- 172.21.15.19:0/3484021242 >> 172.21.15.19:0/3484021242 conn(0x7fbcc8071370 msgr2=0x7fbcc80ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:58.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.023+0000 7fbccd200640 1 -- 172.21.15.19:0/3484021242 shutdown_connections 2024-04-25T10:28:58.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.023+0000 7fbccd200640 1 -- 172.21.15.19:0/3484021242 wait complete. 2024-04-25T10:28:58.050 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T10:28:58.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:28:58.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.337+0000 7f90ea600640 1 Processor -- start 2024-04-25T10:28:58.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.338+0000 7f90ea600640 1 -- start start 2024-04-25T10:28:58.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.340+0000 7f90ea600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90e4154500 0x7f90e4072f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.340+0000 7f90ea600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90e40c7d50 0x7f90e415a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.340+0000 7f90ea600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90e40c8680 con 0x7f90e40c8160 2024-04-25T10:28:58.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.340+0000 7f90ea600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f90e40c8940 con 0x7f90e40c7d50 2024-04-25T10:28:58.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.340+0000 7f90ea600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f90e40c8c20 con 0x7f90e4154500 2024-04-25T10:28:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.340+0000 7f90e3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90e40c7d50 0x7f90e415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.340+0000 7f90e9c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f90e40c8160 0x7f90e40ca090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:59918/0 (socket says 172.21.15.19:59918) 2024-04-25T10:28:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.340+0000 7f90e9c00640 1 -- 172.21.15.19:0/923270322 learned_addr learned my addr 172.21.15.19:0/923270322 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.340+0000 7f90e9200640 1 --2- 172.21.15.19:0/923270322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90e4154500 0x7f90e4072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.341+0000 7f90e3e00640 1 -- 172.21.15.19:0/923270322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90e4154500 msgr2=0x7f90e4072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.341+0000 7f90e3e00640 1 --2- 172.21.15.19:0/923270322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90e4154500 0x7f90e4072f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.341+0000 7f90e3e00640 1 -- 172.21.15.19:0/923270322 >> v1:172.21.15.112:6789/0 conn(0x7f90e40c8160 legacy=0x7f90e40ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.341+0000 7f90e3e00640 1 -- 172.21.15.19:0/923270322 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e40c8f00 con 0x7f90e40c7d50 2024-04-25T10:28:58.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.342+0000 7f90e3e00640 1 --2- 172.21.15.19:0/923270322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90e40c7d50 0x7f90e415a800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f90d00097a0 tx=0x7f90d002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40eced5f01f583a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:58.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.342+0000 7f90e3400640 1 -- 172.21.15.19:0/923270322 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0037070 con 0x7f90e40c7d50 2024-04-25T10:28:58.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.342+0000 7f90e3400640 1 -- 172.21.15.19:0/923270322 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d0032440 con 0x7f90e40c7d50 2024-04-25T10:28:58.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.342+0000 7f90e3400640 1 -- 172.21.15.19:0/923270322 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0032810 con 0x7f90e40c7d50 2024-04-25T10:28:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.343+0000 7f90ea600640 1 -- 172.21.15.19:0/923270322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90e40c7d50 msgr2=0x7f90e415a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.343+0000 7f90ea600640 1 --2- 172.21.15.19:0/923270322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90e40c7d50 0x7f90e415a800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f90d00097a0 tx=0x7f90d002a210 comp rx=0 tx=0).stop 2024-04-25T10:28:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.343+0000 7f90ea600640 1 -- 172.21.15.19:0/923270322 shutdown_connections 2024-04-25T10:28:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.343+0000 7f90ea600640 1 --2- 172.21.15.19:0/923270322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90e40c7d50 0x7f90e415a800 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.343+0000 7f90ea600640 1 --2- 172.21.15.19:0/923270322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90e4154500 0x7f90e4072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.343+0000 7f90ea600640 1 -- 172.21.15.19:0/923270322 >> 172.21.15.19:0/923270322 conn(0x7f90e4070d10 msgr2=0x7f90e4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.344+0000 7f90ea600640 1 -- 172.21.15.19:0/923270322 shutdown_connections 2024-04-25T10:28:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.344+0000 7f90ea600640 1 -- 172.21.15.19:0/923270322 wait complete. 2024-04-25T10:28:58.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.347+0000 7f90ea600640 1 Processor -- start 2024-04-25T10:28:58.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.347+0000 7f90ea600640 1 -- start start 2024-04-25T10:28:58.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.349+0000 7f90ea600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90e40c7d50 0x7f90e41f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.349+0000 7f90ea600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90e4154500 0x7f90e4074060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.349+0000 7f90ea600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90e4159450 0x7f90e4141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.349+0000 7f90ea600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f90e40ca7a0 con 0x7f90e4159450 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.349+0000 7f90ea600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f90e4073480 con 0x7f90e4154500 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.349+0000 7f90ea600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f90e40ca920 con 0x7f90e40c7d50 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e9c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90e4159450 0x7f90e4141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90e4154500 0x7f90e4074060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e9200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90e40c7d50 0x7f90e41f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e9c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90e4159450 0x7f90e4141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60244/0 (socket says 172.21.15.19:60244) 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e9200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90e40c7d50 0x7f90e41f0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:45922/0 (socket says 172.21.15.19:45922) 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e9c00640 1 -- 172.21.15.19:0/3948545589 learned_addr learned my addr 172.21.15.19:0/3948545589 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90e4154500 0x7f90e4074060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:43982/0 (socket says 172.21.15.19:43982) 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e3e00640 1 -- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90e40c7d50 msgr2=0x7f90e41f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e3e00640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90e40c7d50 0x7f90e41f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e3e00640 1 -- 172.21.15.19:0/3948545589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90e4159450 msgr2=0x7f90e4141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e3e00640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90e4159450 0x7f90e4141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e3e00640 1 -- 172.21.15.19:0/3948545589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e41f0850 con 0x7f90e4154500 2024-04-25T10:28:58.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.350+0000 7f90e3e00640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90e4154500 0x7f90e4074060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f90e40c6ab0 tx=0x7f90d00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:58.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.351+0000 7f90e0c00640 1 -- 172.21.15.19:0/3948545589 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0041030 con 0x7f90e4154500 2024-04-25T10:28:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.351+0000 7f90e0c00640 1 -- 172.21.15.19:0/3948545589 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d0030500 con 0x7f90e4154500 2024-04-25T10:28:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.351+0000 7f90e0c00640 1 -- 172.21.15.19:0/3948545589 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0037040 con 0x7f90e4154500 2024-04-25T10:28:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.351+0000 7f90ea600640 1 -- 172.21.15.19:0/3948545589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e41f35e0 con 0x7f90e4154500 2024-04-25T10:28:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.351+0000 7f90ea600640 1 -- 172.21.15.19:0/3948545589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e41f3880 con 0x7f90e4154500 2024-04-25T10:28:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.352+0000 7f90ea600640 1 -- 172.21.15.19:0/3948545589 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90e41f3380 con 0x7f90e4154500 2024-04-25T10:28:58.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.353+0000 7f90e0c00640 1 -- 172.21.15.19:0/3948545589 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f90d0044070 con 0x7f90e4154500 2024-04-25T10:28:58.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.354+0000 7f90e0c00640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f90c40744e0 0x7f90c40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.354+0000 7f90e0c00640 1 -- 172.21.15.19:0/3948545589 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f90d00b5b50 con 0x7f90e4154500 2024-04-25T10:28:58.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.355+0000 7f90e0c00640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] conn(0x7f90c407de00 0x7f90c40802d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.355+0000 7f90e0c00640 1 -- 172.21.15.19:0/3948545589 --> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90d002cea0 con 0x7f90c407de00 2024-04-25T10:28:58.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.355+0000 7f90e0c00640 1 -- 172.21.15.19:0/3948545589 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f90d00ba2a0 con 0x7f90e4154500 2024-04-25T10:28:58.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.355+0000 7f90e9200640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f90c40744e0 0x7f90c40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.355+0000 7f90e9c00640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] conn(0x7f90c407de00 0x7f90c40802d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.355+0000 7f90e9200640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f90c40744e0 0x7f90c40769f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009aa0 tx=0x7f90d8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:58.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.356+0000 7f90e9c00640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] conn(0x7f90c407de00 0x7f90c40802d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:58.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.356+0000 7f90e0c00640 1 -- 172.21.15.19:0/3948545589 <== osd.5 v2:172.21.15.112:6817/667240234 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90d002cea0 con 0x7f90c407de00 2024-04-25T10:28:58.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.371+0000 7f90ea600640 1 -- 172.21.15.19:0/3948545589 --> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f90e4050740 con 0x7f90c407de00 2024-04-25T10:28:58.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.372+0000 7f90e0c00640 1 -- 172.21.15.19:0/3948545589 <== osd.5 v2:172.21.15.112:6817/667240234 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f90e4050740 con 0x7f90c407de00 2024-04-25T10:28:58.374 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:28:58.374 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:28:58.374 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:28:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.373+0000 7f90ea600640 1 -- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] conn(0x7f90c407de00 msgr2=0x7f90c40802d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.373+0000 7f90ea600640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:6817/667240234,v1:172.21.15.112:6819/667240234] conn(0x7f90c407de00 0x7f90c40802d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.373+0000 7f90ea600640 1 -- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f90c40744e0 msgr2=0x7f90c40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.373+0000 7f90ea600640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f90c40744e0 0x7f90c40769f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009aa0 tx=0x7f90d8009190 comp rx=0 tx=0).stop 2024-04-25T10:28:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.373+0000 7f90ea600640 1 -- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90e4154500 msgr2=0x7f90e4074060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.373+0000 7f90ea600640 1 --2- 172.21.15.19:0/3948545589 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90e4154500 0x7f90e4074060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f90e40c6ab0 tx=0x7f90d00046c0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.373+0000 7f90e9c00640 1 -- 172.21.15.19:0/3948545589 reap_dead start 2024-04-25T10:28:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.373+0000 7f90ea600640 1 -- 172.21.15.19:0/3948545589 shutdown_connections 2024-04-25T10:28:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.373+0000 7f90ea600640 1 -- 172.21.15.19:0/3948545589 >> 172.21.15.19:0/3948545589 conn(0x7f90e4070d10 msgr2=0x7f90e4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.373+0000 7f90ea600640 1 -- 172.21.15.19:0/3948545589 shutdown_connections 2024-04-25T10:28:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.373+0000 7f90ea600640 1 -- 172.21.15.19:0/3948545589 wait complete. 2024-04-25T10:28:58.406 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T10:28:58.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.692+0000 7fad38400640 1 Processor -- start 2024-04-25T10:28:58.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.692+0000 7fad38400640 1 -- start start 2024-04-25T10:28:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.694+0000 7fad38400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad30159f90 0x7fad300c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.694+0000 7fad38400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad300b07c0 con 0x7fad30159b80 2024-04-25T10:28:58.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.694+0000 7fad38400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad300b2600 con 0x7fad300c4930 2024-04-25T10:28:58.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.694+0000 7fad38400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fad301596f0 con 0x7fad30159f90 2024-04-25T10:28:58.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.694+0000 7fad36400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad30159f90 0x7fad300c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.694+0000 7fad35a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fad300c4930 0x7fad301534f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:59928/0 (socket says 172.21.15.19:59928) 2024-04-25T10:28:58.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.694+0000 7fad35a00640 1 -- 172.21.15.19:0/3331370511 learned_addr learned my addr 172.21.15.19:0/3331370511 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:58.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.695+0000 7fad2fe00640 1 -- 172.21.15.19:0/3331370511 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311859703 0 0) 0x7fad300b2600 con 0x7fad300c4930 2024-04-25T10:28:58.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.695+0000 7fad2fe00640 1 -- 172.21.15.19:0/3331370511 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad18005730 con 0x7fad300c4930 2024-04-25T10:28:58.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.695+0000 7fad36400640 1 -- 172.21.15.19:0/3331370511 >> v1:172.21.15.112:6789/0 conn(0x7fad300c4930 legacy=0x7fad301534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.695+0000 7fad36400640 1 -- 172.21.15.19:0/3331370511 >> v1:172.21.15.19:6789/0 conn(0x7fad30159b80 legacy=0x7fad300742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.695+0000 7fad2fe00640 1 -- 172.21.15.19:0/3331370511 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3010918050 0 0) 0x7fad300b07c0 con 0x7fad30159b80 2024-04-25T10:28:58.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.695+0000 7fad36400640 1 -- 172.21.15.19:0/3331370511 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad300b28e0 con 0x7fad30159f90 2024-04-25T10:28:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.696+0000 7fad36400640 1 --2- 172.21.15.19:0/3331370511 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad30159f90 0x7fad300c2a10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad28009dc0 tx=0x7fad2802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8c2534958ce810c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.696+0000 7fad2fe00640 1 -- 172.21.15.19:0/3331370511 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28007740 con 0x7fad30159f90 2024-04-25T10:28:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.696+0000 7fad2fe00640 1 -- 172.21.15.19:0/3331370511 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad280078e0 con 0x7fad30159f90 2024-04-25T10:28:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.696+0000 7fad2fe00640 1 -- 172.21.15.19:0/3331370511 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28007c90 con 0x7fad30159f90 2024-04-25T10:28:58.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.697+0000 7fad38400640 1 -- 172.21.15.19:0/3331370511 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad30159f90 msgr2=0x7fad300c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.697+0000 7fad38400640 1 --2- 172.21.15.19:0/3331370511 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad30159f90 0x7fad300c2a10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad28009dc0 tx=0x7fad2802a6d0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.697+0000 7fad38400640 1 -- 172.21.15.19:0/3331370511 shutdown_connections 2024-04-25T10:28:58.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.697+0000 7fad38400640 1 --2- 172.21.15.19:0/3331370511 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad30159f90 0x7fad300c2a10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.697+0000 7fad38400640 1 -- 172.21.15.19:0/3331370511 >> 172.21.15.19:0/3331370511 conn(0x7fad3006f1f0 msgr2=0x7fad3006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:58.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.697+0000 7fad38400640 1 -- 172.21.15.19:0/3331370511 shutdown_connections 2024-04-25T10:28:58.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.697+0000 7fad38400640 1 -- 172.21.15.19:0/3331370511 wait complete. 2024-04-25T10:28:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.700+0000 7fad38400640 1 Processor -- start 2024-04-25T10:28:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.700+0000 7fad38400640 1 -- start start 2024-04-25T10:28:58.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.701+0000 7fad38400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad300c4930 0x7fad300c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.701+0000 7fad38400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad30159b80 0x7fad301f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.701+0000 7fad38400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad30159f90 0x7fad3015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.701+0000 7fad38400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fad3015c900 con 0x7fad30159f90 2024-04-25T10:28:58.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.701+0000 7fad38400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fad300b2ea0 con 0x7fad30159b80 2024-04-25T10:28:58.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.701+0000 7fad38400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fad30159330 con 0x7fad300c4930 2024-04-25T10:28:58.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.702+0000 7fad35a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad300c4930 0x7fad300c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.702+0000 7fad35a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad300c4930 0x7fad300c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:45938/0 (socket says 172.21.15.19:45938) 2024-04-25T10:28:58.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.702+0000 7fad35a00640 1 -- 172.21.15.19:0/580561267 learned_addr learned my addr 172.21.15.19:0/580561267 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:58.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.702+0000 7fad35000640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad30159b80 0x7fad301f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.702+0000 7fad36400640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad30159f90 0x7fad3015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.702+0000 7fad35a00640 1 -- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad30159b80 msgr2=0x7fad301f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.702+0000 7fad35a00640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad30159b80 0x7fad301f24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.702+0000 7fad35a00640 1 -- 172.21.15.19:0/580561267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad30159f90 msgr2=0x7fad3015b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.702+0000 7fad35a00640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad30159f90 0x7fad3015b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.702+0000 7fad35a00640 1 -- 172.21.15.19:0/580561267 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad301f2a20 con 0x7fad300c4930 2024-04-25T10:28:58.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.703+0000 7fad35a00640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad300c4930 0x7fad300c7310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c440 tx=0x7fad2400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:58.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.703+0000 7fad2d600640 1 -- 172.21.15.19:0/580561267 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24017070 con 0x7fad300c4930 2024-04-25T10:28:58.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.703+0000 7fad2d600640 1 -- 172.21.15.19:0/580561267 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad24005ce0 con 0x7fad300c4930 2024-04-25T10:28:58.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.703+0000 7fad2d600640 1 -- 172.21.15.19:0/580561267 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad240072b0 con 0x7fad300c4930 2024-04-25T10:28:58.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.703+0000 7fad38400640 1 -- 172.21.15.19:0/580561267 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad30152540 con 0x7fad300c4930 2024-04-25T10:28:58.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.703+0000 7fad38400640 1 -- 172.21.15.19:0/580561267 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fad301f5d30 con 0x7fad300c4930 2024-04-25T10:28:58.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.704+0000 7fad38400640 1 -- 172.21.15.19:0/580561267 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad301f2bf0 con 0x7fad300c4930 2024-04-25T10:28:58.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.706+0000 7fad2d600640 1 -- 172.21.15.19:0/580561267 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fad2401a070 con 0x7fad300c4930 2024-04-25T10:28:58.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.707+0000 7fad2d600640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fad100744e0 0x7fad100769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:58.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.707+0000 7fad2d600640 1 -- 172.21.15.19:0/580561267 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7fad240948b0 con 0x7fad300c4930 2024-04-25T10:28:58.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.707+0000 7fad35000640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fad100744e0 0x7fad100769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:58.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.708+0000 7fad35000640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fad100744e0 0x7fad100769f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fad30151f90 tx=0x7fad1c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:58.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.712+0000 7fad2d600640 1 -- 172.21.15.19:0/580561267 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad2405e6d0 con 0x7fad300c4930 2024-04-25T10:28:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.919+0000 7fad38400640 1 -- 172.21.15.19:0/580561267 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fad3006a240 con 0x7fad100744e0 2024-04-25T10:28:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.920+0000 7fad2d600640 1 -- 172.21.15.19:0/580561267 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fad3006a240 con 0x7fad100744e0 2024-04-25T10:28:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T10:28:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.922+0000 7fad38400640 1 -- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fad100744e0 msgr2=0x7fad100769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.922+0000 7fad38400640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fad100744e0 0x7fad100769f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fad30151f90 tx=0x7fad1c009040 comp rx=0 tx=0).stop 2024-04-25T10:28:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.922+0000 7fad38400640 1 -- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad300c4930 msgr2=0x7fad300c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.922+0000 7fad38400640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad300c4930 0x7fad300c7310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c440 tx=0x7fad2400c900 comp rx=0 tx=0).stop 2024-04-25T10:28:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.923+0000 7fad38400640 1 -- 172.21.15.19:0/580561267 shutdown_connections 2024-04-25T10:28:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.923+0000 7fad38400640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad30159f90 0x7fad3015b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.923+0000 7fad38400640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad30159b80 0x7fad301f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.923+0000 7fad38400640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fad100744e0 0x7fad100769f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.923+0000 7fad38400640 1 --2- 172.21.15.19:0/580561267 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad300c4930 0x7fad300c7310 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.923+0000 7fad38400640 1 -- 172.21.15.19:0/580561267 >> 172.21.15.19:0/580561267 conn(0x7fad3006f1f0 msgr2=0x7fad300b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.923+0000 7fad38400640 1 -- 172.21.15.19:0/580561267 shutdown_connections 2024-04-25T10:28:58.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:58.923+0000 7fad38400640 1 -- 172.21.15.19:0/580561267 wait complete. 2024-04-25T10:28:58.954 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T10:28:58.954 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:28:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.238+0000 7f72c9e00640 1 Processor -- start 2024-04-25T10:28:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.238+0000 7f72c9e00640 1 -- start start 2024-04-25T10:28:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.241+0000 7f72c9e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f72c40cb0d0 0x7f72c41540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.241+0000 7f72c9e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c40ca590 0x7f72c40ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.241+0000 7f72c9e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c415add0 con 0x7f72c415e540 2024-04-25T10:28:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.241+0000 7f72c9e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f72c40c6b60 con 0x7f72c40cb0d0 2024-04-25T10:28:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.241+0000 7f72c9e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f72c415b070 con 0x7f72c40ca590 2024-04-25T10:28:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.241+0000 7f72c9400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c40ca590 0x7f72c40ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.241+0000 7f72c8a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f72c415e540 0x7f72c40c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:59932/0 (socket says 172.21.15.19:59932) 2024-04-25T10:28:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.241+0000 7f72c8a00640 1 -- 172.21.15.19:0/2567311398 learned_addr learned my addr 172.21.15.19:0/2567311398 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:28:59.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.241+0000 7f72c3e00640 1 --2- 172.21.15.19:0/2567311398 >> v2:172.21.15.19:3300/0 conn(0x7f72c40cb0d0 0x7f72c41540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.242+0000 7f72c3e00640 1 -- 172.21.15.19:0/2567311398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c40ca590 msgr2=0x7f72c40ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.242+0000 7f72c3e00640 1 --2- 172.21.15.19:0/2567311398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c40ca590 0x7f72c40ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.242+0000 7f72c3400640 1 -- 172.21.15.19:0/2567311398 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 926096512 0 0) 0x7f72c415add0 con 0x7f72c415e540 2024-04-25T10:28:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.242+0000 7f72c3e00640 1 -- 172.21.15.19:0/2567311398 >> v1:172.21.15.112:6789/0 conn(0x7f72c415e540 legacy=0x7f72c40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.242+0000 7f72c3e00640 1 -- 172.21.15.19:0/2567311398 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c415da60 con 0x7f72c40cb0d0 2024-04-25T10:28:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.242+0000 7f72c9400640 1 --2- 172.21.15.19:0/2567311398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c40ca590 0x7f72c40ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:59.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.243+0000 7f72c3e00640 1 --2- 172.21.15.19:0/2567311398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c40cb0d0 0x7f72c41540b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f72b00097a0 tx=0x7f72b002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b53f317dbc4547 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:59.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.243+0000 7f72c3400640 1 -- 172.21.15.19:0/2567311398 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0037070 con 0x7f72c40cb0d0 2024-04-25T10:28:59.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.243+0000 7f72c3400640 1 -- 172.21.15.19:0/2567311398 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b0032440 con 0x7f72c40cb0d0 2024-04-25T10:28:59.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.243+0000 7f72c3400640 1 -- 172.21.15.19:0/2567311398 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0032810 con 0x7f72c40cb0d0 2024-04-25T10:28:59.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.244+0000 7f72c9e00640 1 -- 172.21.15.19:0/2567311398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c40cb0d0 msgr2=0x7f72c41540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.244+0000 7f72c9e00640 1 --2- 172.21.15.19:0/2567311398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c40cb0d0 0x7f72c41540b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f72b00097a0 tx=0x7f72b002a210 comp rx=0 tx=0).stop 2024-04-25T10:28:59.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.245+0000 7f72c9e00640 1 -- 172.21.15.19:0/2567311398 shutdown_connections 2024-04-25T10:28:59.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.245+0000 7f72c9e00640 1 --2- 172.21.15.19:0/2567311398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c40ca590 0x7f72c40ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.245+0000 7f72c9e00640 1 --2- 172.21.15.19:0/2567311398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c40cb0d0 0x7f72c41540b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.245+0000 7f72c9e00640 1 -- 172.21.15.19:0/2567311398 >> 172.21.15.19:0/2567311398 conn(0x7f72c4068460 msgr2=0x7f72c4068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:59.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.245+0000 7f72c9e00640 1 -- 172.21.15.19:0/2567311398 shutdown_connections 2024-04-25T10:28:59.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.245+0000 7f72c9e00640 1 -- 172.21.15.19:0/2567311398 wait complete. 2024-04-25T10:28:59.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.247+0000 7f72c9e00640 1 Processor -- start 2024-04-25T10:28:59.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.247+0000 7f72c9e00640 1 -- start start 2024-04-25T10:28:59.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.249+0000 7f72c9e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c40ca590 0x7f72c414d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.249+0000 7f72c9e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c40cb0d0 0x7f72c414fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.249+0000 7f72c9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c415e540 0x7f72c4149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.249+0000 7f72c9e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f72c41545f0 con 0x7f72c40cb0d0 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.249+0000 7f72c9e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f72c415e020 con 0x7f72c415e540 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.249+0000 7f72c9e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f72c4154770 con 0x7f72c40ca590 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.249+0000 7f72c3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c40cb0d0 0x7f72c414fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.249+0000 7f72c8a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c40ca590 0x7f72c414d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.249+0000 7f72c9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c415e540 0x7f72c4149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.249+0000 7f72c3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c40cb0d0 0x7f72c414fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60282/0 (socket says 172.21.15.19:60282) 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.249+0000 7f72c3e00640 1 -- 172.21.15.19:0/3756190800 learned_addr learned my addr 172.21.15.19:0/3756190800 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.250+0000 7f72c3e00640 1 -- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c40ca590 msgr2=0x7f72c414d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.250+0000 7f72c3e00640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c40ca590 0x7f72c414d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.250+0000 7f72c3e00640 1 -- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c415e540 msgr2=0x7f72c4149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.250+0000 7f72c3e00640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c415e540 0x7f72c4149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.250+0000 7f72c3e00640 1 -- 172.21.15.19:0/3756190800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c4150110 con 0x7f72c40cb0d0 2024-04-25T10:28:59.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.250+0000 7f72c8a00640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c40ca590 0x7f72c414d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:59.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.250+0000 7f72c3e00640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c40cb0d0 0x7f72c414fbd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f72b0035040 tx=0x7f72b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.250+0000 7f72c0c00640 1 -- 172.21.15.19:0/3756190800 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0037050 con 0x7f72c40cb0d0 2024-04-25T10:28:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.250+0000 7f72c0c00640 1 -- 172.21.15.19:0/3756190800 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b0038040 con 0x7f72c40cb0d0 2024-04-25T10:28:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.250+0000 7f72c0c00640 1 -- 172.21.15.19:0/3756190800 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0004470 con 0x7f72c40cb0d0 2024-04-25T10:28:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.251+0000 7f72c9e00640 1 -- 172.21.15.19:0/3756190800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c414df50 con 0x7f72c40cb0d0 2024-04-25T10:28:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.251+0000 7f72c9e00640 1 -- 172.21.15.19:0/3756190800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c414ed20 con 0x7f72c40cb0d0 2024-04-25T10:28:59.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.252+0000 7f72c9e00640 1 -- 172.21.15.19:0/3756190800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72c4050740 con 0x7f72c40cb0d0 2024-04-25T10:28:59.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.253+0000 7f72c0c00640 1 -- 172.21.15.19:0/3756190800 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f72b0003610 con 0x7f72c40cb0d0 2024-04-25T10:28:59.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.254+0000 7f72c0c00640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f72a40744b0 0x7f72a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.254+0000 7f72c0c00640 1 -- 172.21.15.19:0/3756190800 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f72b00b5f10 con 0x7f72c40cb0d0 2024-04-25T10:28:59.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.254+0000 7f72c0c00640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] conn(0x7f72a407ddc0 0x7f72a4080290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.254+0000 7f72c0c00640 1 -- 172.21.15.19:0/3756190800 --> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72b004bec0 con 0x7f72a407ddc0 2024-04-25T10:28:59.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.254+0000 7f72c0c00640 1 -- 172.21.15.19:0/3756190800 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f72b00b8530 con 0x7f72c40cb0d0 2024-04-25T10:28:59.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.254+0000 7f72c8a00640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f72a40744b0 0x7f72a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.255+0000 7f72c9400640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] conn(0x7f72a407ddc0 0x7f72a4080290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.255+0000 7f72c8a00640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f72a40744b0 0x7f72a40769c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f72b8000f60 tx=0x7f72b8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:59.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.256+0000 7f72c9400640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] conn(0x7f72a407ddc0 0x7f72a4080290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:59.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.256+0000 7f72c0c00640 1 -- 172.21.15.19:0/3756190800 <== osd.6 v2:172.21.15.112:6816/1243277585 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72b004bec0 con 0x7f72a407ddc0 2024-04-25T10:28:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.271+0000 7f72c9e00640 1 -- 172.21.15.19:0/3756190800 --> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f72c414dcc0 con 0x7f72a407ddc0 2024-04-25T10:28:59.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.272+0000 7f72c0c00640 1 -- 172.21.15.19:0/3756190800 <== osd.6 v2:172.21.15.112:6816/1243277585 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f72c414dcc0 con 0x7f72a407ddc0 2024-04-25T10:28:59.274 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:28:59.274 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:28:59.274 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:28:59.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.273+0000 7f72c9e00640 1 -- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] conn(0x7f72a407ddc0 msgr2=0x7f72a4080290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.273+0000 7f72c9e00640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:6816/1243277585,v1:172.21.15.112:6818/1243277585] conn(0x7f72a407ddc0 0x7f72a4080290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.273+0000 7f72c9e00640 1 -- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f72a40744b0 msgr2=0x7f72a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.273+0000 7f72c9e00640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f72a40744b0 0x7f72a40769c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f72b8000f60 tx=0x7f72b8009040 comp rx=0 tx=0).stop 2024-04-25T10:28:59.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.273+0000 7f72c9e00640 1 -- 172.21.15.19:0/3756190800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c40cb0d0 msgr2=0x7f72c414fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.273+0000 7f72c9e00640 1 --2- 172.21.15.19:0/3756190800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c40cb0d0 0x7f72c414fbd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f72b0035040 tx=0x7f72b00046c0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.273+0000 7f72c9400640 1 -- 172.21.15.19:0/3756190800 reap_dead start 2024-04-25T10:28:59.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.273+0000 7f72c9e00640 1 -- 172.21.15.19:0/3756190800 shutdown_connections 2024-04-25T10:28:59.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.273+0000 7f72c9e00640 1 -- 172.21.15.19:0/3756190800 >> 172.21.15.19:0/3756190800 conn(0x7f72c4068460 msgr2=0x7f72c415a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:59.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.273+0000 7f72c9e00640 1 -- 172.21.15.19:0/3756190800 shutdown_connections 2024-04-25T10:28:59.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.273+0000 7f72c9e00640 1 -- 172.21.15.19:0/3756190800 wait complete. 2024-04-25T10:28:59.302 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T10:28:59.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.590+0000 7f538f600640 1 Processor -- start 2024-04-25T10:28:59.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.590+0000 7f538f600640 1 -- start start 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.592+0000 7f538f600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53880c7cd0 0x7f538815cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.592+0000 7f538f600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53880b5340 0x7f538808d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.592+0000 7f538f600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f538808dca0 0x7f538808e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.592+0000 7f538f600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f53880c7840 con 0x7f538808dca0 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.592+0000 7f538f600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f53880cee50 con 0x7f53880b5340 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.592+0000 7f538f600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f53880c6ab0 con 0x7f53880c7cd0 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.593+0000 7f538d600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f538808dca0 0x7f538808e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.593+0000 7f5387e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53880b5340 0x7f538808d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.593+0000 7f538cc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53880c7cd0 0x7f538815cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.593+0000 7f5387e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53880b5340 0x7f538808d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:44012/0 (socket says 172.21.15.19:44012) 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.593+0000 7f5387e00640 1 -- 172.21.15.19:0/1296076856 learned_addr learned my addr 172.21.15.19:0/1296076856 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:59.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.593+0000 7f5387e00640 1 -- 172.21.15.19:0/1296076856 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53880c7cd0 msgr2=0x7f538815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:59.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.593+0000 7f5387e00640 1 --2- 172.21.15.19:0/1296076856 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53880c7cd0 0x7f538815cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.593+0000 7f5387e00640 1 -- 172.21.15.19:0/1296076856 >> v2:172.21.15.19:3300/0 conn(0x7f538808dca0 msgr2=0x7f538808e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:28:59.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.593+0000 7f5387e00640 1 --2- 172.21.15.19:0/1296076856 >> v2:172.21.15.19:3300/0 conn(0x7f538808dca0 0x7f538808e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.593+0000 7f5387e00640 1 -- 172.21.15.19:0/1296076856 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53880c6f50 con 0x7f53880b5340 2024-04-25T10:28:59.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.593+0000 7f538d600640 1 --2- 172.21.15.19:0/1296076856 >> v2:172.21.15.19:3300/0 conn(0x7f538808dca0 0x7f538808e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:28:59.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.595+0000 7f5387e00640 1 --2- 172.21.15.19:0/1296076856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53880b5340 0x7f538808d760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f538806f720 tx=0x7f537402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c8449270faccb3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:59.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.595+0000 7f5387400640 1 -- 172.21.15.19:0/1296076856 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374037070 con 0x7f53880b5340 2024-04-25T10:28:59.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.595+0000 7f5387400640 1 -- 172.21.15.19:0/1296076856 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5374032440 con 0x7f53880b5340 2024-04-25T10:28:59.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.595+0000 7f5387400640 1 -- 172.21.15.19:0/1296076856 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374032810 con 0x7f53880b5340 2024-04-25T10:28:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.596+0000 7f538f600640 1 -- 172.21.15.19:0/1296076856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53880b5340 msgr2=0x7f538808d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.596+0000 7f538f600640 1 --2- 172.21.15.19:0/1296076856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53880b5340 0x7f538808d760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f538806f720 tx=0x7f537402a270 comp rx=0 tx=0).stop 2024-04-25T10:28:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.596+0000 7f538f600640 1 -- 172.21.15.19:0/1296076856 shutdown_connections 2024-04-25T10:28:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.596+0000 7f538f600640 1 --2- 172.21.15.19:0/1296076856 >> v2:172.21.15.19:3300/0 conn(0x7f538808dca0 0x7f538808e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.596+0000 7f538f600640 1 --2- 172.21.15.19:0/1296076856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53880b5340 0x7f538808d760 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.596+0000 7f538f600640 1 --2- 172.21.15.19:0/1296076856 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53880c7cd0 0x7f538815cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.596+0000 7f538f600640 1 -- 172.21.15.19:0/1296076856 >> 172.21.15.19:0/1296076856 conn(0x7f538806f2e0 msgr2=0x7f5388068460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.596+0000 7f538f600640 1 -- 172.21.15.19:0/1296076856 shutdown_connections 2024-04-25T10:28:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.596+0000 7f538f600640 1 -- 172.21.15.19:0/1296076856 wait complete. 2024-04-25T10:28:59.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.599+0000 7f538f600640 1 Processor -- start 2024-04-25T10:28:59.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.600+0000 7f538f600640 1 -- start start 2024-04-25T10:28:59.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.602+0000 7f538f600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f538808dca0 0x7f53881f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.602+0000 7f538f600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53880b5340 0x7f538815f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.602+0000 7f538f600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53880c7cd0 0x7f538815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.602+0000 7f538f600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f53880c74d0 con 0x7f538808dca0 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.602+0000 7f538f600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f53880c71f0 con 0x7f53880b5340 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.602+0000 7f538f600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f53880ccbd0 con 0x7f53880c7cd0 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.602+0000 7f538cc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f538808dca0 0x7f53881f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.602+0000 7f538cc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f538808dca0 0x7f53881f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60308/0 (socket says 172.21.15.19:60308) 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.602+0000 7f538cc00640 1 -- 172.21.15.19:0/2131871676 learned_addr learned my addr 172.21.15.19:0/2131871676 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.602+0000 7f5387e00640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53880b5340 0x7f538815f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.602+0000 7f538d600640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53880c7cd0 0x7f538815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.603+0000 7f538cc00640 1 -- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53880c7cd0 msgr2=0x7f538815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.603+0000 7f538cc00640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53880c7cd0 0x7f538815bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.603+0000 7f538cc00640 1 -- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53880b5340 msgr2=0x7f538815f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.603+0000 7f538cc00640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53880b5340 0x7f538815f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.603+0000 7f538cc00640 1 -- 172.21.15.19:0/2131871676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53881f57d0 con 0x7f538808dca0 2024-04-25T10:28:59.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.603+0000 7f538cc00640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f538808dca0 0x7f53881f5f60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f537c00e840 tx=0x7f537c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:59.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.603+0000 7f5384c00640 1 -- 172.21.15.19:0/2131871676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c017070 con 0x7f538808dca0 2024-04-25T10:28:59.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.604+0000 7f5384c00640 1 -- 172.21.15.19:0/2131871676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f537c00c730 con 0x7f538808dca0 2024-04-25T10:28:59.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.604+0000 7f5384c00640 1 -- 172.21.15.19:0/2131871676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c00cb00 con 0x7f538808dca0 2024-04-25T10:28:59.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.604+0000 7f538f600640 1 -- 172.21.15.19:0/2131871676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53881f21c0 con 0x7f538808dca0 2024-04-25T10:28:59.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.604+0000 7f538f600640 1 -- 172.21.15.19:0/2131871676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538815e780 con 0x7f538808dca0 2024-04-25T10:28:59.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.605+0000 7f538f600640 1 -- 172.21.15.19:0/2131871676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53881f2390 con 0x7f538808dca0 2024-04-25T10:28:59.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.607+0000 7f5384c00640 1 -- 172.21.15.19:0/2131871676 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f537c01a070 con 0x7f538808dca0 2024-04-25T10:28:59.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.609+0000 7f5384c00640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53680744b0 0x7f53680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:28:59.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.609+0000 7f5384c00640 1 -- 172.21.15.19:0/2131871676 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f537c0953f0 con 0x7f538808dca0 2024-04-25T10:28:59.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.609+0000 7f5387e00640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53680744b0 0x7f53680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:28:59.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.610+0000 7f5387e00640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53680744b0 0x7f53680769c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5374034000 tx=0x7f537402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:28:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.613+0000 7f5384c00640 1 -- 172.21.15.19:0/2131871676 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f537c05f0c0 con 0x7f538808dca0 2024-04-25T10:28:59.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.823+0000 7f538f600640 1 -- 172.21.15.19:0/2131871676 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f53881f5ba0 con 0x7f53680744b0 2024-04-25T10:28:59.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.825+0000 7f5384c00640 1 -- 172.21.15.19:0/2131871676 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f53881f5ba0 con 0x7f53680744b0 2024-04-25T10:28:59.826 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T10:28:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 -- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53680744b0 msgr2=0x7f53680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53680744b0 0x7f53680769c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5374034000 tx=0x7f537402e000 comp rx=0 tx=0).stop 2024-04-25T10:28:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 -- 172.21.15.19:0/2131871676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f538808dca0 msgr2=0x7f53881f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:28:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f538808dca0 0x7f53881f5f60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f537c00e840 tx=0x7f537c00ec40 comp rx=0 tx=0).stop 2024-04-25T10:28:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 -- 172.21.15.19:0/2131871676 shutdown_connections 2024-04-25T10:28:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f53680744b0 0x7f53680769c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53880c7cd0 0x7f538815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53880b5340 0x7f538815f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 --2- 172.21.15.19:0/2131871676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f538808dca0 0x7f53881f5f60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:28:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 -- 172.21.15.19:0/2131871676 >> 172.21.15.19:0/2131871676 conn(0x7f538806f2e0 msgr2=0x7f5388152820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:28:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 -- 172.21.15.19:0/2131871676 shutdown_connections 2024-04-25T10:28:59.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:28:59.828+0000 7f538f600640 1 -- 172.21.15.19:0/2131871676 wait complete. 2024-04-25T10:28:59.857 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T10:28:59.858 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:29:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.144+0000 7f8b91200640 1 Processor -- start 2024-04-25T10:29:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.144+0000 7f8b91200640 1 -- start start 2024-04-25T10:29:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.146+0000 7f8b91200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b8c156800 0x7f8b8c15cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.146+0000 7f8b91200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8b8c15d310 0x7f8b8c0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.146+0000 7f8b91200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b8c0710e0 con 0x7f8b8c0cc770 2024-04-25T10:29:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.146+0000 7f8b91200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f8b8c06dfc0 con 0x7f8b8c156800 2024-04-25T10:29:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.146+0000 7f8b91200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8b8c15c940 con 0x7f8b8c15d310 2024-04-25T10:29:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.146+0000 7f8b8b400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b8c156800 0x7f8b8c15cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.146+0000 7f8b8b400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b8c156800 0x7f8b8c15cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60322/0 (socket says 172.21.15.19:60322) 2024-04-25T10:29:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.146+0000 7f8b8b400640 1 -- 172.21.15.19:0/2629773139 learned_addr learned my addr 172.21.15.19:0/2629773139 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:00.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.146+0000 7f8b83e00640 1 --2- 172.21.15.19:0/2629773139 >> v2:172.21.15.112:3300/0 conn(0x7f8b8c15d310 0x7f8b8c0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.147+0000 7f8b8b400640 1 -- 172.21.15.19:0/2629773139 >> v2:172.21.15.112:3300/0 conn(0x7f8b8c15d310 msgr2=0x7f8b8c0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:29:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.147+0000 7f8b8b400640 1 --2- 172.21.15.19:0/2629773139 >> v2:172.21.15.112:3300/0 conn(0x7f8b8c15d310 0x7f8b8c0cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.147+0000 7f8b8aa00640 1 -- 172.21.15.19:0/2629773139 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571562764 0 0) 0x7f8b8c0710e0 con 0x7f8b8c0cc770 2024-04-25T10:29:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.147+0000 7f8b8b400640 1 -- 172.21.15.19:0/2629773139 >> v1:172.21.15.112:6789/0 conn(0x7f8b8c0cc770 legacy=0x7f8b8c0ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.147+0000 7f8b8b400640 1 -- 172.21.15.19:0/2629773139 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8c15c5f0 con 0x7f8b8c156800 2024-04-25T10:29:00.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.148+0000 7f8b8b400640 1 --2- 172.21.15.19:0/2629773139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c156800 0x7f8b8c15cdd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0728d0 tx=0x7f8b7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1de6eaedcf5f6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:00.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.148+0000 7f8b8aa00640 1 -- 172.21.15.19:0/2629773139 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c037070 con 0x7f8b8c156800 2024-04-25T10:29:00.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.149+0000 7f8b8aa00640 1 -- 172.21.15.19:0/2629773139 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c032440 con 0x7f8b8c156800 2024-04-25T10:29:00.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.149+0000 7f8b8aa00640 1 -- 172.21.15.19:0/2629773139 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c032810 con 0x7f8b8c156800 2024-04-25T10:29:00.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.149+0000 7f8b91200640 1 -- 172.21.15.19:0/2629773139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c156800 msgr2=0x7f8b8c15cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.149+0000 7f8b91200640 1 --2- 172.21.15.19:0/2629773139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c156800 0x7f8b8c15cdd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0728d0 tx=0x7f8b7c02a270 comp rx=0 tx=0).stop 2024-04-25T10:29:00.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.149+0000 7f8b91200640 1 -- 172.21.15.19:0/2629773139 shutdown_connections 2024-04-25T10:29:00.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.149+0000 7f8b91200640 1 --2- 172.21.15.19:0/2629773139 >> v2:172.21.15.112:3300/0 conn(0x7f8b8c15d310 0x7f8b8c0cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.149+0000 7f8b91200640 1 --2- 172.21.15.19:0/2629773139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c156800 0x7f8b8c15cdd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.149+0000 7f8b91200640 1 -- 172.21.15.19:0/2629773139 >> 172.21.15.19:0/2629773139 conn(0x7f8b8c069010 msgr2=0x7f8b8c072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:00.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.149+0000 7f8b91200640 1 -- 172.21.15.19:0/2629773139 shutdown_connections 2024-04-25T10:29:00.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.150+0000 7f8b91200640 1 -- 172.21.15.19:0/2629773139 wait complete. 2024-04-25T10:29:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.152+0000 7f8b91200640 1 Processor -- start 2024-04-25T10:29:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.152+0000 7f8b91200640 1 -- start start 2024-04-25T10:29:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.153+0000 7f8b91200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b8c0cc770 0x7f8b8c0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b91200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c156800 0x7f8b8c0b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b91200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b8c15d310 0x7f8b8c154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b91200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c06e7b0 con 0x7f8b8c156800 2024-04-25T10:29:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b91200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c06e4d0 con 0x7f8b8c15d310 2024-04-25T10:29:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b91200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8c06ea90 con 0x7f8b8c0cc770 2024-04-25T10:29:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b83e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c156800 0x7f8b8c0b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b83e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c156800 0x7f8b8c0b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60324/0 (socket says 172.21.15.19:60324) 2024-04-25T10:29:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b83e00640 1 -- 172.21.15.19:0/892202996 learned_addr learned my addr 172.21.15.19:0/892202996 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b8b400640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b8c0cc770 0x7f8b8c0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b8be00640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b8c15d310 0x7f8b8c154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b83e00640 1 -- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b8c0cc770 msgr2=0x7f8b8c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b83e00640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b8c0cc770 0x7f8b8c0b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b83e00640 1 -- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b8c15d310 msgr2=0x7f8b8c154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b83e00640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b8c15d310 0x7f8b8c154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.154+0000 7f8b83e00640 1 -- 172.21.15.19:0/892202996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8c0b0ec0 con 0x7f8b8c156800 2024-04-25T10:29:00.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.155+0000 7f8b83e00640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c156800 0x7f8b8c0b0980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400e870 tx=0x7f8b7400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:00.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.155+0000 7f8b83400640 1 -- 172.21.15.19:0/892202996 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74017070 con 0x7f8b8c156800 2024-04-25T10:29:00.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.155+0000 7f8b83400640 1 -- 172.21.15.19:0/892202996 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7400c940 con 0x7f8b8c156800 2024-04-25T10:29:00.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.155+0000 7f8b91200640 1 -- 172.21.15.19:0/892202996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8c0b3800 con 0x7f8b8c156800 2024-04-25T10:29:00.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.155+0000 7f8b83400640 1 -- 172.21.15.19:0/892202996 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7400cd10 con 0x7f8b8c156800 2024-04-25T10:29:00.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.155+0000 7f8b91200640 1 -- 172.21.15.19:0/892202996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b8c0b0180 con 0x7f8b8c156800 2024-04-25T10:29:00.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.156+0000 7f8b91200640 1 -- 172.21.15.19:0/892202996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b8c0b22e0 con 0x7f8b8c156800 2024-04-25T10:29:00.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.158+0000 7f8b83400640 1 -- 172.21.15.19:0/892202996 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8b7401a070 con 0x7f8b8c156800 2024-04-25T10:29:00.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.159+0000 7f8b83400640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8b680744b0 0x7f8b680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.159+0000 7f8b83400640 1 -- 172.21.15.19:0/892202996 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f8b74095370 con 0x7f8b8c156800 2024-04-25T10:29:00.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.159+0000 7f8b83400640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] conn(0x7f8b6807ddc0 0x7f8b68080290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.159+0000 7f8b83400640 1 -- 172.21.15.19:0/892202996 --> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b74021ec0 con 0x7f8b6807ddc0 2024-04-25T10:29:00.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.159+0000 7f8b83400640 1 -- 172.21.15.19:0/892202996 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b7409c050 con 0x7f8b8c156800 2024-04-25T10:29:00.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.159+0000 7f8b8b400640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8b680744b0 0x7f8b680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.160+0000 7f8b8be00640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] conn(0x7f8b6807ddc0 0x7f8b68080290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.160+0000 7f8b8be00640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] conn(0x7f8b6807ddc0 0x7f8b68080290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:00.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.160+0000 7f8b8b400640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8b680744b0 0x7f8b680769c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c034000 tx=0x7f8b7c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:00.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.161+0000 7f8b83400640 1 -- 172.21.15.19:0/892202996 <== osd.7 v2:172.21.15.112:6802/1243256197 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b74021ec0 con 0x7f8b6807ddc0 2024-04-25T10:29:00.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.176+0000 7f8b91200640 1 -- 172.21.15.19:0/892202996 --> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8b8c0b3590 con 0x7f8b6807ddc0 2024-04-25T10:29:00.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.177+0000 7f8b83400640 1 -- 172.21.15.19:0/892202996 <== osd.7 v2:172.21.15.112:6802/1243256197 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8b8c0b3590 con 0x7f8b6807ddc0 2024-04-25T10:29:00.178 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-04-25T10:29:00.179 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:29:00.179 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-04-25T10:29:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.177+0000 7f8b91200640 1 -- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] conn(0x7f8b6807ddc0 msgr2=0x7f8b68080290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.177+0000 7f8b91200640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:6802/1243256197,v1:172.21.15.112:6804/1243256197] conn(0x7f8b6807ddc0 0x7f8b68080290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.178+0000 7f8b91200640 1 -- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8b680744b0 msgr2=0x7f8b680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.178+0000 7f8b91200640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f8b680744b0 0x7f8b680769c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c034000 tx=0x7f8b7c02e000 comp rx=0 tx=0).stop 2024-04-25T10:29:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.178+0000 7f8b91200640 1 -- 172.21.15.19:0/892202996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c156800 msgr2=0x7f8b8c0b0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.178+0000 7f8b91200640 1 --2- 172.21.15.19:0/892202996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b8c156800 0x7f8b8c0b0980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400e870 tx=0x7f8b7400ed30 comp rx=0 tx=0).stop 2024-04-25T10:29:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.178+0000 7f8b8be00640 1 -- 172.21.15.19:0/892202996 reap_dead start 2024-04-25T10:29:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.178+0000 7f8b91200640 1 -- 172.21.15.19:0/892202996 shutdown_connections 2024-04-25T10:29:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.178+0000 7f8b91200640 1 -- 172.21.15.19:0/892202996 >> 172.21.15.19:0/892202996 conn(0x7f8b8c069010 msgr2=0x7f8b8c0ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.178+0000 7f8b91200640 1 -- 172.21.15.19:0/892202996 shutdown_connections 2024-04-25T10:29:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.178+0000 7f8b91200640 1 -- 172.21.15.19:0/892202996 wait complete. 2024-04-25T10:29:00.206 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T10:29:00.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.493+0000 7ff58a200640 1 Processor -- start 2024-04-25T10:29:00.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.494+0000 7ff58a200640 1 -- start start 2024-04-25T10:29:00.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.496+0000 7ff58a200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff58415b2c0 0x7ff5840c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.496+0000 7ff58a200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff584158010 con 0x7ff584073160 2024-04-25T10:29:00.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.496+0000 7ff58a200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff584074970 con 0x7ff5840cdde0 2024-04-25T10:29:00.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.496+0000 7ff58a200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff5840c8600 con 0x7ff58415b2c0 2024-04-25T10:29:00.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.496+0000 7ff583400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff58415b2c0 0x7ff5840c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.496+0000 7ff583400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff58415b2c0 0x7ff5840c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60330/0 (socket says 172.21.15.19:60330) 2024-04-25T10:29:00.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.496+0000 7ff57be00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff584073160 0x7ff58415e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44460/0 (socket says 172.21.15.19:44460) 2024-04-25T10:29:00.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.496+0000 7ff583400640 1 -- 172.21.15.19:0/323947089 learned_addr learned my addr 172.21.15.19:0/323947089 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.497+0000 7ff583400640 1 -- 172.21.15.19:0/323947089 >> v1:172.21.15.112:6789/0 conn(0x7ff5840cdde0 legacy=0x7ff584164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.497+0000 7ff583400640 1 -- 172.21.15.19:0/323947089 >> v1:172.21.15.19:6789/0 conn(0x7ff584073160 legacy=0x7ff58415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.497+0000 7ff583400640 1 -- 172.21.15.19:0/323947089 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5840c88e0 con 0x7ff58415b2c0 2024-04-25T10:29:00.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.498+0000 7ff583400640 1 --2- 172.21.15.19:0/323947089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff58415b2c0 0x7ff5840c9810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff574009870 tx=0x7ff57402a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def55d4f81b01cab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:00.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.498+0000 7ff582a00640 1 -- 172.21.15.19:0/323947089 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574037070 con 0x7ff58415b2c0 2024-04-25T10:29:00.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.498+0000 7ff582a00640 1 -- 172.21.15.19:0/323947089 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff574032640 con 0x7ff58415b2c0 2024-04-25T10:29:00.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.498+0000 7ff582a00640 1 -- 172.21.15.19:0/323947089 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574032a10 con 0x7ff58415b2c0 2024-04-25T10:29:00.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.499+0000 7ff58a200640 1 -- 172.21.15.19:0/323947089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff58415b2c0 msgr2=0x7ff5840c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.499+0000 7ff58a200640 1 --2- 172.21.15.19:0/323947089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff58415b2c0 0x7ff5840c9810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff574009870 tx=0x7ff57402a3c0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.499+0000 7ff58a200640 1 -- 172.21.15.19:0/323947089 shutdown_connections 2024-04-25T10:29:00.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.499+0000 7ff58a200640 1 --2- 172.21.15.19:0/323947089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff58415b2c0 0x7ff5840c9810 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.499+0000 7ff58a200640 1 -- 172.21.15.19:0/323947089 >> 172.21.15.19:0/323947089 conn(0x7ff58406f1f0 msgr2=0x7ff58406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:00.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.499+0000 7ff58a200640 1 -- 172.21.15.19:0/323947089 shutdown_connections 2024-04-25T10:29:00.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.499+0000 7ff58a200640 1 -- 172.21.15.19:0/323947089 wait complete. 2024-04-25T10:29:00.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.502+0000 7ff58a200640 1 Processor -- start 2024-04-25T10:29:00.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.502+0000 7ff58a200640 1 -- start start 2024-04-25T10:29:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.503+0000 7ff58a200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff584073160 0x7ff5840ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.503+0000 7ff58a200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5840cdde0 0x7ff5840cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.503+0000 7ff58a200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff58415c0f0 0x7ff584158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.503+0000 7ff58a200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff58406d4c0 con 0x7ff584073160 2024-04-25T10:29:00.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.503+0000 7ff58a200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff58415a580 con 0x7ff58415c0f0 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.503+0000 7ff58a200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff58415e930 con 0x7ff5840cdde0 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.504+0000 7ff583400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff584073160 0x7ff5840ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.504+0000 7ff583400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff584073160 0x7ff5840ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60336/0 (socket says 172.21.15.19:60336) 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.504+0000 7ff583400640 1 -- 172.21.15.19:0/2891740798 learned_addr learned my addr 172.21.15.19:0/2891740798 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.504+0000 7ff57be00640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5840cdde0 0x7ff5840cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.504+0000 7ff583e00640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff58415c0f0 0x7ff584158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.504+0000 7ff583400640 1 -- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5840cdde0 msgr2=0x7ff5840cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.504+0000 7ff583400640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5840cdde0 0x7ff5840cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.504+0000 7ff583400640 1 -- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff58415c0f0 msgr2=0x7ff584158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.504+0000 7ff583400640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff58415c0f0 0x7ff584158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.504+0000 7ff583400640 1 -- 172.21.15.19:0/2891740798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5840cd420 con 0x7ff584073160 2024-04-25T10:29:00.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.505+0000 7ff583400640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff584073160 0x7ff5840ccee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff574000c00 tx=0x7ff5740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:00.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.505+0000 7ff57b400640 1 -- 172.21.15.19:0/2891740798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574037040 con 0x7ff584073160 2024-04-25T10:29:00.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.505+0000 7ff57b400640 1 -- 172.21.15.19:0/2891740798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff574042070 con 0x7ff584073160 2024-04-25T10:29:00.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.505+0000 7ff57b400640 1 -- 172.21.15.19:0/2891740798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574030bd0 con 0x7ff584073160 2024-04-25T10:29:00.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.505+0000 7ff58a200640 1 -- 172.21.15.19:0/2891740798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5840cbe30 con 0x7ff584073160 2024-04-25T10:29:00.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.505+0000 7ff58a200640 1 -- 172.21.15.19:0/2891740798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5841f2a10 con 0x7ff584073160 2024-04-25T10:29:00.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.506+0000 7ff58a200640 1 -- 172.21.15.19:0/2891740798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff584076520 con 0x7ff584073160 2024-04-25T10:29:00.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.507+0000 7ff57b400640 1 -- 172.21.15.19:0/2891740798 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff574032500 con 0x7ff584073160 2024-04-25T10:29:00.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.509+0000 7ff57b400640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff5600744b0 0x7ff5600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:00.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.509+0000 7ff57b400640 1 -- 172.21.15.19:0/2891740798 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7ff5740b5fe0 con 0x7ff584073160 2024-04-25T10:29:00.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.509+0000 7ff57be00640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff5600744b0 0x7ff5600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:00.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.510+0000 7ff57be00640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff5600744b0 0x7ff5600769c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff584156360 tx=0x7ff56c000ed0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:00.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.514+0000 7ff57b400640 1 -- 172.21.15.19:0/2891740798 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff57407fd80 con 0x7ff584073160 2024-04-25T10:29:00.543 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:29:00.550 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:29:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.725+0000 7ff58a200640 1 -- 172.21.15.19:0/2891740798 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7ff584073a70 con 0x7ff5600744b0 2024-04-25T10:29:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.726+0000 7ff57b400640 1 -- 172.21.15.19:0/2891740798 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff584073a70 con 0x7ff5600744b0 2024-04-25T10:29:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T10:29:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 -- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff5600744b0 msgr2=0x7ff5600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff5600744b0 0x7ff5600769c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff584156360 tx=0x7ff56c000ed0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 -- 172.21.15.19:0/2891740798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff584073160 msgr2=0x7ff5840ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff584073160 0x7ff5840ccee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff574000c00 tx=0x7ff5740046c0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 -- 172.21.15.19:0/2891740798 shutdown_connections 2024-04-25T10:29:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff58415c0f0 0x7ff584158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff5600744b0 0x7ff5600769c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5840cdde0 0x7ff5840cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 --2- 172.21.15.19:0/2891740798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff584073160 0x7ff5840ccee0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 -- 172.21.15.19:0/2891740798 >> 172.21.15.19:0/2891740798 conn(0x7ff58406f1f0 msgr2=0x7ff5840b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 -- 172.21.15.19:0/2891740798 shutdown_connections 2024-04-25T10:29:00.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:00.729+0000 7ff58a200640 1 -- 172.21.15.19:0/2891740798 wait complete. 2024-04-25T10:29:00.758 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:29:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.044+0000 7fc713e00640 1 Processor -- start 2024-04-25T10:29:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.044+0000 7fc713e00640 1 -- start start 2024-04-25T10:29:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.046+0000 7fc713e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc714156410 0x7fc71415c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.046+0000 7fc713e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc71415c870 0x7fc714166cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.046+0000 7fc713e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7140c51b0 con 0x7fc7140c72e0 2024-04-25T10:29:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.046+0000 7fc713e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fc7140c86a0 con 0x7fc71415c870 2024-04-25T10:29:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc713e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc71406fa10 con 0x7fc714156410 2024-04-25T10:29:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc713400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc71415c870 0x7fc714166cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc712a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc7140c72e0 0x7fc7140cdad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:59962/0 (socket says 172.21.15.19:59962) 2024-04-25T10:29:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc712a00640 1 -- 172.21.15.19:0/559265195 learned_addr learned my addr 172.21.15.19:0/559265195 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:29:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc712000640 1 --2- 172.21.15.19:0/559265195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc714156410 0x7fc71415c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc711600640 1 -- 172.21.15.19:0/559265195 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289979187 0 0) 0x7fc7140c51b0 con 0x7fc7140c72e0 2024-04-25T10:29:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc711600640 1 -- 172.21.15.19:0/559265195 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6f8003520 con 0x7fc7140c72e0 2024-04-25T10:29:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc713400640 1 -- 172.21.15.19:0/559265195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc714156410 msgr2=0x7fc71415c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:29:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc713400640 1 --2- 172.21.15.19:0/559265195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc714156410 0x7fc71415c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc713400640 1 -- 172.21.15.19:0/559265195 >> v1:172.21.15.112:6789/0 conn(0x7fc7140c72e0 legacy=0x7fc7140cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc713400640 1 -- 172.21.15.19:0/559265195 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71406fc60 con 0x7fc71415c870 2024-04-25T10:29:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.047+0000 7fc712000640 1 --2- 172.21.15.19:0/559265195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc714156410 0x7fc71415c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.049+0000 7fc713400640 1 --2- 172.21.15.19:0/559265195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71415c870 0x7fc714166cb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009d90 tx=0x7fc70c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b32b3896e87f1db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.049+0000 7fc711600640 1 -- 172.21.15.19:0/559265195 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c031600 con 0x7fc71415c870 2024-04-25T10:29:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.049+0000 7fc711600640 1 -- 172.21.15.19:0/559265195 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c0317a0 con 0x7fc71415c870 2024-04-25T10:29:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.049+0000 7fc711600640 1 -- 172.21.15.19:0/559265195 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c031b50 con 0x7fc71415c870 2024-04-25T10:29:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.050+0000 7fc713e00640 1 -- 172.21.15.19:0/559265195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71415c870 msgr2=0x7fc714166cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.050+0000 7fc713e00640 1 --2- 172.21.15.19:0/559265195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71415c870 0x7fc714166cb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009d90 tx=0x7fc70c02a5d0 comp rx=0 tx=0).stop 2024-04-25T10:29:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.050+0000 7fc713e00640 1 -- 172.21.15.19:0/559265195 shutdown_connections 2024-04-25T10:29:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.050+0000 7fc713e00640 1 --2- 172.21.15.19:0/559265195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71415c870 0x7fc714166cb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.050+0000 7fc713e00640 1 --2- 172.21.15.19:0/559265195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc714156410 0x7fc71415c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.050+0000 7fc713e00640 1 -- 172.21.15.19:0/559265195 >> 172.21.15.19:0/559265195 conn(0x7fc71406c7a0 msgr2=0x7fc71406cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.050+0000 7fc713e00640 1 -- 172.21.15.19:0/559265195 shutdown_connections 2024-04-25T10:29:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.050+0000 7fc713e00640 1 -- 172.21.15.19:0/559265195 wait complete. 2024-04-25T10:29:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.052+0000 7fc713e00640 1 Processor -- start 2024-04-25T10:29:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.052+0000 7fc713e00640 1 -- start start 2024-04-25T10:29:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.054+0000 7fc713e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7140c72e0 0x7fc7141f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.054+0000 7fc713e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc714156410 0x7fc7141e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.054+0000 7fc713e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71415c870 0x7fc71415f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.054+0000 7fc713e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc7140702b0 con 0x7fc714156410 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.054+0000 7fc713e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc7140c8330 con 0x7fc71415c870 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.054+0000 7fc713e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc71415cc80 con 0x7fc7140c72e0 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.054+0000 7fc712000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc714156410 0x7fc7141e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.054+0000 7fc712000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc714156410 0x7fc7141e6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60354/0 (socket says 172.21.15.19:60354) 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.054+0000 7fc712000640 1 -- 172.21.15.19:0/3702959085 learned_addr learned my addr 172.21.15.19:0/3702959085 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.054+0000 7fc712a00640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7140c72e0 0x7fc7141f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.054+0000 7fc713400640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71415c870 0x7fc71415f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.055+0000 7fc712000640 1 -- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7140c72e0 msgr2=0x7fc7141f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.055+0000 7fc712000640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7140c72e0 0x7fc7141f2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.055+0000 7fc712000640 1 -- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71415c870 msgr2=0x7fc71415f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.055+0000 7fc712000640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71415c870 0x7fc71415f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.055+0000 7fc712000640 1 -- 172.21.15.19:0/3702959085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7141f34d0 con 0x7fc714156410 2024-04-25T10:29:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.055+0000 7fc712000640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc714156410 0x7fc7141e6f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc70000e930 tx=0x7fc70000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.055+0000 7fc70aa00640 1 -- 172.21.15.19:0/3702959085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700017070 con 0x7fc714156410 2024-04-25T10:29:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.055+0000 7fc70aa00640 1 -- 172.21.15.19:0/3702959085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70000ca00 con 0x7fc714156410 2024-04-25T10:29:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.055+0000 7fc713e00640 1 -- 172.21.15.19:0/3702959085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7141e7440 con 0x7fc714156410 2024-04-25T10:29:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.055+0000 7fc70aa00640 1 -- 172.21.15.19:0/3702959085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70000cdf0 con 0x7fc714156410 2024-04-25T10:29:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.056+0000 7fc713e00640 1 -- 172.21.15.19:0/3702959085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71415dc50 con 0x7fc714156410 2024-04-25T10:29:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.057+0000 7fc713e00640 1 -- 172.21.15.19:0/3702959085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71415d6e0 con 0x7fc714156410 2024-04-25T10:29:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.058+0000 7fc70aa00640 1 -- 172.21.15.19:0/3702959085 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc70001a070 con 0x7fc714156410 2024-04-25T10:29:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.059+0000 7fc70aa00640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6f40744e0 0x7fc6f40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.059+0000 7fc70aa00640 1 -- 172.21.15.19:0/3702959085 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7fc700094f40 con 0x7fc714156410 2024-04-25T10:29:01.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.060+0000 7fc712a00640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6f40744e0 0x7fc6f40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:01.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.060+0000 7fc712a00640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6f40744e0 0x7fc6f40769f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc7040011e0 tx=0x7fc704007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:01.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.064+0000 7fc70aa00640 1 -- 172.21.15.19:0/3702959085 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc70005edd0 con 0x7fc714156410 2024-04-25T10:29:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.270+0000 7fc713e00640 1 -- 172.21.15.19:0/3702959085 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7140c51b0 con 0x7fc6f40744e0 2024-04-25T10:29:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.280+0000 7fc70aa00640 1 -- 172.21.15.19:0/3702959085 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+329637 (secure 0 0 0) 0x7fc7140c51b0 con 0x7fc6f40744e0 2024-04-25T10:29:01.289 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:29:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:29:01.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.285+0000 7fc713e00640 1 -- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6f40744e0 msgr2=0x7fc6f40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.285+0000 7fc713e00640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6f40744e0 0x7fc6f40769f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc7040011e0 tx=0x7fc704007d30 comp rx=0 tx=0).stop 2024-04-25T10:29:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.285+0000 7fc713e00640 1 -- 172.21.15.19:0/3702959085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc714156410 msgr2=0x7fc7141e6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.285+0000 7fc713e00640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc714156410 0x7fc7141e6f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc70000e930 tx=0x7fc70000edf0 comp rx=0 tx=0).stop 2024-04-25T10:29:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.285+0000 7fc713e00640 1 -- 172.21.15.19:0/3702959085 shutdown_connections 2024-04-25T10:29:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.285+0000 7fc713e00640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc71415c870 0x7fc71415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.285+0000 7fc713e00640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc714156410 0x7fc7141e6f00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.285+0000 7fc713e00640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fc6f40744e0 0x7fc6f40769f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.285+0000 7fc713e00640 1 --2- 172.21.15.19:0/3702959085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7140c72e0 0x7fc7141f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.285+0000 7fc713e00640 1 -- 172.21.15.19:0/3702959085 >> 172.21.15.19:0/3702959085 conn(0x7fc71406c7a0 msgr2=0x7fc7141515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.285+0000 7fc713e00640 1 -- 172.21.15.19:0/3702959085 shutdown_connections 2024-04-25T10:29:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:01.286+0000 7fc713e00640 1 -- 172.21.15.19:0/3702959085 wait complete. 2024-04-25T10:29:01.311 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-04-25T10:29:00.635914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":631669,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":273,"num_write_kb":1729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":745,"ondisk_log_size":745,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219792,"kb_used_data":3664,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754928,"statfs":{"total":773094113280,"available":772869046272,"internally_reserved":0,"allocated":3751936,"data_stored":2230378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20253,"num_objects":0,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":25,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002935"},"pg_stats":[{"pgid":"2.1f","version":"27'10","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.737647+0000","last_change":"2024-04-25T10:25:36.182605+0000","last_active":"2024-04-25T10:28:07.737647+0000","last_peered":"2024-04-25T10:28:07.737647+0000","last_clean":"2024-04-25T10:28:07.737647+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:28:07.737647+0000","last_undegraded":"2024-04-25T10:28:07.737647+0000","last_fullsized":"2024-04-25T10:28:07.737647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.992887+0000","last_change":"2024-04-25T10:25:37.199467+0000","last_active":"2024-04-25T10:28:49.992887+0000","last_peered":"2024-04-25T10:28:49.992887+0000","last_clean":"2024-04-25T10:28:49.992887+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:28:49.992887+0000","last_undegraded":"2024-04-25T10:28:49.992887+0000","last_fullsized":"2024-04-25T10:28:49.992887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426008+0000","last_change":"2024-04-25T10:25:41.234657+0000","last_active":"2024-04-25T10:27:42.426008+0000","last_peered":"2024-04-25T10:27:42.426008+0000","last_clean":"2024-04-25T10:27:42.426008+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:27:42.426008+0000","last_undegraded":"2024-04-25T10:27:42.426008+0000","last_fullsized":"2024-04-25T10:27:42.426008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:56.869031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:47.432958+0000","last_change":"2024-04-25T10:25:36.166548+0000","last_active":"2024-04-25T10:27:47.432958+0000","last_peered":"2024-04-25T10:27:47.432958+0000","last_clean":"2024-04-25T10:27:47.432958+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:27:47.432958+0000","last_undegraded":"2024-04-25T10:27:47.432958+0000","last_fullsized":"2024-04-25T10:27:47.432958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.002210+0000","last_change":"2024-04-25T10:25:37.179746+0000","last_active":"2024-04-25T10:28:50.002210+0000","last_peered":"2024-04-25T10:28:50.002210+0000","last_clean":"2024-04-25T10:28:50.002210+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:28:50.002210+0000","last_undegraded":"2024-04-25T10:28:50.002210+0000","last_fullsized":"2024-04-25T10:28:50.002210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:09.669468+0000","last_change":"2024-04-25T10:25:41.232828+0000","last_active":"2024-04-25T10:28:09.669468+0000","last_peered":"2024-04-25T10:28:09.669468+0000","last_clean":"2024-04-25T10:28:09.669468+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:28:09.669468+0000","last_undegraded":"2024-04-25T10:28:09.669468+0000","last_fullsized":"2024-04-25T10:28:09.669468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.494332+0000","last_change":"2024-04-25T10:25:36.190035+0000","last_active":"2024-04-25T10:28:46.494332+0000","last_peered":"2024-04-25T10:28:46.494332+0000","last_clean":"2024-04-25T10:28:46.494332+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:28:46.494332+0000","last_undegraded":"2024-04-25T10:28:46.494332+0000","last_fullsized":"2024-04-25T10:28:46.494332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":7,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.513766+0000","last_change":"2024-04-25T10:28:59.513833+0000","last_active":"2024-04-25T10:28:59.513766+0000","last_peered":"2024-04-25T10:28:59.513766+0000","last_clean":"2024-04-25T10:28:59.513766+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:28:59.513766+0000","last_undegraded":"2024-04-25T10:28:59.513766+0000","last_fullsized":"2024-04-25T10:28:59.513766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:28:59.513540+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:28:59.513540+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.513540+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:44.778177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:14.670131+0000","last_change":"2024-04-25T10:25:41.242444+0000","last_active":"2024-04-25T10:28:14.670131+0000","last_peered":"2024-04-25T10:28:14.670131+0000","last_clean":"2024-04-25T10:28:14.670131+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:28:14.670131+0000","last_undegraded":"2024-04-25T10:28:14.670131+0000","last_fullsized":"2024-04-25T10:28:14.670131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:09.656018+0000","last_change":"2024-04-25T10:25:36.190527+0000","last_active":"2024-04-25T10:28:09.656018+0000","last_peered":"2024-04-25T10:28:09.656018+0000","last_clean":"2024-04-25T10:28:09.656018+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:28:09.656018+0000","last_undegraded":"2024-04-25T10:28:09.656018+0000","last_fullsized":"2024-04-25T10:28:09.656018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.024944+0000","last_change":"2024-04-25T10:25:37.204468+0000","last_active":"2024-04-25T10:28:50.024944+0000","last_peered":"2024-04-25T10:28:50.024944+0000","last_clean":"2024-04-25T10:28:50.024944+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:28:50.024944+0000","last_undegraded":"2024-04-25T10:28:50.024944+0000","last_fullsized":"2024-04-25T10:28:50.024944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:14.670094+0000","last_change":"2024-04-25T10:25:41.236518+0000","last_active":"2024-04-25T10:28:14.670094+0000","last_peered":"2024-04-25T10:28:14.670094+0000","last_clean":"2024-04-25T10:28:14.670094+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:28:14.670094+0000","last_undegraded":"2024-04-25T10:28:14.670094+0000","last_fullsized":"2024-04-25T10:28:14.670094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.247590+0000","last_change":"2024-04-25T10:28:57.247636+0000","last_active":"2024-04-25T10:28:57.247590+0000","last_peered":"2024-04-25T10:28:57.247590+0000","last_clean":"2024-04-25T10:28:57.247590+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:28:57.247590+0000","last_undegraded":"2024-04-25T10:28:57.247590+0000","last_fullsized":"2024-04-25T10:28:57.247590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:28:57.247441+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:28:57.247441+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.247441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:39.593764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.494636+0000","last_change":"2024-04-25T10:25:36.188266+0000","last_active":"2024-04-25T10:28:46.494636+0000","last_peered":"2024-04-25T10:28:46.494636+0000","last_clean":"2024-04-25T10:28:46.494636+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:28:46.494636+0000","last_undegraded":"2024-04-25T10:28:46.494636+0000","last_fullsized":"2024-04-25T10:28:46.494636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.658151+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:27:59.658151+0000","last_peered":"2024-04-25T10:27:59.658151+0000","last_clean":"2024-04-25T10:27:59.658151+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:27:59.658151+0000","last_undegraded":"2024-04-25T10:27:59.658151+0000","last_fullsized":"2024-04-25T10:27:59.658151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.956477+0000","last_change":"2024-04-25T10:25:37.166002+0000","last_active":"2024-04-25T10:28:49.956477+0000","last_peered":"2024-04-25T10:28:49.956477+0000","last_clean":"2024-04-25T10:28:49.956477+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:28:49.956477+0000","last_undegraded":"2024-04-25T10:28:49.956477+0000","last_fullsized":"2024-04-25T10:28:49.956477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:41.783046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279806+0000","last_change":"2024-04-25T10:25:36.168204+0000","last_active":"2024-04-25T10:27:43.279806+0000","last_peered":"2024-04-25T10:27:43.279806+0000","last_clean":"2024-04-25T10:27:43.279806+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:27:43.279806+0000","last_undegraded":"2024-04-25T10:27:43.279806+0000","last_fullsized":"2024-04-25T10:27:43.279806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:55.907635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.654134+0000","last_change":"2024-04-25T10:25:41.257264+0000","last_active":"2024-04-25T10:27:59.654134+0000","last_peered":"2024-04-25T10:27:59.654134+0000","last_clean":"2024-04-25T10:27:59.654134+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:27:59.654134+0000","last_undegraded":"2024-04-25T10:27:59.654134+0000","last_fullsized":"2024-04-25T10:27:59.654134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.971670+0000","last_change":"2024-04-25T10:25:37.158884+0000","last_active":"2024-04-25T10:28:49.971670+0000","last_peered":"2024-04-25T10:28:49.971670+0000","last_clean":"2024-04-25T10:28:49.971670+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:28:49.971670+0000","last_undegraded":"2024-04-25T10:28:49.971670+0000","last_fullsized":"2024-04-25T10:28:49.971670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:49.638142+0000","last_change":"2024-04-25T10:25:36.173499+0000","last_active":"2024-04-25T10:27:49.638142+0000","last_peered":"2024-04-25T10:27:49.638142+0000","last_clean":"2024-04-25T10:27:49.638142+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:27:49.638142+0000","last_undegraded":"2024-04-25T10:27:49.638142+0000","last_fullsized":"2024-04-25T10:27:49.638142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426750+0000","last_change":"2024-04-25T10:25:41.239990+0000","last_active":"2024-04-25T10:27:42.426750+0000","last_peered":"2024-04-25T10:27:42.426750+0000","last_clean":"2024-04-25T10:27:42.426750+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:27:42.426750+0000","last_undegraded":"2024-04-25T10:27:42.426750+0000","last_fullsized":"2024-04-25T10:27:42.426750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:15.055786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.268007+0000","last_change":"2024-04-25T10:28:58.268085+0000","last_active":"2024-04-25T10:28:58.268007+0000","last_peered":"2024-04-25T10:28:58.268007+0000","last_clean":"2024-04-25T10:28:58.268007+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:28:58.268007+0000","last_undegraded":"2024-04-25T10:28:58.268007+0000","last_fullsized":"2024-04-25T10:28:58.268007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:28:58.267794+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:28:58.267794+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.267794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:31.648763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:56.689813+0000","last_change":"2024-04-25T10:28:56.689855+0000","last_active":"2024-04-25T10:28:56.689813+0000","last_peered":"2024-04-25T10:28:56.689813+0000","last_clean":"2024-04-25T10:28:56.689813+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:28:56.689813+0000","last_undegraded":"2024-04-25T10:28:56.689813+0000","last_fullsized":"2024-04-25T10:28:56.689813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:28:56.689703+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:28:56.689703+0000","last_clean_scrub_stamp":"2024-04-25T10:28:56.689703+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:04.893320+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.667344+0000","last_change":"2024-04-25T10:25:41.262158+0000","last_active":"2024-04-25T10:27:59.667344+0000","last_peered":"2024-04-25T10:27:59.667344+0000","last_clean":"2024-04-25T10:27:59.667344+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:27:59.667344+0000","last_undegraded":"2024-04-25T10:27:59.667344+0000","last_fullsized":"2024-04-25T10:27:59.667344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.971890+0000","last_change":"2024-04-25T10:25:37.159876+0000","last_active":"2024-04-25T10:28:49.971890+0000","last_peered":"2024-04-25T10:28:49.971890+0000","last_clean":"2024-04-25T10:28:49.971890+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:28:49.971890+0000","last_undegraded":"2024-04-25T10:28:49.971890+0000","last_fullsized":"2024-04-25T10:28:49.971890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.503893+0000","last_change":"2024-04-25T10:25:36.194275+0000","last_active":"2024-04-25T10:28:50.503893+0000","last_peered":"2024-04-25T10:28:50.503893+0000","last_clean":"2024-04-25T10:28:50.503893+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:28:50.503893+0000","last_undegraded":"2024-04-25T10:28:50.503893+0000","last_fullsized":"2024-04-25T10:28:50.503893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:49.665245+0000","last_change":"2024-04-25T10:25:41.261185+0000","last_active":"2024-04-25T10:27:49.665245+0000","last_peered":"2024-04-25T10:27:49.665245+0000","last_clean":"2024-04-25T10:27:49.665245+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:27:49.665245+0000","last_undegraded":"2024-04-25T10:27:49.665245+0000","last_fullsized":"2024-04-25T10:27:49.665245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.968591+0000","last_change":"2024-04-25T10:25:37.165436+0000","last_active":"2024-04-25T10:28:49.968591+0000","last_peered":"2024-04-25T10:28:49.968591+0000","last_clean":"2024-04-25T10:28:49.968591+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:28:49.968591+0000","last_undegraded":"2024-04-25T10:28:49.968591+0000","last_fullsized":"2024-04-25T10:28:49.968591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'12","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.261345+0000","last_change":"2024-04-25T10:25:36.181966+0000","last_active":"2024-04-25T10:28:50.261345+0000","last_peered":"2024-04-25T10:28:50.261345+0000","last_clean":"2024-04-25T10:28:50.261345+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:28:50.261345+0000","last_undegraded":"2024-04-25T10:28:50.261345+0000","last_fullsized":"2024-04-25T10:28:50.261345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:44.637446+0000","last_change":"2024-04-25T10:25:41.246715+0000","last_active":"2024-04-25T10:27:44.637446+0000","last_peered":"2024-04-25T10:27:44.637446+0000","last_clean":"2024-04-25T10:27:44.637446+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:27:44.637446+0000","last_undegraded":"2024-04-25T10:27:44.637446+0000","last_fullsized":"2024-04-25T10:27:44.637446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.966169+0000","last_change":"2024-04-25T10:25:37.170738+0000","last_active":"2024-04-25T10:28:49.966169+0000","last_peered":"2024-04-25T10:28:49.966169+0000","last_clean":"2024-04-25T10:28:49.966169+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:28:49.966169+0000","last_undegraded":"2024-04-25T10:28:49.966169+0000","last_fullsized":"2024-04-25T10:28:49.966169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:43.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:44.654687+0000","last_change":"2024-04-25T10:25:36.186052+0000","last_active":"2024-04-25T10:27:44.654687+0000","last_peered":"2024-04-25T10:27:44.654687+0000","last_clean":"2024-04-25T10:27:44.654687+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:27:44.654687+0000","last_undegraded":"2024-04-25T10:27:44.654687+0000","last_fullsized":"2024-04-25T10:27:44.654687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279843+0000","last_change":"2024-04-25T10:25:41.244909+0000","last_active":"2024-04-25T10:27:43.279843+0000","last_peered":"2024-04-25T10:27:43.279843+0000","last_clean":"2024-04-25T10:27:43.279843+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:27:43.279843+0000","last_undegraded":"2024-04-25T10:27:43.279843+0000","last_fullsized":"2024-04-25T10:27:43.279843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:48.008560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.321741+0000","last_change":"2024-04-25T10:28:58.321787+0000","last_active":"2024-04-25T10:28:58.321741+0000","last_peered":"2024-04-25T10:28:58.321741+0000","last_clean":"2024-04-25T10:28:58.321741+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:28:58.321741+0000","last_undegraded":"2024-04-25T10:28:58.321741+0000","last_fullsized":"2024-04-25T10:28:58.321741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:28:58.321649+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:28:58.321649+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.321649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:22.455633+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:44.637590+0000","last_change":"2024-04-25T10:25:36.166395+0000","last_active":"2024-04-25T10:27:44.637590+0000","last_peered":"2024-04-25T10:27:44.637590+0000","last_clean":"2024-04-25T10:27:44.637590+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:27:44.637590+0000","last_undegraded":"2024-04-25T10:27:44.637590+0000","last_fullsized":"2024-04-25T10:27:44.637590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.279527+0000","last_change":"2024-04-25T10:25:41.237175+0000","last_active":"2024-04-25T10:27:43.279527+0000","last_peered":"2024-04-25T10:27:43.279527+0000","last_clean":"2024-04-25T10:27:43.279527+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:27:43.279527+0000","last_undegraded":"2024-04-25T10:27:43.279527+0000","last_fullsized":"2024-04-25T10:27:43.279527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:18.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.019578+0000","last_change":"2024-04-25T10:25:37.192638+0000","last_active":"2024-04-25T10:28:50.019578+0000","last_peered":"2024-04-25T10:28:50.019578+0000","last_clean":"2024-04-25T10:28:50.019578+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:28:50.019578+0000","last_undegraded":"2024-04-25T10:28:50.019578+0000","last_fullsized":"2024-04-25T10:28:50.019578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:47.434445+0000","last_change":"2024-04-25T10:25:36.182126+0000","last_active":"2024-04-25T10:27:47.434445+0000","last_peered":"2024-04-25T10:27:47.434445+0000","last_clean":"2024-04-25T10:27:47.434445+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:27:47.434445+0000","last_undegraded":"2024-04-25T10:27:47.434445+0000","last_fullsized":"2024-04-25T10:27:47.434445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280453+0000","last_change":"2024-04-25T10:25:41.247504+0000","last_active":"2024-04-25T10:27:43.280453+0000","last_peered":"2024-04-25T10:27:43.280453+0000","last_clean":"2024-04-25T10:27:43.280453+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:27:43.280453+0000","last_undegraded":"2024-04-25T10:27:43.280453+0000","last_fullsized":"2024-04-25T10:27:43.280453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.315039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.971292+0000","last_change":"2024-04-25T10:25:37.171962+0000","last_active":"2024-04-25T10:28:49.971292+0000","last_peered":"2024-04-25T10:28:49.971292+0000","last_clean":"2024-04-25T10:28:49.971292+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:28:49.971292+0000","last_undegraded":"2024-04-25T10:28:49.971292+0000","last_fullsized":"2024-04-25T10:28:49.971292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.500349+0000","last_change":"2024-04-25T10:25:36.167914+0000","last_active":"2024-04-25T10:28:50.500349+0000","last_peered":"2024-04-25T10:28:50.500349+0000","last_clean":"2024-04-25T10:28:50.500349+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:28:50.500349+0000","last_undegraded":"2024-04-25T10:28:50.500349+0000","last_fullsized":"2024-04-25T10:28:50.500349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:15.593834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.281110+0000","last_change":"2024-04-25T10:25:41.250414+0000","last_active":"2024-04-25T10:27:43.281110+0000","last_peered":"2024-04-25T10:27:43.281110+0000","last_clean":"2024-04-25T10:27:43.281110+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:27:43.281110+0000","last_undegraded":"2024-04-25T10:27:43.281110+0000","last_fullsized":"2024-04-25T10:27:43.281110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:08.000869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.984097+0000","last_change":"2024-04-25T10:25:37.179610+0000","last_active":"2024-04-25T10:28:49.984097+0000","last_peered":"2024-04-25T10:28:49.984097+0000","last_clean":"2024-04-25T10:28:49.984097+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:28:49.984097+0000","last_undegraded":"2024-04-25T10:28:49.984097+0000","last_fullsized":"2024-04-25T10:28:49.984097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:22.862181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.733826+0000","last_change":"2024-04-25T10:25:36.187683+0000","last_active":"2024-04-25T10:28:07.733826+0000","last_peered":"2024-04-25T10:28:07.733826+0000","last_clean":"2024-04-25T10:28:07.733826+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:28:07.733826+0000","last_undegraded":"2024-04-25T10:28:07.733826+0000","last_fullsized":"2024-04-25T10:28:07.733826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.638990+0000","last_change":"2024-04-25T10:25:41.239687+0000","last_active":"2024-04-25T10:27:54.638990+0000","last_peered":"2024-04-25T10:27:54.638990+0000","last_clean":"2024-04-25T10:27:54.638990+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:27:54.638990+0000","last_undegraded":"2024-04-25T10:27:54.638990+0000","last_fullsized":"2024-04-25T10:27:54.638990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.694903+0000","last_change":"2024-04-25T10:28:58.694935+0000","last_active":"2024-04-25T10:28:58.694903+0000","last_peered":"2024-04-25T10:28:58.694903+0000","last_clean":"2024-04-25T10:28:58.694903+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:28:58.694903+0000","last_undegraded":"2024-04-25T10:28:58.694903+0000","last_fullsized":"2024-04-25T10:28:58.694903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:28:58.694754+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:28:58.694754+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.694754+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:57.595631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:47.428448+0000","last_change":"2024-04-25T10:25:36.186586+0000","last_active":"2024-04-25T10:27:47.428448+0000","last_peered":"2024-04-25T10:27:47.428448+0000","last_clean":"2024-04-25T10:27:47.428448+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:27:47.428448+0000","last_undegraded":"2024-04-25T10:27:47.428448+0000","last_fullsized":"2024-04-25T10:27:47.428448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:55.578556+0000","last_change":"2024-04-25T10:28:55.578640+0000","last_active":"2024-04-25T10:28:55.578556+0000","last_peered":"2024-04-25T10:28:55.578556+0000","last_clean":"2024-04-25T10:28:55.578556+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:28:55.578556+0000","last_undegraded":"2024-04-25T10:28:55.578556+0000","last_fullsized":"2024-04-25T10:28:55.578556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-04-25T10:28:55.578322+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-04-25T10:28:55.578322+0000","last_clean_scrub_stamp":"2024-04-25T10:28:55.578322+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:49.614946+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:49.655801+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:27:49.655801+0000","last_peered":"2024-04-25T10:27:49.655801+0000","last_clean":"2024-04-25T10:27:49.655801+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:27:49.655801+0000","last_undegraded":"2024-04-25T10:27:49.655801+0000","last_fullsized":"2024-04-25T10:27:49.655801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.013958+0000","last_change":"2024-04-25T10:25:37.187670+0000","last_active":"2024-04-25T10:28:50.013958+0000","last_peered":"2024-04-25T10:28:50.013958+0000","last_clean":"2024-04-25T10:28:50.013958+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:28:50.013958+0000","last_undegraded":"2024-04-25T10:28:50.013958+0000","last_fullsized":"2024-04-25T10:28:50.013958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.729957+0000","last_change":"2024-04-25T10:25:36.190434+0000","last_active":"2024-04-25T10:28:07.729957+0000","last_peered":"2024-04-25T10:28:07.729957+0000","last_clean":"2024-04-25T10:28:07.729957+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:28:07.729957+0000","last_undegraded":"2024-04-25T10:28:07.729957+0000","last_fullsized":"2024-04-25T10:28:07.729957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.666195+0000","last_change":"2024-04-25T10:25:41.249210+0000","last_active":"2024-04-25T10:27:54.666195+0000","last_peered":"2024-04-25T10:27:54.666195+0000","last_clean":"2024-04-25T10:27:54.666195+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:27:54.666195+0000","last_undegraded":"2024-04-25T10:27:54.666195+0000","last_fullsized":"2024-04-25T10:27:54.666195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:55.642149+0000","last_change":"2024-04-25T10:28:55.642284+0000","last_active":"2024-04-25T10:28:55.642149+0000","last_peered":"2024-04-25T10:28:55.642149+0000","last_clean":"2024-04-25T10:28:55.642149+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:28:55.642149+0000","last_undegraded":"2024-04-25T10:28:55.642149+0000","last_fullsized":"2024-04-25T10:28:55.642149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:28:55.641849+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:28:55.641849+0000","last_clean_scrub_stamp":"2024-04-25T10:28:55.641849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:06.649856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.638968+0000","last_change":"2024-04-25T10:25:36.175833+0000","last_active":"2024-04-25T10:27:54.638968+0000","last_peered":"2024-04-25T10:27:54.638968+0000","last_clean":"2024-04-25T10:27:54.638968+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:27:54.638968+0000","last_undegraded":"2024-04-25T10:27:54.638968+0000","last_fullsized":"2024-04-25T10:27:54.638968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.639638+0000","last_change":"2024-04-25T10:25:41.256600+0000","last_active":"2024-04-25T10:27:59.639638+0000","last_peered":"2024-04-25T10:27:59.639638+0000","last_clean":"2024-04-25T10:27:59.639638+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:27:59.639638+0000","last_undegraded":"2024-04-25T10:27:59.639638+0000","last_fullsized":"2024-04-25T10:27:59.639638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:54.624310+0000","last_change":"2024-04-25T10:28:54.624376+0000","last_active":"2024-04-25T10:28:54.624310+0000","last_peered":"2024-04-25T10:28:54.624310+0000","last_clean":"2024-04-25T10:28:54.624310+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:28:54.624310+0000","last_undegraded":"2024-04-25T10:28:54.624310+0000","last_fullsized":"2024-04-25T10:28:54.624310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:28:54.624108+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:28:54.624108+0000","last_clean_scrub_stamp":"2024-04-25T10:28:54.624108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.524986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.638897+0000","last_change":"2024-04-25T10:25:36.168542+0000","last_active":"2024-04-25T10:27:54.638897+0000","last_peered":"2024-04-25T10:27:54.638897+0000","last_clean":"2024-04-25T10:27:54.638897+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:27:54.638897+0000","last_undegraded":"2024-04-25T10:27:54.638897+0000","last_fullsized":"2024-04-25T10:27:54.638897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.656741+0000","last_change":"2024-04-25T10:25:41.242053+0000","last_active":"2024-04-25T10:27:54.656741+0000","last_peered":"2024-04-25T10:27:54.656741+0000","last_clean":"2024-04-25T10:27:54.656741+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:27:54.656741+0000","last_undegraded":"2024-04-25T10:27:54.656741+0000","last_fullsized":"2024-04-25T10:27:54.656741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.025053+0000","last_change":"2024-04-25T10:25:37.198952+0000","last_active":"2024-04-25T10:28:50.025053+0000","last_peered":"2024-04-25T10:28:50.025053+0000","last_clean":"2024-04-25T10:28:50.025053+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:28:50.025053+0000","last_undegraded":"2024-04-25T10:28:50.025053+0000","last_fullsized":"2024-04-25T10:28:50.025053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.683375+0000","last_change":"2024-04-25T10:28:57.683452+0000","last_active":"2024-04-25T10:28:57.683375+0000","last_peered":"2024-04-25T10:28:57.683375+0000","last_clean":"2024-04-25T10:28:57.683375+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:28:57.683375+0000","last_undegraded":"2024-04-25T10:28:57.683375+0000","last_fullsized":"2024-04-25T10:28:57.683375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:28:57.683180+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:28:57.683180+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.683180+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:27.929746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:54.653864+0000","last_change":"2024-04-25T10:25:41.251379+0000","last_active":"2024-04-25T10:27:54.653864+0000","last_peered":"2024-04-25T10:27:54.653864+0000","last_clean":"2024-04-25T10:27:54.653864+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:27:54.653864+0000","last_undegraded":"2024-04-25T10:27:54.653864+0000","last_fullsized":"2024-04-25T10:27:54.653864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.018287+0000","last_change":"2024-04-25T10:25:37.202390+0000","last_active":"2024-04-25T10:28:50.018287+0000","last_peered":"2024-04-25T10:28:50.018287+0000","last_clean":"2024-04-25T10:28:50.018287+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:28:50.018287+0000","last_undegraded":"2024-04-25T10:28:50.018287+0000","last_fullsized":"2024-04-25T10:28:50.018287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.502492+0000","last_change":"2024-04-25T10:25:36.154879+0000","last_active":"2024-04-25T10:28:50.502492+0000","last_peered":"2024-04-25T10:28:50.502492+0000","last_clean":"2024-04-25T10:28:50.502492+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:28:50.502492+0000","last_undegraded":"2024-04-25T10:28:50.502492+0000","last_fullsized":"2024-04-25T10:28:50.502492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:09.641108+0000","last_change":"2024-04-25T10:25:41.239631+0000","last_active":"2024-04-25T10:28:09.641108+0000","last_peered":"2024-04-25T10:28:09.641108+0000","last_clean":"2024-04-25T10:28:09.641108+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:28:09.641108+0000","last_undegraded":"2024-04-25T10:28:09.641108+0000","last_fullsized":"2024-04-25T10:28:09.641108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.569372+0000","last_change":"2024-04-25T10:28:57.569425+0000","last_active":"2024-04-25T10:28:57.569372+0000","last_peered":"2024-04-25T10:28:57.569372+0000","last_clean":"2024-04-25T10:28:57.569372+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:28:57.569372+0000","last_undegraded":"2024-04-25T10:28:57.569372+0000","last_fullsized":"2024-04-25T10:28:57.569372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:28:57.569233+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:28:57.569233+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.569233+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:26.337773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.654074+0000","last_change":"2024-04-25T10:25:36.192797+0000","last_active":"2024-04-25T10:27:59.654074+0000","last_peered":"2024-04-25T10:27:59.654074+0000","last_clean":"2024-04-25T10:27:59.654074+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:27:59.654074+0000","last_undegraded":"2024-04-25T10:27:59.654074+0000","last_fullsized":"2024-04-25T10:27:59.654074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:09.641140+0000","last_change":"2024-04-25T10:25:41.244618+0000","last_active":"2024-04-25T10:28:09.641140+0000","last_peered":"2024-04-25T10:28:09.641140+0000","last_clean":"2024-04-25T10:28:09.641140+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:28:09.641140+0000","last_undegraded":"2024-04-25T10:28:09.641140+0000","last_fullsized":"2024-04-25T10:28:09.641140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.025748+0000","last_change":"2024-04-25T10:25:37.208984+0000","last_active":"2024-04-25T10:28:50.025748+0000","last_peered":"2024-04-25T10:28:50.025748+0000","last_clean":"2024-04-25T10:28:50.025748+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:28:50.025748+0000","last_undegraded":"2024-04-25T10:28:50.025748+0000","last_fullsized":"2024-04-25T10:28:50.025748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.504791+0000","last_change":"2024-04-25T10:25:36.185689+0000","last_active":"2024-04-25T10:28:46.504791+0000","last_peered":"2024-04-25T10:28:46.504791+0000","last_clean":"2024-04-25T10:28:46.504791+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:28:46.504791+0000","last_undegraded":"2024-04-25T10:28:46.504791+0000","last_fullsized":"2024-04-25T10:28:46.504791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:43.280314+0000","last_change":"2024-04-25T10:25:41.247314+0000","last_active":"2024-04-25T10:27:43.280314+0000","last_peered":"2024-04-25T10:27:43.280314+0000","last_clean":"2024-04-25T10:27:43.280314+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:27:43.280314+0000","last_undegraded":"2024-04-25T10:27:43.280314+0000","last_fullsized":"2024-04-25T10:27:43.280314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:47.258142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.021527+0000","last_change":"2024-04-25T10:25:37.193696+0000","last_active":"2024-04-25T10:28:50.021527+0000","last_peered":"2024-04-25T10:28:50.021527+0000","last_clean":"2024-04-25T10:28:50.021527+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:28:50.021527+0000","last_undegraded":"2024-04-25T10:28:50.021527+0000","last_fullsized":"2024-04-25T10:28:50.021527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.688198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.728571+0000","last_change":"2024-04-25T10:25:36.181843+0000","last_active":"2024-04-25T10:28:07.728571+0000","last_peered":"2024-04-25T10:28:07.728571+0000","last_clean":"2024-04-25T10:28:07.728571+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:28:07.728571+0000","last_undegraded":"2024-04-25T10:28:07.728571+0000","last_fullsized":"2024-04-25T10:28:07.728571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:17.305909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:09.659787+0000","last_change":"2024-04-25T10:25:41.247061+0000","last_active":"2024-04-25T10:28:09.659787+0000","last_peered":"2024-04-25T10:28:09.659787+0000","last_clean":"2024-04-25T10:28:09.659787+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:28:09.659787+0000","last_undegraded":"2024-04-25T10:28:09.659787+0000","last_fullsized":"2024-04-25T10:28:09.659787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.011194+0000","last_change":"2024-04-25T10:25:37.185402+0000","last_active":"2024-04-25T10:28:50.011194+0000","last_peered":"2024-04-25T10:28:50.011194+0000","last_clean":"2024-04-25T10:28:50.011194+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:28:50.011194+0000","last_undegraded":"2024-04-25T10:28:50.011194+0000","last_fullsized":"2024-04-25T10:28:50.011194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'31","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.281097+0000","last_change":"2024-04-25T10:28:57.281154+0000","last_active":"2024-04-25T10:28:57.281097+0000","last_peered":"2024-04-25T10:28:57.281097+0000","last_clean":"2024-04-25T10:28:57.281097+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:28:57.281097+0000","last_undegraded":"2024-04-25T10:28:57.281097+0000","last_fullsized":"2024-04-25T10:28:57.281097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-25T10:28:57.280949+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-25T10:28:57.280949+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.280949+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:57.934071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.505910+0000","last_change":"2024-04-25T10:25:41.248522+0000","last_active":"2024-04-25T10:28:46.505910+0000","last_peered":"2024-04-25T10:28:46.505910+0000","last_clean":"2024-04-25T10:28:46.505910+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:28:46.505910+0000","last_undegraded":"2024-04-25T10:28:46.505910+0000","last_fullsized":"2024-04-25T10:28:46.505910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.019649+0000","last_change":"2024-04-25T10:25:37.196588+0000","last_active":"2024-04-25T10:28:50.019649+0000","last_peered":"2024-04-25T10:28:50.019649+0000","last_clean":"2024-04-25T10:28:50.019649+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:28:50.019649+0000","last_undegraded":"2024-04-25T10:28:50.019649+0000","last_fullsized":"2024-04-25T10:28:50.019649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:46.510079+0000","last_change":"2024-04-25T10:25:36.156630+0000","last_active":"2024-04-25T10:28:46.510079+0000","last_peered":"2024-04-25T10:28:46.510079+0000","last_clean":"2024-04-25T10:28:46.510079+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:28:46.510079+0000","last_undegraded":"2024-04-25T10:28:46.510079+0000","last_fullsized":"2024-04-25T10:28:46.510079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:28.605034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:04.668648+0000","last_change":"2024-04-25T10:26:18.708803+0000","last_active":"2024-04-25T10:28:04.668648+0000","last_peered":"2024-04-25T10:28:04.668648+0000","last_clean":"2024-04-25T10:28:04.668648+0000","last_became_active":"2024-04-25T10:26:18.708320+0000","last_became_peered":"2024-04-25T10:26:18.708320+0000","last_unstale":"2024-04-25T10:28:04.668648+0000","last_undegraded":"2024-04-25T10:28:04.668648+0000","last_fullsized":"2024-04-25T10:28:04.668648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,7],"acting":[2,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.021047+0000","last_change":"2024-04-25T10:25:37.187575+0000","last_active":"2024-04-25T10:28:50.021047+0000","last_peered":"2024-04-25T10:28:50.021047+0000","last_clean":"2024-04-25T10:28:50.021047+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:28:50.021047+0000","last_undegraded":"2024-04-25T10:28:50.021047+0000","last_fullsized":"2024-04-25T10:28:50.021047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.668746+0000","last_change":"2024-04-25T10:28:58.668801+0000","last_active":"2024-04-25T10:28:58.668746+0000","last_peered":"2024-04-25T10:28:58.668746+0000","last_clean":"2024-04-25T10:28:58.668746+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:28:58.668746+0000","last_undegraded":"2024-04-25T10:28:58.668746+0000","last_fullsized":"2024-04-25T10:28:58.668746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:28:58.668621+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:28:58.668621+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.668621+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:59.770861+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.425916+0000","last_change":"2024-04-25T10:25:41.238488+0000","last_active":"2024-04-25T10:27:42.425916+0000","last_peered":"2024-04-25T10:27:42.425916+0000","last_clean":"2024-04-25T10:27:42.425916+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:27:42.425916+0000","last_undegraded":"2024-04-25T10:27:42.425916+0000","last_fullsized":"2024-04-25T10:27:42.425916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:05.771002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.011442+0000","last_change":"2024-04-25T10:25:37.192707+0000","last_active":"2024-04-25T10:28:50.011442+0000","last_peered":"2024-04-25T10:28:50.011442+0000","last_clean":"2024-04-25T10:28:50.011442+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:28:50.011442+0000","last_undegraded":"2024-04-25T10:28:50.011442+0000","last_fullsized":"2024-04-25T10:28:50.011442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:56.590175+0000","last_change":"2024-04-25T10:28:56.590227+0000","last_active":"2024-04-25T10:28:56.590175+0000","last_peered":"2024-04-25T10:28:56.590175+0000","last_clean":"2024-04-25T10:28:56.590175+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:28:56.590175+0000","last_undegraded":"2024-04-25T10:28:56.590175+0000","last_fullsized":"2024-04-25T10:28:56.590175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:28:56.590042+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:28:56.590042+0000","last_clean_scrub_stamp":"2024-04-25T10:28:56.590042+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:00.077883+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:04.640401+0000","last_change":"2024-04-25T10:25:41.248983+0000","last_active":"2024-04-25T10:28:04.640401+0000","last_peered":"2024-04-25T10:28:04.640401+0000","last_clean":"2024-04-25T10:28:04.640401+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:28:04.640401+0000","last_undegraded":"2024-04-25T10:28:04.640401+0000","last_fullsized":"2024-04-25T10:28:04.640401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:44.637504+0000","last_change":"2024-04-25T10:25:41.246692+0000","last_active":"2024-04-25T10:27:44.637504+0000","last_peered":"2024-04-25T10:27:44.637504+0000","last_clean":"2024-04-25T10:27:44.637504+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:27:44.637504+0000","last_undegraded":"2024-04-25T10:27:44.637504+0000","last_fullsized":"2024-04-25T10:27:44.637504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'10","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.005017+0000","last_change":"2024-04-25T10:25:37.178691+0000","last_active":"2024-04-25T10:28:50.005017+0000","last_peered":"2024-04-25T10:28:50.005017+0000","last_clean":"2024-04-25T10:28:50.005017+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:28:50.005017+0000","last_undegraded":"2024-04-25T10:28:50.005017+0000","last_fullsized":"2024-04-25T10:28:50.005017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:04.659085+0000","last_change":"2024-04-25T10:25:36.191338+0000","last_active":"2024-04-25T10:28:04.659085+0000","last_peered":"2024-04-25T10:28:04.659085+0000","last_clean":"2024-04-25T10:28:04.659085+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:28:04.659085+0000","last_undegraded":"2024-04-25T10:28:04.659085+0000","last_fullsized":"2024-04-25T10:28:04.659085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:49.655838+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:27:49.655838+0000","last_peered":"2024-04-25T10:27:49.655838+0000","last_clean":"2024-04-25T10:27:49.655838+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:27:49.655838+0000","last_undegraded":"2024-04-25T10:27:49.655838+0000","last_fullsized":"2024-04-25T10:27:49.655838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.971382+0000","last_change":"2024-04-25T10:25:37.170931+0000","last_active":"2024-04-25T10:28:49.971382+0000","last_peered":"2024-04-25T10:28:49.971382+0000","last_clean":"2024-04-25T10:28:49.971382+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:28:49.971382+0000","last_undegraded":"2024-04-25T10:28:49.971382+0000","last_fullsized":"2024-04-25T10:28:49.971382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:07.731321+0000","last_change":"2024-04-25T10:25:36.173721+0000","last_active":"2024-04-25T10:28:07.731321+0000","last_peered":"2024-04-25T10:28:07.731321+0000","last_clean":"2024-04-25T10:28:07.731321+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:28:07.731321+0000","last_undegraded":"2024-04-25T10:28:07.731321+0000","last_fullsized":"2024-04-25T10:28:07.731321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:42.329459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:09.659755+0000","last_change":"2024-04-25T10:25:36.195499+0000","last_active":"2024-04-25T10:28:09.659755+0000","last_peered":"2024-04-25T10:28:09.659755+0000","last_clean":"2024-04-25T10:28:09.659755+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:28:09.659755+0000","last_undegraded":"2024-04-25T10:28:09.659755+0000","last_fullsized":"2024-04-25T10:28:09.659755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.021179+0000","last_change":"2024-04-25T10:25:37.180896+0000","last_active":"2024-04-25T10:28:50.021179+0000","last_peered":"2024-04-25T10:28:50.021179+0000","last_clean":"2024-04-25T10:28:50.021179+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:28:50.021179+0000","last_undegraded":"2024-04-25T10:28:50.021179+0000","last_fullsized":"2024-04-25T10:28:50.021179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:14.641685+0000","last_change":"2024-04-25T10:25:41.231793+0000","last_active":"2024-04-25T10:28:14.641685+0000","last_peered":"2024-04-25T10:28:14.641685+0000","last_clean":"2024-04-25T10:28:14.641685+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:28:14.641685+0000","last_undegraded":"2024-04-25T10:28:14.641685+0000","last_fullsized":"2024-04-25T10:28:14.641685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:09.641066+0000","last_change":"2024-04-25T10:25:36.166742+0000","last_active":"2024-04-25T10:28:09.641066+0000","last_peered":"2024-04-25T10:28:09.641066+0000","last_clean":"2024-04-25T10:28:09.641066+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:28:09.641066+0000","last_undegraded":"2024-04-25T10:28:09.641066+0000","last_fullsized":"2024-04-25T10:28:09.641066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:35.114241+0000","last_clean_scrub_stamp":"2024-04-25T10:25:35.114241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.528082+0000","last_change":"2024-04-25T10:28:58.528153+0000","last_active":"2024-04-25T10:28:58.528082+0000","last_peered":"2024-04-25T10:28:58.528082+0000","last_clean":"2024-04-25T10:28:58.528082+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:28:58.528082+0000","last_undegraded":"2024-04-25T10:28:58.528082+0000","last_fullsized":"2024-04-25T10:28:58.528082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:28:58.527876+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:28:58.527876+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.527876+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:49.562543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:42.426354+0000","last_change":"2024-04-25T10:25:41.258191+0000","last_active":"2024-04-25T10:27:42.426354+0000","last_peered":"2024-04-25T10:27:42.426354+0000","last_clean":"2024-04-25T10:27:42.426354+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:27:42.426354+0000","last_undegraded":"2024-04-25T10:27:42.426354+0000","last_fullsized":"2024-04-25T10:27:42.426354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:17.479785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.991117+0000","last_change":"2024-04-25T10:25:37.183192+0000","last_active":"2024-04-25T10:28:49.991117+0000","last_peered":"2024-04-25T10:28:49.991117+0000","last_clean":"2024-04-25T10:28:49.991117+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:28:49.991117+0000","last_undegraded":"2024-04-25T10:28:49.991117+0000","last_fullsized":"2024-04-25T10:28:49.991117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.004833+0000","last_change":"2024-04-25T10:25:37.180242+0000","last_active":"2024-04-25T10:28:50.004833+0000","last_peered":"2024-04-25T10:28:50.004833+0000","last_clean":"2024-04-25T10:28:50.004833+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:28:50.004833+0000","last_undegraded":"2024-04-25T10:28:50.004833+0000","last_fullsized":"2024-04-25T10:28:50.004833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:03.274585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.006829+0000","last_change":"2024-04-25T10:25:37.187312+0000","last_active":"2024-04-25T10:28:50.006829+0000","last_peered":"2024-04-25T10:28:50.006829+0000","last_clean":"2024-04-25T10:28:50.006829+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:28:50.006829+0000","last_undegraded":"2024-04-25T10:28:50.006829+0000","last_fullsized":"2024-04-25T10:28:50.006829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.971753+0000","last_change":"2024-04-25T10:25:37.166351+0000","last_active":"2024-04-25T10:28:49.971753+0000","last_peered":"2024-04-25T10:28:49.971753+0000","last_clean":"2024-04-25T10:28:49.971753+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:28:49.971753+0000","last_undegraded":"2024-04-25T10:28:49.971753+0000","last_fullsized":"2024-04-25T10:28:49.971753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.963558+0000","last_change":"2024-04-25T10:26:18.699084+0000","last_active":"2024-04-25T10:28:49.963558+0000","last_peered":"2024-04-25T10:28:49.963558+0000","last_clean":"2024-04-25T10:28:49.963558+0000","last_became_active":"2024-04-25T10:26:18.698625+0000","last_became_peered":"2024-04-25T10:26:18.698625+0000","last_unstale":"2024-04-25T10:28:49.963558+0000","last_undegraded":"2024-04-25T10:28:49.963558+0000","last_fullsized":"2024-04-25T10:28:49.963558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:44.112645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.960779+0000","last_change":"2024-04-25T10:25:37.170647+0000","last_active":"2024-04-25T10:28:49.960779+0000","last_peered":"2024-04-25T10:28:49.960779+0000","last_clean":"2024-04-25T10:28:49.960779+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:28:49.960779+0000","last_undegraded":"2024-04-25T10:28:49.960779+0000","last_fullsized":"2024-04-25T10:28:49.960779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:45.290370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.011208+0000","last_change":"2024-04-25T10:25:37.196676+0000","last_active":"2024-04-25T10:28:50.011208+0000","last_peered":"2024-04-25T10:28:50.011208+0000","last_clean":"2024-04-25T10:28:50.011208+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:28:50.011208+0000","last_undegraded":"2024-04-25T10:28:50.011208+0000","last_fullsized":"2024-04-25T10:28:50.011208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.002059+0000","last_change":"2024-04-25T10:25:37.186567+0000","last_active":"2024-04-25T10:28:50.002059+0000","last_peered":"2024-04-25T10:28:50.002059+0000","last_clean":"2024-04-25T10:28:50.002059+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:28:50.002059+0000","last_undegraded":"2024-04-25T10:28:50.002059+0000","last_fullsized":"2024-04-25T10:28:50.002059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.006321+0000","last_change":"2024-04-25T10:25:37.184887+0000","last_active":"2024-04-25T10:28:50.006321+0000","last_peered":"2024-04-25T10:28:50.006321+0000","last_clean":"2024-04-25T10:28:50.006321+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:28:50.006321+0000","last_undegraded":"2024-04-25T10:28:50.006321+0000","last_fullsized":"2024-04-25T10:28:50.006321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.993170+0000","last_change":"2024-04-25T10:25:37.196649+0000","last_active":"2024-04-25T10:28:49.993170+0000","last_peered":"2024-04-25T10:28:49.993170+0000","last_clean":"2024-04-25T10:28:49.993170+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:28:49.993170+0000","last_undegraded":"2024-04-25T10:28:49.993170+0000","last_fullsized":"2024-04-25T10:28:49.993170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.016313+0000","last_change":"2024-04-25T10:25:37.192093+0000","last_active":"2024-04-25T10:28:50.016313+0000","last_peered":"2024-04-25T10:28:50.016313+0000","last_clean":"2024-04-25T10:28:50.016313+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:28:50.016313+0000","last_undegraded":"2024-04-25T10:28:50.016313+0000","last_fullsized":"2024-04-25T10:28:50.016313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.993968+0000","last_change":"2024-04-25T10:25:37.184014+0000","last_active":"2024-04-25T10:28:49.993968+0000","last_peered":"2024-04-25T10:28:49.993968+0000","last_clean":"2024-04-25T10:28:49.993968+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:28:49.993968+0000","last_undegraded":"2024-04-25T10:28:49.993968+0000","last_fullsized":"2024-04-25T10:28:49.993968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.018882+0000","last_change":"2024-04-25T10:25:37.187384+0000","last_active":"2024-04-25T10:28:50.018882+0000","last_peered":"2024-04-25T10:28:50.018882+0000","last_clean":"2024-04-25T10:28:50.018882+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:28:50.018882+0000","last_undegraded":"2024-04-25T10:28:50.018882+0000","last_fullsized":"2024-04-25T10:28:50.018882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.282786+0000","last_change":"2024-04-25T10:28:59.282844+0000","last_active":"2024-04-25T10:28:59.282786+0000","last_peered":"2024-04-25T10:28:59.282786+0000","last_clean":"2024-04-25T10:28:59.282786+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:28:59.282786+0000","last_undegraded":"2024-04-25T10:28:59.282786+0000","last_fullsized":"2024-04-25T10:28:59.282786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:28:59.282645+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:28:59.282645+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.282645+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:17.928272+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.980829+0000","last_change":"2024-04-25T10:25:37.198664+0000","last_active":"2024-04-25T10:28:49.980829+0000","last_peered":"2024-04-25T10:28:49.980829+0000","last_clean":"2024-04-25T10:28:49.980829+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:28:49.980829+0000","last_undegraded":"2024-04-25T10:28:49.980829+0000","last_fullsized":"2024-04-25T10:28:49.980829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:27.161449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.024587+0000","last_change":"2024-04-25T10:25:37.203174+0000","last_active":"2024-04-25T10:28:50.024587+0000","last_peered":"2024-04-25T10:28:50.024587+0000","last_clean":"2024-04-25T10:28:50.024587+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:28:50.024587+0000","last_undegraded":"2024-04-25T10:28:50.024587+0000","last_fullsized":"2024-04-25T10:28:50.024587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.017741+0000","last_change":"2024-04-25T10:25:37.199911+0000","last_active":"2024-04-25T10:28:50.017741+0000","last_peered":"2024-04-25T10:28:50.017741+0000","last_clean":"2024-04-25T10:28:50.017741+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:28:50.017741+0000","last_undegraded":"2024-04-25T10:28:50.017741+0000","last_fullsized":"2024-04-25T10:28:50.017741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.015605+0000","last_change":"2024-04-25T10:25:37.177405+0000","last_active":"2024-04-25T10:28:50.015605+0000","last_peered":"2024-04-25T10:28:50.015605+0000","last_clean":"2024-04-25T10:28:50.015605+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:28:50.015605+0000","last_undegraded":"2024-04-25T10:28:50.015605+0000","last_fullsized":"2024-04-25T10:28:50.015605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.960780+0000","last_change":"2024-04-25T10:25:37.167752+0000","last_active":"2024-04-25T10:28:49.960780+0000","last_peered":"2024-04-25T10:28:49.960780+0000","last_clean":"2024-04-25T10:28:49.960780+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:28:49.960780+0000","last_undegraded":"2024-04-25T10:28:49.960780+0000","last_fullsized":"2024-04-25T10:28:49.960780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:06.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.022295+0000","last_change":"2024-04-25T10:25:37.180781+0000","last_active":"2024-04-25T10:28:50.022295+0000","last_peered":"2024-04-25T10:28:50.022295+0000","last_clean":"2024-04-25T10:28:50.022295+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:28:50.022295+0000","last_undegraded":"2024-04-25T10:28:50.022295+0000","last_fullsized":"2024-04-25T10:28:50.022295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:01.712583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.018597+0000","last_change":"2024-04-25T10:25:37.192759+0000","last_active":"2024-04-25T10:28:50.018597+0000","last_peered":"2024-04-25T10:28:50.018597+0000","last_clean":"2024-04-25T10:28:50.018597+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:28:50.018597+0000","last_undegraded":"2024-04-25T10:28:50.018597+0000","last_fullsized":"2024-04-25T10:28:50.018597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.026551+0000","last_change":"2024-04-25T10:25:37.195532+0000","last_active":"2024-04-25T10:28:50.026551+0000","last_peered":"2024-04-25T10:28:50.026551+0000","last_clean":"2024-04-25T10:28:50.026551+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:28:50.026551+0000","last_undegraded":"2024-04-25T10:28:50.026551+0000","last_fullsized":"2024-04-25T10:28:50.026551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.023477+0000","last_change":"2024-04-25T10:25:37.200331+0000","last_active":"2024-04-25T10:28:50.023477+0000","last_peered":"2024-04-25T10:28:50.023477+0000","last_clean":"2024-04-25T10:28:50.023477+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:28:50.023477+0000","last_undegraded":"2024-04-25T10:28:50.023477+0000","last_fullsized":"2024-04-25T10:28:50.023477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.022797+0000","last_change":"2024-04-25T10:25:37.194514+0000","last_active":"2024-04-25T10:28:50.022797+0000","last_peered":"2024-04-25T10:28:50.022797+0000","last_clean":"2024-04-25T10:28:50.022797+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:28:50.022797+0000","last_undegraded":"2024-04-25T10:28:50.022797+0000","last_fullsized":"2024-04-25T10:28:50.022797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.017215+0000","last_change":"2024-04-25T10:28:59.017255+0000","last_active":"2024-04-25T10:28:59.017215+0000","last_peered":"2024-04-25T10:28:59.017215+0000","last_clean":"2024-04-25T10:28:59.017215+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:28:59.017215+0000","last_undegraded":"2024-04-25T10:28:59.017215+0000","last_fullsized":"2024-04-25T10:28:59.017215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:28:59.017103+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:28:59.017103+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.017103+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.100385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.014013+0000","last_change":"2024-04-25T10:25:37.173419+0000","last_active":"2024-04-25T10:28:50.014013+0000","last_peered":"2024-04-25T10:28:50.014013+0000","last_clean":"2024-04-25T10:28:50.014013+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:28:50.014013+0000","last_undegraded":"2024-04-25T10:28:50.014013+0000","last_fullsized":"2024-04-25T10:28:50.014013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.985737+0000","last_change":"2024-04-25T10:25:37.182871+0000","last_active":"2024-04-25T10:28:49.985737+0000","last_peered":"2024-04-25T10:28:49.985737+0000","last_clean":"2024-04-25T10:28:49.985737+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:28:49.985737+0000","last_undegraded":"2024-04-25T10:28:49.985737+0000","last_fullsized":"2024-04-25T10:28:49.985737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.020163+0000","last_change":"2024-04-25T10:25:37.173983+0000","last_active":"2024-04-25T10:28:50.020163+0000","last_peered":"2024-04-25T10:28:50.020163+0000","last_clean":"2024-04-25T10:28:50.020163+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:28:50.020163+0000","last_undegraded":"2024-04-25T10:28:50.020163+0000","last_fullsized":"2024-04-25T10:28:50.020163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.324459+0000","last_change":"2024-04-25T10:28:59.324497+0000","last_active":"2024-04-25T10:28:59.324459+0000","last_peered":"2024-04-25T10:28:59.324459+0000","last_clean":"2024-04-25T10:28:59.324459+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:28:59.324459+0000","last_undegraded":"2024-04-25T10:28:59.324459+0000","last_fullsized":"2024-04-25T10:28:59.324459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:28:59.324348+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:28:59.324348+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.324348+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:58.225226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.971505+0000","last_change":"2024-04-25T10:25:37.170383+0000","last_active":"2024-04-25T10:28:49.971505+0000","last_peered":"2024-04-25T10:28:49.971505+0000","last_clean":"2024-04-25T10:28:49.971505+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:28:49.971505+0000","last_undegraded":"2024-04-25T10:28:49.971505+0000","last_fullsized":"2024-04-25T10:28:49.971505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:49.971814+0000","last_change":"2024-04-25T10:25:37.167687+0000","last_active":"2024-04-25T10:28:49.971814+0000","last_peered":"2024-04-25T10:28:49.971814+0000","last_clean":"2024-04-25T10:28:49.971814+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:28:49.971814+0000","last_undegraded":"2024-04-25T10:28:49.971814+0000","last_fullsized":"2024-04-25T10:28:49.971814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:50.023557+0000","last_change":"2024-04-25T10:25:37.196591+0000","last_active":"2024-04-25T10:28:50.023557+0000","last_peered":"2024-04-25T10:28:50.023557+0000","last_clean":"2024-04-25T10:28:50.023557+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:28:50.023557+0000","last_undegraded":"2024-04-25T10:28:50.023557+0000","last_fullsized":"2024-04-25T10:28:50.023557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:36.130468+0000","last_clean_scrub_stamp":"2024-04-25T10:25:36.130468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":41301,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":77,"num_read_kb":80,"num_write":170,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":82602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":122200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":712464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":159727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":158193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":892928,"data_stored":711408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:29:01.320 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.320 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.320 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.320 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.320 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.320 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.320 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.320 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.321 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.321 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.321 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.321 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.321 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.321 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.321 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.321 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.321 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.322 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.322 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.322 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.322 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.322 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.322 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.322 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.322 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.322 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.323 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.323 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.323 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.323 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.323 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.323 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.323 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.323 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.323 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.323 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.324 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.324 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.324 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.324 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.324 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.324 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.324 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.324 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.324 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.325 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.325 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.325 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.325 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.325 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.325 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.325 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.325 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.325 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.325 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.326 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.326 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.326 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.326 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.326 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.326 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.326 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.326 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.326 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.327 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.327 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.327 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.327 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.327 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.327 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.327 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.327 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.327 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.328 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.328 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.328 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.328 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.328 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.328 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.328 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.328 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T10:25:35.114241+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.328 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.328 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.329 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.329 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.329 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.329 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.329 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.329 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.329 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.329 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.329 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.329 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.330 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.330 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.330 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.330 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.330 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.330 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.330 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.330 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.330 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.331 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.331 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.331 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.331 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.331 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.331 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.331 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.331 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.331 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T10:25:36.130468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:01.331 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T10:29:21.333 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:29:21.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.627+0000 7f7744a00640 1 Processor -- start 2024-04-25T10:29:21.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.627+0000 7f7744a00640 1 -- start start 2024-04-25T10:29:21.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.630+0000 7f7744a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 0x7f7740073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:21.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.630+0000 7f7744a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f77400cac80 0x7f7740073b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:21.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.630+0000 7f7744a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f774015a8b0 con 0x7f774015a370 2024-04-25T10:29:21.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.630+0000 7f7744a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7740070f70 con 0x7f77400cac80 2024-04-25T10:29:21.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.630+0000 7f7744a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7740072ea0 con 0x7f77400c7f90 2024-04-25T10:29:21.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.630+0000 7f773f400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f774015a370 0x7f7740070860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54568/0 (socket says 172.21.15.19:54568) 2024-04-25T10:29:21.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.630+0000 7f773f400640 1 -- 172.21.15.19:0/145400654 learned_addr learned my addr 172.21.15.19:0/145400654 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:29:21.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.630+0000 7f773fe00640 1 --2- 172.21.15.19:0/145400654 >> v2:172.21.15.112:3300/0 conn(0x7f77400cac80 0x7f7740073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:21.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.630+0000 7f773ea00640 1 --2- 172.21.15.19:0/145400654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 0x7f7740073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:21.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.631+0000 7f773ea00640 1 -- 172.21.15.19:0/145400654 >> v2:172.21.15.112:3300/0 conn(0x7f77400cac80 msgr2=0x7f7740073b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:29:21.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.631+0000 7f773ea00640 1 --2- 172.21.15.19:0/145400654 >> v2:172.21.15.112:3300/0 conn(0x7f77400cac80 0x7f7740073b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:21.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.631+0000 7f773ea00640 1 -- 172.21.15.19:0/145400654 >> v1:172.21.15.19:6789/0 conn(0x7f774015a370 legacy=0x7f7740070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:21.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.631+0000 7f773ea00640 1 -- 172.21.15.19:0/145400654 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774015ab70 con 0x7f77400c7f90 2024-04-25T10:29:21.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.631+0000 7f773e000640 1 -- 172.21.15.19:0/145400654 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290709044 0 0) 0x7f774015a8b0 con 0x7f774015a370 2024-04-25T10:29:21.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.631+0000 7f773fe00640 1 --2- 172.21.15.19:0/145400654 >> v2:172.21.15.112:3300/0 conn(0x7f77400cac80 0x7f7740073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:21.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.632+0000 7f773ea00640 1 --2- 172.21.15.19:0/145400654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 0x7f7740073610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f772c0097a0 tx=0x7f772c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea0569e4eac48d61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:21.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.632+0000 7f773e000640 1 -- 172.21.15.19:0/145400654 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c037070 con 0x7f77400c7f90 2024-04-25T10:29:21.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.632+0000 7f773e000640 1 -- 172.21.15.19:0/145400654 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772c02ae50 con 0x7f77400c7f90 2024-04-25T10:29:21.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.632+0000 7f773e000640 1 -- 172.21.15.19:0/145400654 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c032660 con 0x7f77400c7f90 2024-04-25T10:29:21.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.633+0000 7f7744a00640 1 -- 172.21.15.19:0/145400654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 msgr2=0x7f7740073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:21.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.633+0000 7f7744a00640 1 --2- 172.21.15.19:0/145400654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 0x7f7740073610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f772c0097a0 tx=0x7f772c02a100 comp rx=0 tx=0).stop 2024-04-25T10:29:21.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.633+0000 7f7744a00640 1 -- 172.21.15.19:0/145400654 shutdown_connections 2024-04-25T10:29:21.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.633+0000 7f7744a00640 1 --2- 172.21.15.19:0/145400654 >> v2:172.21.15.112:3300/0 conn(0x7f77400cac80 0x7f7740073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:21.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.633+0000 7f7744a00640 1 --2- 172.21.15.19:0/145400654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 0x7f7740073610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:21.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.633+0000 7f7744a00640 1 -- 172.21.15.19:0/145400654 >> 172.21.15.19:0/145400654 conn(0x7f77400cdbc0 msgr2=0x7f77400ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:21.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.633+0000 7f7744a00640 1 -- 172.21.15.19:0/145400654 shutdown_connections 2024-04-25T10:29:21.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.633+0000 7f7744a00640 1 -- 172.21.15.19:0/145400654 wait complete. 2024-04-25T10:29:21.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.635+0000 7f7744a00640 1 Processor -- start 2024-04-25T10:29:21.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.636+0000 7f7744a00640 1 -- start start 2024-04-25T10:29:21.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.637+0000 7f7744a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 0x7f77401f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.637+0000 7f7744a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77400cac80 0x7f774015b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.637+0000 7f7744a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f774015a370 0x7f77400ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.637+0000 7f7744a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f774015b130 con 0x7f774015a370 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.637+0000 7f7744a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7740073180 con 0x7f77400cac80 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.637+0000 7f7744a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f77400c4b20 con 0x7f77400c7f90 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.637+0000 7f773fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f774015a370 0x7f77400ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 0x7f77401f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77400cac80 0x7f774015b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 0x7f77401f28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:47310/0 (socket says 172.21.15.19:47310) 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f774015a370 0x7f77400ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55196/0 (socket says 172.21.15.19:55196) 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773f400640 1 -- 172.21.15.19:0/905873669 learned_addr learned my addr 172.21.15.19:0/905873669 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773ea00640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77400cac80 0x7f774015b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:51572/0 (socket says 172.21.15.19:51572) 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773f400640 1 -- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77400cac80 msgr2=0x7f774015b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:21.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773f400640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77400cac80 0x7f774015b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773f400640 1 -- 172.21.15.19:0/905873669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f774015a370 msgr2=0x7f77400ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773f400640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f774015a370 0x7f77400ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773f400640 1 -- 172.21.15.19:0/905873669 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77401f2e20 con 0x7f77400c7f90 2024-04-25T10:29:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.638+0000 7f773f400640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 0x7f77401f28e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f773000c450 tx=0x7f773000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:21.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.639+0000 7f7737400640 1 -- 172.21.15.19:0/905873669 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77300074e0 con 0x7f77400c7f90 2024-04-25T10:29:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.639+0000 7f7737400640 1 -- 172.21.15.19:0/905873669 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77300047e0 con 0x7f77400c7f90 2024-04-25T10:29:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.639+0000 7f7744a00640 1 -- 172.21.15.19:0/905873669 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77401584e0 con 0x7f77400c7f90 2024-04-25T10:29:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.639+0000 7f7737400640 1 -- 172.21.15.19:0/905873669 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730004bd0 con 0x7f77400c7f90 2024-04-25T10:29:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.639+0000 7f7744a00640 1 -- 172.21.15.19:0/905873669 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f774015d880 con 0x7f77400c7f90 2024-04-25T10:29:21.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.640+0000 7f7744a00640 1 -- 172.21.15.19:0/905873669 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77400b39c0 con 0x7f77400c7f90 2024-04-25T10:29:21.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.641+0000 7f7737400640 1 -- 172.21.15.19:0/905873669 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7730011070 con 0x7f77400c7f90 2024-04-25T10:29:21.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.642+0000 7f7737400640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f77200744e0 0x7f77200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:21.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.643+0000 7f7737400640 1 -- 172.21.15.19:0/905873669 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f77300951c0 con 0x7f77400c7f90 2024-04-25T10:29:21.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.643+0000 7f773ea00640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f77200744e0 0x7f77200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:21.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.644+0000 7f773ea00640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f77200744e0 0x7f77200769f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f772c034000 tx=0x7f772c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:21.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.646+0000 7f7737400640 1 -- 172.21.15.19:0/905873669 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f77400b39c0 con 0x7f77400c7f90 2024-04-25T10:29:21.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.845+0000 7f7744a00640 1 -- 172.21.15.19:0/905873669 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7740050740 con 0x7f77200744e0 2024-04-25T10:29:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.855+0000 7f7737400640 1 -- 172.21.15.19:0/905873669 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332928 (secure 0 0 0) 0x7f7740050740 con 0x7f77200744e0 2024-04-25T10:29:21.863 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:29:21.864 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:29:21.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.862+0000 7f7744a00640 1 -- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f77200744e0 msgr2=0x7f77200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:21.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.862+0000 7f7744a00640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f77200744e0 0x7f77200769f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f772c034000 tx=0x7f772c02e000 comp rx=0 tx=0).stop 2024-04-25T10:29:21.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.862+0000 7f7744a00640 1 -- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 msgr2=0x7f77401f28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:21.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.862+0000 7f7744a00640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 0x7f77401f28e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f773000c450 tx=0x7f773000c850 comp rx=0 tx=0).stop 2024-04-25T10:29:21.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.862+0000 7f7744a00640 1 -- 172.21.15.19:0/905873669 shutdown_connections 2024-04-25T10:29:21.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.862+0000 7f7744a00640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f774015a370 0x7f77400ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:21.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.862+0000 7f7744a00640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77400cac80 0x7f774015b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:21.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.862+0000 7f7744a00640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f77200744e0 0x7f77200769f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:21.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.862+0000 7f7744a00640 1 --2- 172.21.15.19:0/905873669 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77400c7f90 0x7f77401f28e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:21.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.862+0000 7f7744a00640 1 -- 172.21.15.19:0/905873669 >> 172.21.15.19:0/905873669 conn(0x7f77400cdbc0 msgr2=0x7f7740153510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:21.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.863+0000 7f7744a00640 1 -- 172.21.15.19:0/905873669 shutdown_connections 2024-04-25T10:29:21.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:21.863+0000 7f7744a00640 1 -- 172.21.15.19:0/905873669 wait complete. 2024-04-25T10:29:21.894 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-04-25T10:29:20.641719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":631669,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":273,"num_write_kb":1729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":792,"ondisk_log_size":792,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219792,"kb_used_data":3664,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754928,"statfs":{"total":773094113280,"available":772869046272,"internally_reserved":0,"allocated":3751936,"data_stored":2230378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003505"},"pg_stats":[{"pgid":"2.1f","version":"27'14","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.781596+0000","last_change":"2024-04-25T10:29:03.781661+0000","last_active":"2024-04-25T10:29:03.781596+0000","last_peered":"2024-04-25T10:29:03.781596+0000","last_clean":"2024-04-25T10:29:03.781596+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:29:03.781596+0000","last_undegraded":"2024-04-25T10:29:03.781596+0000","last_fullsized":"2024-04-25T10:29:03.781596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-04-25T10:29:03.781501+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-04-25T10:29:03.781501+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.781501+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:16.988962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:13.857674+0000","last_change":"2024-04-25T10:29:13.857705+0000","last_active":"2024-04-25T10:29:13.857674+0000","last_peered":"2024-04-25T10:29:13.857674+0000","last_clean":"2024-04-25T10:29:13.857674+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:29:13.857674+0000","last_undegraded":"2024-04-25T10:29:13.857674+0000","last_fullsized":"2024-04-25T10:29:13.857674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:13.857580+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:13.857580+0000","last_clean_scrub_stamp":"2024-04-25T10:29:13.857580+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:27.176508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.318754+0000","last_change":"2024-04-25T10:29:07.318813+0000","last_active":"2024-04-25T10:29:07.318754+0000","last_peered":"2024-04-25T10:29:07.318754+0000","last_clean":"2024-04-25T10:29:07.318754+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:29:07.318754+0000","last_undegraded":"2024-04-25T10:29:07.318754+0000","last_fullsized":"2024-04-25T10:29:07.318754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:07.318643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:07.318643+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.318643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:26.916351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.027708+0000","last_change":"2024-04-25T10:29:04.027739+0000","last_active":"2024-04-25T10:29:04.027708+0000","last_peered":"2024-04-25T10:29:04.027708+0000","last_clean":"2024-04-25T10:29:04.027708+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:29:04.027708+0000","last_undegraded":"2024-04-25T10:29:04.027708+0000","last_fullsized":"2024-04-25T10:29:04.027708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:29:04.027602+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:29:04.027602+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.027602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:46.373925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.010998+0000","last_change":"2024-04-25T10:29:01.011030+0000","last_active":"2024-04-25T10:29:01.010998+0000","last_peered":"2024-04-25T10:29:01.010998+0000","last_clean":"2024-04-25T10:29:01.010998+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:29:01.010998+0000","last_undegraded":"2024-04-25T10:29:01.010998+0000","last_fullsized":"2024-04-25T10:29:01.010998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:01.010891+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:01.010891+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.010891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:02.113130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.367853+0000","last_change":"2024-04-25T10:29:06.367921+0000","last_active":"2024-04-25T10:29:06.367853+0000","last_peered":"2024-04-25T10:29:06.367853+0000","last_clean":"2024-04-25T10:29:06.367853+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:29:06.367853+0000","last_undegraded":"2024-04-25T10:29:06.367853+0000","last_fullsized":"2024-04-25T10:29:06.367853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:06.367640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:06.367640+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.367640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:48.713963+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.718240+0000","last_change":"2024-04-25T10:28:59.718385+0000","last_active":"2024-04-25T10:28:59.718240+0000","last_peered":"2024-04-25T10:28:59.718240+0000","last_clean":"2024-04-25T10:28:59.718240+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:28:59.718240+0000","last_undegraded":"2024-04-25T10:28:59.718240+0000","last_fullsized":"2024-04-25T10:28:59.718240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:28:59.717991+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:28:59.717991+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.717991+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:12.925452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":7,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.513766+0000","last_change":"2024-04-25T10:28:59.513833+0000","last_active":"2024-04-25T10:28:59.513766+0000","last_peered":"2024-04-25T10:28:59.513766+0000","last_clean":"2024-04-25T10:28:59.513766+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:28:59.513766+0000","last_undegraded":"2024-04-25T10:28:59.513766+0000","last_fullsized":"2024-04-25T10:28:59.513766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:28:59.513540+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:28:59.513540+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.513540+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:44.778177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.402183+0000","last_change":"2024-04-25T10:29:07.402311+0000","last_active":"2024-04-25T10:29:07.402183+0000","last_peered":"2024-04-25T10:29:07.402183+0000","last_clean":"2024-04-25T10:29:07.402183+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:29:07.402183+0000","last_undegraded":"2024-04-25T10:29:07.402183+0000","last_fullsized":"2024-04-25T10:29:07.402183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:07.401926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:07.401926+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.401926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:48.026975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.759827+0000","last_change":"2024-04-25T10:29:00.759882+0000","last_active":"2024-04-25T10:29:00.759827+0000","last_peered":"2024-04-25T10:29:00.759827+0000","last_clean":"2024-04-25T10:29:00.759827+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:29:00.759827+0000","last_undegraded":"2024-04-25T10:29:00.759827+0000","last_fullsized":"2024-04-25T10:29:00.759827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:29:00.759669+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:29:00.759669+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.759669+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:32.106371+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:16.219350+0000","last_change":"2024-04-25T10:29:16.219545+0000","last_active":"2024-04-25T10:29:16.219350+0000","last_peered":"2024-04-25T10:29:16.219350+0000","last_clean":"2024-04-25T10:29:16.219350+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:29:16.219350+0000","last_undegraded":"2024-04-25T10:29:16.219350+0000","last_fullsized":"2024-04-25T10:29:16.219350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-25T10:29:16.219083+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-25T10:29:16.219083+0000","last_clean_scrub_stamp":"2024-04-25T10:29:16.219083+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:34.425358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.341545+0000","last_change":"2024-04-25T10:29:05.341612+0000","last_active":"2024-04-25T10:29:05.341545+0000","last_peered":"2024-04-25T10:29:05.341545+0000","last_clean":"2024-04-25T10:29:05.341545+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:29:05.341545+0000","last_undegraded":"2024-04-25T10:29:05.341545+0000","last_fullsized":"2024-04-25T10:29:05.341545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:05.341306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:05.341306+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.341306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:40.175396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.247590+0000","last_change":"2024-04-25T10:28:57.247636+0000","last_active":"2024-04-25T10:28:57.247590+0000","last_peered":"2024-04-25T10:28:57.247590+0000","last_clean":"2024-04-25T10:28:57.247590+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:28:57.247590+0000","last_undegraded":"2024-04-25T10:28:57.247590+0000","last_fullsized":"2024-04-25T10:28:57.247590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:28:57.247441+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:28:57.247441+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.247441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:39.593764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:12.154410+0000","last_change":"2024-04-25T10:29:12.154497+0000","last_active":"2024-04-25T10:29:12.154410+0000","last_peered":"2024-04-25T10:29:12.154410+0000","last_clean":"2024-04-25T10:29:12.154410+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:29:12.154410+0000","last_undegraded":"2024-04-25T10:29:12.154410+0000","last_fullsized":"2024-04-25T10:29:12.154410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:12.154180+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:12.154180+0000","last_clean_scrub_stamp":"2024-04-25T10:29:12.154180+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:22.591599+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:59.658151+0000","last_change":"2024-04-25T10:25:41.259149+0000","last_active":"2024-04-25T10:27:59.658151+0000","last_peered":"2024-04-25T10:27:59.658151+0000","last_clean":"2024-04-25T10:27:59.658151+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:27:59.658151+0000","last_undegraded":"2024-04-25T10:27:59.658151+0000","last_fullsized":"2024-04-25T10:27:59.658151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.350921+0000","last_change":"2024-04-25T10:29:04.350952+0000","last_active":"2024-04-25T10:29:04.350921+0000","last_peered":"2024-04-25T10:29:04.350921+0000","last_clean":"2024-04-25T10:29:04.350921+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:29:04.350921+0000","last_undegraded":"2024-04-25T10:29:04.350921+0000","last_fullsized":"2024-04-25T10:29:04.350921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:04.350824+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:04.350824+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.350824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.971582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.933904+0000","last_change":"2024-04-25T10:28:59.933936+0000","last_active":"2024-04-25T10:28:59.933904+0000","last_peered":"2024-04-25T10:28:59.933904+0000","last_clean":"2024-04-25T10:28:59.933904+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:28:59.933904+0000","last_undegraded":"2024-04-25T10:28:59.933904+0000","last_fullsized":"2024-04-25T10:28:59.933904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:28:59.933815+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:28:59.933815+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.933815+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:27.412460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.661100+0000","last_change":"2024-04-25T10:29:11.661165+0000","last_active":"2024-04-25T10:29:11.661100+0000","last_peered":"2024-04-25T10:29:11.661100+0000","last_clean":"2024-04-25T10:29:11.661100+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:29:11.661100+0000","last_undegraded":"2024-04-25T10:29:11.661100+0000","last_fullsized":"2024-04-25T10:29:11.661100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:11.660885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:11.660885+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.660885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:05:17.219877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.735882+0000","last_change":"2024-04-25T10:29:04.735913+0000","last_active":"2024-04-25T10:29:04.735882+0000","last_peered":"2024-04-25T10:29:04.735882+0000","last_clean":"2024-04-25T10:29:04.735882+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:29:04.735882+0000","last_undegraded":"2024-04-25T10:29:04.735882+0000","last_fullsized":"2024-04-25T10:29:04.735882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:04.735777+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:04.735777+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.735777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:36.082479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.734560+0000","last_change":"2024-04-25T10:29:01.734600+0000","last_active":"2024-04-25T10:29:01.734560+0000","last_peered":"2024-04-25T10:29:01.734560+0000","last_clean":"2024-04-25T10:29:01.734560+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:29:01.734560+0000","last_undegraded":"2024-04-25T10:29:01.734560+0000","last_fullsized":"2024-04-25T10:29:01.734560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:01.734468+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:01.734468+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.734468+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:31.981033+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.401475+0000","last_change":"2024-04-25T10:29:09.401507+0000","last_active":"2024-04-25T10:29:09.401475+0000","last_peered":"2024-04-25T10:29:09.401475+0000","last_clean":"2024-04-25T10:29:09.401475+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:29:09.401475+0000","last_undegraded":"2024-04-25T10:29:09.401475+0000","last_fullsized":"2024-04-25T10:29:09.401475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:09.401377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:09.401377+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.401377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:02.128450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.268007+0000","last_change":"2024-04-25T10:28:58.268085+0000","last_active":"2024-04-25T10:28:58.268007+0000","last_peered":"2024-04-25T10:28:58.268007+0000","last_clean":"2024-04-25T10:28:58.268007+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:28:58.268007+0000","last_undegraded":"2024-04-25T10:28:58.268007+0000","last_fullsized":"2024-04-25T10:28:58.268007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:28:58.267794+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:28:58.267794+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.267794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:31.648763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:56.689813+0000","last_change":"2024-04-25T10:28:56.689855+0000","last_active":"2024-04-25T10:28:56.689813+0000","last_peered":"2024-04-25T10:28:56.689813+0000","last_clean":"2024-04-25T10:28:56.689813+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:28:56.689813+0000","last_undegraded":"2024-04-25T10:28:56.689813+0000","last_fullsized":"2024-04-25T10:28:56.689813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:28:56.689703+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:28:56.689703+0000","last_clean_scrub_stamp":"2024-04-25T10:28:56.689703+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:04.893320+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.373281+0000","last_change":"2024-04-25T10:29:10.373350+0000","last_active":"2024-04-25T10:29:10.373281+0000","last_peered":"2024-04-25T10:29:10.373281+0000","last_clean":"2024-04-25T10:29:10.373281+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:29:10.373281+0000","last_undegraded":"2024-04-25T10:29:10.373281+0000","last_fullsized":"2024-04-25T10:29:10.373281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:10.373068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:10.373068+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.373068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:08.639453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.733577+0000","last_change":"2024-04-25T10:29:05.733610+0000","last_active":"2024-04-25T10:29:05.733577+0000","last_peered":"2024-04-25T10:29:05.733577+0000","last_clean":"2024-04-25T10:29:05.733577+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:29:05.733577+0000","last_undegraded":"2024-04-25T10:29:05.733577+0000","last_fullsized":"2024-04-25T10:29:05.733577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:05.733477+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:05.733477+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.733477+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:40.567567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:14.212820+0000","last_change":"2024-04-25T10:29:14.212910+0000","last_active":"2024-04-25T10:29:14.212820+0000","last_peered":"2024-04-25T10:29:14.212820+0000","last_clean":"2024-04-25T10:29:14.212820+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:29:14.212820+0000","last_undegraded":"2024-04-25T10:29:14.212820+0000","last_fullsized":"2024-04-25T10:29:14.212820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:14.212595+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:14.212595+0000","last_clean_scrub_stamp":"2024-04-25T10:29:14.212595+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:51.141361+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.370040+0000","last_change":"2024-04-25T10:29:09.370106+0000","last_active":"2024-04-25T10:29:09.370040+0000","last_peered":"2024-04-25T10:29:09.370040+0000","last_clean":"2024-04-25T10:29:09.370040+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:29:09.370040+0000","last_undegraded":"2024-04-25T10:29:09.370040+0000","last_fullsized":"2024-04-25T10:29:09.370040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:09.369831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:09.369831+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.369831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:28.015457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.756390+0000","last_change":"2024-04-25T10:29:06.756422+0000","last_active":"2024-04-25T10:29:06.756390+0000","last_peered":"2024-04-25T10:29:06.756390+0000","last_clean":"2024-04-25T10:29:06.756390+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:29:06.756390+0000","last_undegraded":"2024-04-25T10:29:06.756390+0000","last_fullsized":"2024-04-25T10:29:06.756390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:06.756287+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:06.756287+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.756287+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:49.102609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'13","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.752777+0000","last_change":"2024-04-25T10:29:02.752843+0000","last_active":"2024-04-25T10:29:02.752777+0000","last_peered":"2024-04-25T10:29:02.752777+0000","last_clean":"2024-04-25T10:29:02.752777+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:29:02.752777+0000","last_undegraded":"2024-04-25T10:29:02.752777+0000","last_fullsized":"2024-04-25T10:29:02.752777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-25T10:29:02.752631+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-25T10:29:02.752631+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.752631+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:03.854870+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:12.747407+0000","last_change":"2024-04-25T10:29:12.747437+0000","last_active":"2024-04-25T10:29:12.747407+0000","last_peered":"2024-04-25T10:29:12.747407+0000","last_clean":"2024-04-25T10:29:12.747407+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:29:12.747407+0000","last_undegraded":"2024-04-25T10:29:12.747407+0000","last_fullsized":"2024-04-25T10:29:12.747407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:12.747296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:12.747296+0000","last_clean_scrub_stamp":"2024-04-25T10:29:12.747296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:54.745372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.945174+0000","last_change":"2024-04-25T10:29:04.945227+0000","last_active":"2024-04-25T10:29:04.945174+0000","last_peered":"2024-04-25T10:29:04.945174+0000","last_clean":"2024-04-25T10:29:04.945174+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:29:04.945174+0000","last_undegraded":"2024-04-25T10:29:04.945174+0000","last_fullsized":"2024-04-25T10:29:04.945174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:04.945032+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:04.945032+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.945032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:35.191598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.110293+0000","last_change":"2024-04-25T10:29:08.110376+0000","last_active":"2024-04-25T10:29:08.110293+0000","last_peered":"2024-04-25T10:29:08.110293+0000","last_clean":"2024-04-25T10:29:08.110293+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:29:08.110293+0000","last_undegraded":"2024-04-25T10:29:08.110293+0000","last_fullsized":"2024-04-25T10:29:08.110293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:29:08.110083+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:29:08.110083+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.110083+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:53.229735+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.906600+0000","last_change":"2024-04-25T10:29:09.906631+0000","last_active":"2024-04-25T10:29:09.906600+0000","last_peered":"2024-04-25T10:29:09.906600+0000","last_clean":"2024-04-25T10:29:09.906600+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:29:09.906600+0000","last_undegraded":"2024-04-25T10:29:09.906600+0000","last_fullsized":"2024-04-25T10:29:09.906600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:09.906492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:09.906492+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.906492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:50.531542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.321741+0000","last_change":"2024-04-25T10:28:58.321787+0000","last_active":"2024-04-25T10:28:58.321741+0000","last_peered":"2024-04-25T10:28:58.321741+0000","last_clean":"2024-04-25T10:28:58.321741+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:28:58.321741+0000","last_undegraded":"2024-04-25T10:28:58.321741+0000","last_fullsized":"2024-04-25T10:28:58.321741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:28:58.321649+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:28:58.321649+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.321649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:22.455633+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.982456+0000","last_change":"2024-04-25T10:29:02.982481+0000","last_active":"2024-04-25T10:29:02.982456+0000","last_peered":"2024-04-25T10:29:02.982456+0000","last_clean":"2024-04-25T10:29:02.982456+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:29:02.982456+0000","last_undegraded":"2024-04-25T10:29:02.982456+0000","last_fullsized":"2024-04-25T10:29:02.982456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:02.982364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:02.982364+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.982364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:37.816454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.954103+0000","last_change":"2024-04-25T10:29:08.954134+0000","last_active":"2024-04-25T10:29:08.954103+0000","last_peered":"2024-04-25T10:29:08.954103+0000","last_clean":"2024-04-25T10:29:08.954103+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:29:08.954103+0000","last_undegraded":"2024-04-25T10:29:08.954103+0000","last_fullsized":"2024-04-25T10:29:08.954103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:08.953998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:08.953998+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.953998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:51.300320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.753112+0000","last_change":"2024-04-25T10:29:06.753179+0000","last_active":"2024-04-25T10:29:06.753112+0000","last_peered":"2024-04-25T10:29:06.753112+0000","last_clean":"2024-04-25T10:29:06.753112+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:29:06.753112+0000","last_undegraded":"2024-04-25T10:29:06.753112+0000","last_fullsized":"2024-04-25T10:29:06.753112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:06.752905+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:06.752905+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.752905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:05.704236+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.138900+0000","last_change":"2024-04-25T10:29:07.139044+0000","last_active":"2024-04-25T10:29:07.138900+0000","last_peered":"2024-04-25T10:29:07.138900+0000","last_clean":"2024-04-25T10:29:07.138900+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:29:07.138900+0000","last_undegraded":"2024-04-25T10:29:07.138900+0000","last_fullsized":"2024-04-25T10:29:07.138900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:29:07.138628+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:29:07.138628+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.138628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:20.457556+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.962467+0000","last_change":"2024-04-25T10:29:11.962497+0000","last_active":"2024-04-25T10:29:11.962467+0000","last_peered":"2024-04-25T10:29:11.962467+0000","last_clean":"2024-04-25T10:29:11.962467+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:29:11.962467+0000","last_undegraded":"2024-04-25T10:29:11.962467+0000","last_fullsized":"2024-04-25T10:29:11.962467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:11.962365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:11.962365+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.962365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:22.927722+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.020156+0000","last_change":"2024-04-25T10:29:02.020185+0000","last_active":"2024-04-25T10:29:02.020156+0000","last_peered":"2024-04-25T10:29:02.020156+0000","last_clean":"2024-04-25T10:29:02.020156+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:29:02.020156+0000","last_undegraded":"2024-04-25T10:29:02.020156+0000","last_fullsized":"2024-04-25T10:29:02.020156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:02.020056+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:02.020056+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.020056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:15.227517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'10","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.291235+0000","last_change":"2024-04-25T10:29:02.291306+0000","last_active":"2024-04-25T10:29:02.291235+0000","last_peered":"2024-04-25T10:29:02.291235+0000","last_clean":"2024-04-25T10:29:02.291235+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:29:02.291235+0000","last_undegraded":"2024-04-25T10:29:02.291235+0000","last_fullsized":"2024-04-25T10:29:02.291235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:02.291108+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:02.291108+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.291108+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.145907+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:12.923149+0000","last_change":"2024-04-25T10:29:12.923181+0000","last_active":"2024-04-25T10:29:12.923149+0000","last_peered":"2024-04-25T10:29:12.923149+0000","last_clean":"2024-04-25T10:29:12.923149+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:29:12.923149+0000","last_undegraded":"2024-04-25T10:29:12.923149+0000","last_fullsized":"2024-04-25T10:29:12.923149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:12.923052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:12.923052+0000","last_clean_scrub_stamp":"2024-04-25T10:29:12.923052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:35.323401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.965891+0000","last_change":"2024-04-25T10:29:05.965919+0000","last_active":"2024-04-25T10:29:05.965891+0000","last_peered":"2024-04-25T10:29:05.965891+0000","last_clean":"2024-04-25T10:29:05.965891+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:29:05.965891+0000","last_undegraded":"2024-04-25T10:29:05.965891+0000","last_fullsized":"2024-04-25T10:29:05.965891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:05.965794+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:05.965794+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.965794+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:07.068033+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.161564+0000","last_change":"2024-04-25T10:29:11.161649+0000","last_active":"2024-04-25T10:29:11.161564+0000","last_peered":"2024-04-25T10:29:11.161564+0000","last_clean":"2024-04-25T10:29:11.161564+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:29:11.161564+0000","last_undegraded":"2024-04-25T10:29:11.161564+0000","last_fullsized":"2024-04-25T10:29:11.161564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T10:29:11.161262+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T10:29:11.161262+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.161262+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:33.179952+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:15.779935+0000","last_change":"2024-04-25T10:29:15.779969+0000","last_active":"2024-04-25T10:29:15.779935+0000","last_peered":"2024-04-25T10:29:15.779935+0000","last_clean":"2024-04-25T10:29:15.779935+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:29:15.779935+0000","last_undegraded":"2024-04-25T10:29:15.779935+0000","last_fullsized":"2024-04-25T10:29:15.779935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:15.779836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:15.779836+0000","last_clean_scrub_stamp":"2024-04-25T10:29:15.779836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:22.071234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.694903+0000","last_change":"2024-04-25T10:28:58.694935+0000","last_active":"2024-04-25T10:28:58.694903+0000","last_peered":"2024-04-25T10:28:58.694903+0000","last_clean":"2024-04-25T10:28:58.694903+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:28:58.694903+0000","last_undegraded":"2024-04-25T10:28:58.694903+0000","last_fullsized":"2024-04-25T10:28:58.694903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:28:58.694754+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:28:58.694754+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.694754+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:57.595631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.152978+0000","last_change":"2024-04-25T10:29:10.153140+0000","last_active":"2024-04-25T10:29:10.152978+0000","last_peered":"2024-04-25T10:29:10.152978+0000","last_clean":"2024-04-25T10:29:10.152978+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:29:10.152978+0000","last_undegraded":"2024-04-25T10:29:10.152978+0000","last_fullsized":"2024-04-25T10:29:10.152978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:10.152715+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:10.152715+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.152715+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:33.709067+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:55.578556+0000","last_change":"2024-04-25T10:28:55.578640+0000","last_active":"2024-04-25T10:28:55.578556+0000","last_peered":"2024-04-25T10:28:55.578556+0000","last_clean":"2024-04-25T10:28:55.578556+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:28:55.578556+0000","last_undegraded":"2024-04-25T10:28:55.578556+0000","last_fullsized":"2024-04-25T10:28:55.578556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-04-25T10:28:55.578322+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-04-25T10:28:55.578322+0000","last_clean_scrub_stamp":"2024-04-25T10:28:55.578322+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:49.614946+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:49.655801+0000","last_change":"2024-04-25T10:25:41.257421+0000","last_active":"2024-04-25T10:27:49.655801+0000","last_peered":"2024-04-25T10:27:49.655801+0000","last_clean":"2024-04-25T10:27:49.655801+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:27:49.655801+0000","last_undegraded":"2024-04-25T10:27:49.655801+0000","last_fullsized":"2024-04-25T10:27:49.655801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.303861+0000","last_change":"2024-04-25T10:29:00.303900+0000","last_active":"2024-04-25T10:29:00.303861+0000","last_peered":"2024-04-25T10:29:00.303861+0000","last_clean":"2024-04-25T10:29:00.303861+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:29:00.303861+0000","last_undegraded":"2024-04-25T10:29:00.303861+0000","last_fullsized":"2024-04-25T10:29:00.303861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:00.303736+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:00.303736+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.303736+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:11.269094+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.950800+0000","last_change":"2024-04-25T10:29:01.950858+0000","last_active":"2024-04-25T10:29:01.950800+0000","last_peered":"2024-04-25T10:29:01.950800+0000","last_clean":"2024-04-25T10:29:01.950800+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:29:01.950800+0000","last_undegraded":"2024-04-25T10:29:01.950800+0000","last_fullsized":"2024-04-25T10:29:01.950800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:01.950645+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:01.950645+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.950645+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:21.548353+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.353834+0000","last_change":"2024-04-25T10:29:08.353901+0000","last_active":"2024-04-25T10:29:08.353834+0000","last_peered":"2024-04-25T10:29:08.353834+0000","last_clean":"2024-04-25T10:29:08.353834+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:29:08.353834+0000","last_undegraded":"2024-04-25T10:29:08.353834+0000","last_fullsized":"2024-04-25T10:29:08.353834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:08.353605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:08.353605+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.353605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:05.811055+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:55.642149+0000","last_change":"2024-04-25T10:28:55.642284+0000","last_active":"2024-04-25T10:28:55.642149+0000","last_peered":"2024-04-25T10:28:55.642149+0000","last_clean":"2024-04-25T10:28:55.642149+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:28:55.642149+0000","last_undegraded":"2024-04-25T10:28:55.642149+0000","last_fullsized":"2024-04-25T10:28:55.642149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:28:55.641849+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:28:55.641849+0000","last_clean_scrub_stamp":"2024-04-25T10:28:55.641849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:06.649856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.027851+0000","last_change":"2024-04-25T10:29:06.027898+0000","last_active":"2024-04-25T10:29:06.027851+0000","last_peered":"2024-04-25T10:29:06.027851+0000","last_clean":"2024-04-25T10:29:06.027851+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:29:06.027851+0000","last_undegraded":"2024-04-25T10:29:06.027851+0000","last_fullsized":"2024-04-25T10:29:06.027851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:29:06.027737+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:29:06.027737+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.027737+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:03.485186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:17.757200+0000","last_change":"2024-04-25T10:29:17.757258+0000","last_active":"2024-04-25T10:29:17.757200+0000","last_peered":"2024-04-25T10:29:17.757200+0000","last_clean":"2024-04-25T10:29:17.757200+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:29:17.757200+0000","last_undegraded":"2024-04-25T10:29:17.757200+0000","last_fullsized":"2024-04-25T10:29:17.757200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:17.757079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:17.757079+0000","last_clean_scrub_stamp":"2024-04-25T10:29:17.757079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.313431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:54.624310+0000","last_change":"2024-04-25T10:28:54.624376+0000","last_active":"2024-04-25T10:28:54.624310+0000","last_peered":"2024-04-25T10:28:54.624310+0000","last_clean":"2024-04-25T10:28:54.624310+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:28:54.624310+0000","last_undegraded":"2024-04-25T10:28:54.624310+0000","last_fullsized":"2024-04-25T10:28:54.624310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:28:54.624108+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:28:54.624108+0000","last_clean_scrub_stamp":"2024-04-25T10:28:54.624108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.524986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.730386+0000","last_change":"2024-04-25T10:29:00.730445+0000","last_active":"2024-04-25T10:29:00.730386+0000","last_peered":"2024-04-25T10:29:00.730386+0000","last_clean":"2024-04-25T10:29:00.730386+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:29:00.730386+0000","last_undegraded":"2024-04-25T10:29:00.730386+0000","last_fullsized":"2024-04-25T10:29:00.730386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:29:00.730243+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:29:00.730243+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.730243+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:08.933859+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:18.201676+0000","last_change":"2024-04-25T10:29:18.201823+0000","last_active":"2024-04-25T10:29:18.201676+0000","last_peered":"2024-04-25T10:29:18.201676+0000","last_clean":"2024-04-25T10:29:18.201676+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:29:18.201676+0000","last_undegraded":"2024-04-25T10:29:18.201676+0000","last_fullsized":"2024-04-25T10:29:18.201676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:18.201286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:18.201286+0000","last_clean_scrub_stamp":"2024-04-25T10:29:18.201286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:51.732085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.349704+0000","last_change":"2024-04-25T10:29:04.349773+0000","last_active":"2024-04-25T10:29:04.349704+0000","last_peered":"2024-04-25T10:29:04.349704+0000","last_clean":"2024-04-25T10:29:04.349704+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:29:04.349704+0000","last_undegraded":"2024-04-25T10:29:04.349704+0000","last_fullsized":"2024-04-25T10:29:04.349704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:04.349459+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:04.349459+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.349459+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:17.556919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.683375+0000","last_change":"2024-04-25T10:28:57.683452+0000","last_active":"2024-04-25T10:28:57.683375+0000","last_peered":"2024-04-25T10:28:57.683375+0000","last_clean":"2024-04-25T10:28:57.683375+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:28:57.683375+0000","last_undegraded":"2024-04-25T10:28:57.683375+0000","last_fullsized":"2024-04-25T10:28:57.683375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:28:57.683180+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:28:57.683180+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.683180+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:27.929746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.539866+0000","last_change":"2024-04-25T10:29:02.540000+0000","last_active":"2024-04-25T10:29:02.539866+0000","last_peered":"2024-04-25T10:29:02.539866+0000","last_clean":"2024-04-25T10:29:02.539866+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:29:02.539866+0000","last_undegraded":"2024-04-25T10:29:02.539866+0000","last_fullsized":"2024-04-25T10:29:02.539866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:02.539577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:02.539577+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.539577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:26.673560+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.168104+0000","last_change":"2024-04-25T10:29:05.168184+0000","last_active":"2024-04-25T10:29:05.168104+0000","last_peered":"2024-04-25T10:29:05.168104+0000","last_clean":"2024-04-25T10:29:05.168104+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:29:05.168104+0000","last_undegraded":"2024-04-25T10:29:05.168104+0000","last_fullsized":"2024-04-25T10:29:05.168104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:05.167882+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:05.167882+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.167882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:16.353420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'25","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.701332+0000","last_change":"2024-04-25T10:28:59.701381+0000","last_active":"2024-04-25T10:28:59.701332+0000","last_peered":"2024-04-25T10:28:59.701332+0000","last_clean":"2024-04-25T10:28:59.701332+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:28:59.701332+0000","last_undegraded":"2024-04-25T10:28:59.701332+0000","last_fullsized":"2024-04-25T10:28:59.701332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-25T10:28:59.701224+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-25T10:28:59.701224+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.701224+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:10.709231+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:14.818220+0000","last_change":"2024-04-25T10:29:14.818281+0000","last_active":"2024-04-25T10:29:14.818220+0000","last_peered":"2024-04-25T10:29:14.818220+0000","last_clean":"2024-04-25T10:29:14.818220+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:29:14.818220+0000","last_undegraded":"2024-04-25T10:29:14.818220+0000","last_fullsized":"2024-04-25T10:29:14.818220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:14.818089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:14.818089+0000","last_clean_scrub_stamp":"2024-04-25T10:29:14.818089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:59.937742+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.569372+0000","last_change":"2024-04-25T10:28:57.569425+0000","last_active":"2024-04-25T10:28:57.569372+0000","last_peered":"2024-04-25T10:28:57.569372+0000","last_clean":"2024-04-25T10:28:57.569372+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:28:57.569372+0000","last_undegraded":"2024-04-25T10:28:57.569372+0000","last_fullsized":"2024-04-25T10:28:57.569372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:28:57.569233+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:28:57.569233+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.569233+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:26.337773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.753556+0000","last_change":"2024-04-25T10:29:01.753644+0000","last_active":"2024-04-25T10:29:01.753556+0000","last_peered":"2024-04-25T10:29:01.753556+0000","last_clean":"2024-04-25T10:29:01.753556+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:29:01.753556+0000","last_undegraded":"2024-04-25T10:29:01.753556+0000","last_fullsized":"2024-04-25T10:29:01.753556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:01.753326+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:01.753326+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.753326+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:36.587415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:16.761724+0000","last_change":"2024-04-25T10:29:16.761774+0000","last_active":"2024-04-25T10:29:16.761724+0000","last_peered":"2024-04-25T10:29:16.761724+0000","last_clean":"2024-04-25T10:29:16.761724+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:29:16.761724+0000","last_undegraded":"2024-04-25T10:29:16.761724+0000","last_fullsized":"2024-04-25T10:29:16.761724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:16.761585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:16.761585+0000","last_clean_scrub_stamp":"2024-04-25T10:29:16.761585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:36.261718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:17.227977+0000","last_change":"2024-04-25T10:29:17.228054+0000","last_active":"2024-04-25T10:29:17.227977+0000","last_peered":"2024-04-25T10:29:17.227977+0000","last_clean":"2024-04-25T10:29:17.227977+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:29:17.227977+0000","last_undegraded":"2024-04-25T10:29:17.227977+0000","last_fullsized":"2024-04-25T10:29:17.227977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-25T10:29:17.227756+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-25T10:29:17.227756+0000","last_clean_scrub_stamp":"2024-04-25T10:29:17.227756+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:57.353028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.146231+0000","last_change":"2024-04-25T10:29:09.146310+0000","last_active":"2024-04-25T10:29:09.146231+0000","last_peered":"2024-04-25T10:29:09.146231+0000","last_clean":"2024-04-25T10:29:09.146231+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:29:09.146231+0000","last_undegraded":"2024-04-25T10:29:09.146231+0000","last_fullsized":"2024-04-25T10:29:09.146231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:09.146020+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:09.146020+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.146020+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:29.099742+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.947442+0000","last_change":"2024-04-25T10:29:10.947489+0000","last_active":"2024-04-25T10:29:10.947442+0000","last_peered":"2024-04-25T10:29:10.947442+0000","last_clean":"2024-04-25T10:29:10.947442+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:29:10.947442+0000","last_undegraded":"2024-04-25T10:29:10.947442+0000","last_fullsized":"2024-04-25T10:29:10.947442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:10.947313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:10.947313+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.947313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:08.404762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.956117+0000","last_change":"2024-04-25T10:29:07.956147+0000","last_active":"2024-04-25T10:29:07.956117+0000","last_peered":"2024-04-25T10:29:07.956117+0000","last_clean":"2024-04-25T10:29:07.956117+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:29:07.956117+0000","last_undegraded":"2024-04-25T10:29:07.956117+0000","last_fullsized":"2024-04-25T10:29:07.956117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:07.956001+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:07.956001+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.956001+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:15.200107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'10","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.332574+0000","last_change":"2024-04-25T10:29:03.332647+0000","last_active":"2024-04-25T10:29:03.332574+0000","last_peered":"2024-04-25T10:29:03.332574+0000","last_clean":"2024-04-25T10:29:03.332574+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:29:03.332574+0000","last_undegraded":"2024-04-25T10:29:03.332574+0000","last_fullsized":"2024-04-25T10:29:03.332574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:03.332466+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:03.332466+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.332466+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:30.093197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:19.227012+0000","last_change":"2024-04-25T10:29:19.227092+0000","last_active":"2024-04-25T10:29:19.227012+0000","last_peered":"2024-04-25T10:29:19.227012+0000","last_clean":"2024-04-25T10:29:19.227012+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:29:19.227012+0000","last_undegraded":"2024-04-25T10:29:19.227012+0000","last_fullsized":"2024-04-25T10:29:19.227012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:19.226737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:19.226737+0000","last_clean_scrub_stamp":"2024-04-25T10:29:19.226737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.205773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.724783+0000","last_change":"2024-04-25T10:29:04.724851+0000","last_active":"2024-04-25T10:29:04.724783+0000","last_peered":"2024-04-25T10:29:04.724783+0000","last_clean":"2024-04-25T10:29:04.724783+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:29:04.724783+0000","last_undegraded":"2024-04-25T10:29:04.724783+0000","last_fullsized":"2024-04-25T10:29:04.724783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:04.724573+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:04.724573+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.724573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:15.036830+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'31","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.281097+0000","last_change":"2024-04-25T10:28:57.281154+0000","last_active":"2024-04-25T10:28:57.281097+0000","last_peered":"2024-04-25T10:28:57.281097+0000","last_clean":"2024-04-25T10:28:57.281097+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:28:57.281097+0000","last_undegraded":"2024-04-25T10:28:57.281097+0000","last_fullsized":"2024-04-25T10:28:57.281097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-25T10:28:57.280949+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-25T10:28:57.280949+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.280949+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:57.934071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:13.780429+0000","last_change":"2024-04-25T10:29:13.780463+0000","last_active":"2024-04-25T10:29:13.780429+0000","last_peered":"2024-04-25T10:29:13.780429+0000","last_clean":"2024-04-25T10:29:13.780429+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:29:13.780429+0000","last_undegraded":"2024-04-25T10:29:13.780429+0000","last_fullsized":"2024-04-25T10:29:13.780429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:29:13.780320+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:29:13.780320+0000","last_clean_scrub_stamp":"2024-04-25T10:29:13.780320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:25.509980+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.273291+0000","last_change":"2024-04-25T10:29:01.273340+0000","last_active":"2024-04-25T10:29:01.273291+0000","last_peered":"2024-04-25T10:29:01.273291+0000","last_clean":"2024-04-25T10:29:01.273291+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:29:01.273291+0000","last_undegraded":"2024-04-25T10:29:01.273291+0000","last_fullsized":"2024-04-25T10:29:01.273291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-25T10:29:01.273160+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-25T10:29:01.273160+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.273160+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:52.969965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.335282+0000","last_change":"2024-04-25T10:29:01.335322+0000","last_active":"2024-04-25T10:29:01.335282+0000","last_peered":"2024-04-25T10:29:01.335282+0000","last_clean":"2024-04-25T10:29:01.335282+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:29:01.335282+0000","last_undegraded":"2024-04-25T10:29:01.335282+0000","last_fullsized":"2024-04-25T10:29:01.335282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:01.335172+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:01.335172+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.335172+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:07.125699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.331189+0000","last_change":"2024-04-25T10:29:11.331257+0000","last_active":"2024-04-25T10:29:11.331189+0000","last_peered":"2024-04-25T10:29:11.331189+0000","last_clean":"2024-04-25T10:29:11.331189+0000","last_became_active":"2024-04-25T10:26:18.708320+0000","last_became_peered":"2024-04-25T10:26:18.708320+0000","last_unstale":"2024-04-25T10:29:11.331189+0000","last_undegraded":"2024-04-25T10:29:11.331189+0000","last_fullsized":"2024-04-25T10:29:11.331189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:11.330974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:11.330974+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.330974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:10.282305+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,7],"acting":[2,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.926702+0000","last_change":"2024-04-25T10:29:11.926732+0000","last_active":"2024-04-25T10:29:11.926702+0000","last_peered":"2024-04-25T10:29:11.926702+0000","last_clean":"2024-04-25T10:29:11.926702+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:29:11.926702+0000","last_undegraded":"2024-04-25T10:29:11.926702+0000","last_fullsized":"2024-04-25T10:29:11.926702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:11.926583+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:11.926583+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.926583+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:23.112121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.668746+0000","last_change":"2024-04-25T10:28:58.668801+0000","last_active":"2024-04-25T10:28:58.668746+0000","last_peered":"2024-04-25T10:28:58.668746+0000","last_clean":"2024-04-25T10:28:58.668746+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:28:58.668746+0000","last_undegraded":"2024-04-25T10:28:58.668746+0000","last_fullsized":"2024-04-25T10:28:58.668746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:28:58.668621+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:28:58.668621+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.668621+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:59.770861+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.364970+0000","last_change":"2024-04-25T10:29:08.365004+0000","last_active":"2024-04-25T10:29:08.364970+0000","last_peered":"2024-04-25T10:29:08.364970+0000","last_clean":"2024-04-25T10:29:08.364970+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:29:08.364970+0000","last_undegraded":"2024-04-25T10:29:08.364970+0000","last_fullsized":"2024-04-25T10:29:08.364970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:08.364859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:08.364859+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.364859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:22.242350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.316800+0000","last_change":"2024-04-25T10:29:02.316948+0000","last_active":"2024-04-25T10:29:02.316800+0000","last_peered":"2024-04-25T10:29:02.316800+0000","last_clean":"2024-04-25T10:29:02.316800+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:29:02.316800+0000","last_undegraded":"2024-04-25T10:29:02.316800+0000","last_fullsized":"2024-04-25T10:29:02.316800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:02.316468+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:02.316468+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.316468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:32.563033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:56.590175+0000","last_change":"2024-04-25T10:28:56.590227+0000","last_active":"2024-04-25T10:28:56.590175+0000","last_peered":"2024-04-25T10:28:56.590175+0000","last_clean":"2024-04-25T10:28:56.590175+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:28:56.590175+0000","last_undegraded":"2024-04-25T10:28:56.590175+0000","last_fullsized":"2024-04-25T10:28:56.590175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:28:56.590042+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:28:56.590042+0000","last_clean_scrub_stamp":"2024-04-25T10:28:56.590042+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:00.077883+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:14.774633+0000","last_change":"2024-04-25T10:29:14.774661+0000","last_active":"2024-04-25T10:29:14.774633+0000","last_peered":"2024-04-25T10:29:14.774633+0000","last_clean":"2024-04-25T10:29:14.774633+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:29:14.774633+0000","last_undegraded":"2024-04-25T10:29:14.774633+0000","last_fullsized":"2024-04-25T10:29:14.774633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:14.774495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:14.774495+0000","last_clean_scrub_stamp":"2024-04-25T10:29:14.774495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:25.960034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.770445+0000","last_change":"2024-04-25T10:29:11.770473+0000","last_active":"2024-04-25T10:29:11.770445+0000","last_peered":"2024-04-25T10:29:11.770445+0000","last_clean":"2024-04-25T10:29:11.770445+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:29:11.770445+0000","last_undegraded":"2024-04-25T10:29:11.770445+0000","last_fullsized":"2024-04-25T10:29:11.770445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:11.770343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:11.770343+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.770343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:34.170692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.713672+0000","last_change":"2024-04-25T10:29:07.713700+0000","last_active":"2024-04-25T10:29:07.713672+0000","last_peered":"2024-04-25T10:29:07.713672+0000","last_clean":"2024-04-25T10:29:07.713672+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:29:07.713672+0000","last_undegraded":"2024-04-25T10:29:07.713672+0000","last_fullsized":"2024-04-25T10:29:07.713672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:07.713580+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:07.713580+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.713580+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:41.094550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:13.167226+0000","last_change":"2024-04-25T10:29:13.167312+0000","last_active":"2024-04-25T10:29:13.167226+0000","last_peered":"2024-04-25T10:29:13.167226+0000","last_clean":"2024-04-25T10:29:13.167226+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:29:13.167226+0000","last_undegraded":"2024-04-25T10:29:13.167226+0000","last_fullsized":"2024-04-25T10:29:13.167226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-04-25T10:29:13.166984+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-04-25T10:29:13.166984+0000","last_clean_scrub_stamp":"2024-04-25T10:29:13.166984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:58.398965+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:27:49.655838+0000","last_change":"2024-04-25T10:25:41.260553+0000","last_active":"2024-04-25T10:27:49.655838+0000","last_peered":"2024-04-25T10:27:49.655838+0000","last_clean":"2024-04-25T10:27:49.655838+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:27:49.655838+0000","last_undegraded":"2024-04-25T10:27:49.655838+0000","last_fullsized":"2024-04-25T10:27:49.655838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:25:40.188887+0000","last_clean_scrub_stamp":"2024-04-25T10:25:40.188887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.957557+0000","last_change":"2024-04-25T10:29:09.957586+0000","last_active":"2024-04-25T10:29:09.957557+0000","last_peered":"2024-04-25T10:29:09.957557+0000","last_clean":"2024-04-25T10:29:09.957557+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:29:09.957557+0000","last_undegraded":"2024-04-25T10:29:09.957557+0000","last_fullsized":"2024-04-25T10:29:09.957557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:09.957466+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:09.957466+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.957466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:51.955541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.939905+0000","last_change":"2024-04-25T10:29:00.939940+0000","last_active":"2024-04-25T10:29:00.939905+0000","last_peered":"2024-04-25T10:29:00.939905+0000","last_clean":"2024-04-25T10:29:00.939905+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:29:00.939905+0000","last_undegraded":"2024-04-25T10:29:00.939905+0000","last_fullsized":"2024-04-25T10:29:00.939905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:29:00.939802+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:29:00.939802+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.939802+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:05.337267+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.163550+0000","last_change":"2024-04-25T10:29:06.163699+0000","last_active":"2024-04-25T10:29:06.163550+0000","last_peered":"2024-04-25T10:29:06.163550+0000","last_clean":"2024-04-25T10:29:06.163550+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:29:06.163550+0000","last_undegraded":"2024-04-25T10:29:06.163550+0000","last_fullsized":"2024-04-25T10:29:06.163550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T10:29:06.163257+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T10:29:06.163257+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.163257+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:52.003109+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.725932+0000","last_change":"2024-04-25T10:29:08.725962+0000","last_active":"2024-04-25T10:29:08.725932+0000","last_peered":"2024-04-25T10:29:08.725932+0000","last_clean":"2024-04-25T10:29:08.725932+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:29:08.725932+0000","last_undegraded":"2024-04-25T10:29:08.725932+0000","last_fullsized":"2024-04-25T10:29:08.725932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:08.725831+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:08.725831+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.725831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:27.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.775520+0000","last_change":"2024-04-25T10:29:10.775585+0000","last_active":"2024-04-25T10:29:10.775520+0000","last_peered":"2024-04-25T10:29:10.775520+0000","last_clean":"2024-04-25T10:29:10.775520+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:29:10.775520+0000","last_undegraded":"2024-04-25T10:29:10.775520+0000","last_fullsized":"2024-04-25T10:29:10.775520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:10.775395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:10.775395+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.775395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:02.472200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.053091+0000","last_change":"2024-04-25T10:29:05.053144+0000","last_active":"2024-04-25T10:29:05.053091+0000","last_peered":"2024-04-25T10:29:05.053091+0000","last_clean":"2024-04-25T10:29:05.053091+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:29:05.053091+0000","last_undegraded":"2024-04-25T10:29:05.053091+0000","last_fullsized":"2024-04-25T10:29:05.053091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:05.052957+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:05.052957+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.052957+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:45.678007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.528082+0000","last_change":"2024-04-25T10:28:58.528153+0000","last_active":"2024-04-25T10:28:58.528082+0000","last_peered":"2024-04-25T10:28:58.528082+0000","last_clean":"2024-04-25T10:28:58.528082+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:28:58.528082+0000","last_undegraded":"2024-04-25T10:28:58.528082+0000","last_fullsized":"2024-04-25T10:28:58.528082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:28:58.527876+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:28:58.527876+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.527876+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:49.562543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.355356+0000","last_change":"2024-04-25T10:29:10.355387+0000","last_active":"2024-04-25T10:29:10.355356+0000","last_peered":"2024-04-25T10:29:10.355356+0000","last_clean":"2024-04-25T10:29:10.355356+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:29:10.355356+0000","last_undegraded":"2024-04-25T10:29:10.355356+0000","last_fullsized":"2024-04-25T10:29:10.355356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:10.355216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:10.355216+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.355216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:45.009509+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.343609+0000","last_change":"2024-04-25T10:29:01.343753+0000","last_active":"2024-04-25T10:29:01.343609+0000","last_peered":"2024-04-25T10:29:01.343609+0000","last_clean":"2024-04-25T10:29:01.343609+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:29:01.343609+0000","last_undegraded":"2024-04-25T10:29:01.343609+0000","last_fullsized":"2024-04-25T10:29:01.343609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:01.343344+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:01.343344+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.343344+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:05.426626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.327579+0000","last_change":"2024-04-25T10:29:05.327606+0000","last_active":"2024-04-25T10:29:05.327579+0000","last_peered":"2024-04-25T10:29:05.327579+0000","last_clean":"2024-04-25T10:29:05.327579+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:29:05.327579+0000","last_undegraded":"2024-04-25T10:29:05.327579+0000","last_fullsized":"2024-04-25T10:29:05.327579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-25T10:29:05.327469+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-25T10:29:05.327469+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.327469+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:53.313421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.277166+0000","last_change":"2024-04-25T10:29:02.277241+0000","last_active":"2024-04-25T10:29:02.277166+0000","last_peered":"2024-04-25T10:29:02.277166+0000","last_clean":"2024-04-25T10:29:02.277166+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:29:02.277166+0000","last_undegraded":"2024-04-25T10:29:02.277166+0000","last_fullsized":"2024-04-25T10:29:02.277166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:02.276957+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:02.276957+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.276957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:24.677305+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.999418+0000","last_change":"2024-04-25T10:29:06.999465+0000","last_active":"2024-04-25T10:29:06.999418+0000","last_peered":"2024-04-25T10:29:06.999418+0000","last_clean":"2024-04-25T10:29:06.999418+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:29:06.999418+0000","last_undegraded":"2024-04-25T10:29:06.999418+0000","last_fullsized":"2024-04-25T10:29:06.999418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:06.999293+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:06.999293+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.999293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:25.644920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:13.888338+0000","last_change":"2024-04-25T10:29:13.888388+0000","last_active":"2024-04-25T10:29:13.888338+0000","last_peered":"2024-04-25T10:29:13.888338+0000","last_clean":"2024-04-25T10:29:13.888338+0000","last_became_active":"2024-04-25T10:26:18.698625+0000","last_became_peered":"2024-04-25T10:26:18.698625+0000","last_unstale":"2024-04-25T10:29:13.888338+0000","last_undegraded":"2024-04-25T10:29:13.888338+0000","last_fullsized":"2024-04-25T10:29:13.888338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T10:29:13.888193+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T10:29:13.888193+0000","last_clean_scrub_stamp":"2024-04-25T10:29:13.888193+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:55.886269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.930374+0000","last_change":"2024-04-25T10:29:03.930415+0000","last_active":"2024-04-25T10:29:03.930374+0000","last_peered":"2024-04-25T10:29:03.930374+0000","last_clean":"2024-04-25T10:29:03.930374+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:29:03.930374+0000","last_undegraded":"2024-04-25T10:29:03.930374+0000","last_fullsized":"2024-04-25T10:29:03.930374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:03.930273+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:03.930273+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.930273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:08.013555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.300970+0000","last_change":"2024-04-25T10:29:03.301048+0000","last_active":"2024-04-25T10:29:03.300970+0000","last_peered":"2024-04-25T10:29:03.300970+0000","last_clean":"2024-04-25T10:29:03.300970+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:29:03.300970+0000","last_undegraded":"2024-04-25T10:29:03.300970+0000","last_fullsized":"2024-04-25T10:29:03.300970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-25T10:29:03.300773+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-25T10:29:03.300773+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.300773+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:04.403012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.928587+0000","last_change":"2024-04-25T10:29:10.928617+0000","last_active":"2024-04-25T10:29:10.928587+0000","last_peered":"2024-04-25T10:29:10.928587+0000","last_clean":"2024-04-25T10:29:10.928587+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:29:10.928587+0000","last_undegraded":"2024-04-25T10:29:10.928587+0000","last_fullsized":"2024-04-25T10:29:10.928587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:29:10.928494+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:29:10.928494+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.928494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:22.658153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.213873+0000","last_change":"2024-04-25T10:29:04.213949+0000","last_active":"2024-04-25T10:29:04.213873+0000","last_peered":"2024-04-25T10:29:04.213873+0000","last_clean":"2024-04-25T10:29:04.213873+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:29:04.213873+0000","last_undegraded":"2024-04-25T10:29:04.213873+0000","last_fullsized":"2024-04-25T10:29:04.213873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:04.213655+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:04.213655+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.213655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:15.943315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:12.894685+0000","last_change":"2024-04-25T10:29:12.894761+0000","last_active":"2024-04-25T10:29:12.894685+0000","last_peered":"2024-04-25T10:29:12.894685+0000","last_clean":"2024-04-25T10:29:12.894685+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:29:12.894685+0000","last_undegraded":"2024-04-25T10:29:12.894685+0000","last_fullsized":"2024-04-25T10:29:12.894685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:12.894557+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:12.894557+0000","last_clean_scrub_stamp":"2024-04-25T10:29:12.894557+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:33.342795+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.513734+0000","last_change":"2024-04-25T10:29:00.513785+0000","last_active":"2024-04-25T10:29:00.513734+0000","last_peered":"2024-04-25T10:29:00.513734+0000","last_clean":"2024-04-25T10:29:00.513734+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:29:00.513734+0000","last_undegraded":"2024-04-25T10:29:00.513734+0000","last_fullsized":"2024-04-25T10:29:00.513734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:00.513590+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:00.513590+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.513590+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:01.166712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.767510+0000","last_change":"2024-04-25T10:29:09.767551+0000","last_active":"2024-04-25T10:29:09.767510+0000","last_peered":"2024-04-25T10:29:09.767510+0000","last_clean":"2024-04-25T10:29:09.767510+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:29:09.767510+0000","last_undegraded":"2024-04-25T10:29:09.767510+0000","last_fullsized":"2024-04-25T10:29:09.767510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-25T10:29:09.767413+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-25T10:29:09.767413+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.767413+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:20.732770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.716566+0000","last_change":"2024-04-25T10:29:05.716637+0000","last_active":"2024-04-25T10:29:05.716566+0000","last_peered":"2024-04-25T10:29:05.716566+0000","last_clean":"2024-04-25T10:29:05.716566+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:29:05.716566+0000","last_undegraded":"2024-04-25T10:29:05.716566+0000","last_fullsized":"2024-04-25T10:29:05.716566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:05.716330+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:05.716330+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.716330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:03.982715+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.282786+0000","last_change":"2024-04-25T10:28:59.282844+0000","last_active":"2024-04-25T10:28:59.282786+0000","last_peered":"2024-04-25T10:28:59.282786+0000","last_clean":"2024-04-25T10:28:59.282786+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:28:59.282786+0000","last_undegraded":"2024-04-25T10:28:59.282786+0000","last_fullsized":"2024-04-25T10:28:59.282786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:28:59.282645+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:28:59.282645+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.282645+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:17.928272+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.298901+0000","last_change":"2024-04-25T10:29:06.298940+0000","last_active":"2024-04-25T10:29:06.298901+0000","last_peered":"2024-04-25T10:29:06.298901+0000","last_clean":"2024-04-25T10:29:06.298901+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:29:06.298901+0000","last_undegraded":"2024-04-25T10:29:06.298901+0000","last_fullsized":"2024-04-25T10:29:06.298901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:06.298792+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:06.298792+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.298792+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:10.696257+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:15.206226+0000","last_change":"2024-04-25T10:29:15.206363+0000","last_active":"2024-04-25T10:29:15.206226+0000","last_peered":"2024-04-25T10:29:15.206226+0000","last_clean":"2024-04-25T10:29:15.206226+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:29:15.206226+0000","last_undegraded":"2024-04-25T10:29:15.206226+0000","last_fullsized":"2024-04-25T10:29:15.206226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:15.205890+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:15.205890+0000","last_clean_scrub_stamp":"2024-04-25T10:29:15.205890+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:16.536941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.248969+0000","last_change":"2024-04-25T10:29:03.249045+0000","last_active":"2024-04-25T10:29:03.248969+0000","last_peered":"2024-04-25T10:29:03.248969+0000","last_clean":"2024-04-25T10:29:03.248969+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:29:03.248969+0000","last_undegraded":"2024-04-25T10:29:03.248969+0000","last_fullsized":"2024-04-25T10:29:03.248969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:03.248741+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:03.248741+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.248741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:01.100929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.029604+0000","last_change":"2024-04-25T10:29:00.029651+0000","last_active":"2024-04-25T10:29:00.029604+0000","last_peered":"2024-04-25T10:29:00.029604+0000","last_clean":"2024-04-25T10:29:00.029604+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:29:00.029604+0000","last_undegraded":"2024-04-25T10:29:00.029604+0000","last_fullsized":"2024-04-25T10:29:00.029604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:00.029501+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:00.029501+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.029501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:30.276066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.977371+0000","last_change":"2024-04-25T10:29:02.977402+0000","last_active":"2024-04-25T10:29:02.977371+0000","last_peered":"2024-04-25T10:29:02.977371+0000","last_clean":"2024-04-25T10:29:02.977371+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:29:02.977371+0000","last_undegraded":"2024-04-25T10:29:02.977371+0000","last_fullsized":"2024-04-25T10:29:02.977371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:02.977260+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:02.977260+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.977260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:16.854752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.952186+0000","last_change":"2024-04-25T10:29:06.952237+0000","last_active":"2024-04-25T10:29:06.952186+0000","last_peered":"2024-04-25T10:29:06.952186+0000","last_clean":"2024-04-25T10:29:06.952186+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:29:06.952186+0000","last_undegraded":"2024-04-25T10:29:06.952186+0000","last_fullsized":"2024-04-25T10:29:06.952186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:06.952066+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:06.952066+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.952066+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:46.512747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.714261+0000","last_change":"2024-04-25T10:29:07.714387+0000","last_active":"2024-04-25T10:29:07.714261+0000","last_peered":"2024-04-25T10:29:07.714261+0000","last_clean":"2024-04-25T10:29:07.714261+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:29:07.714261+0000","last_undegraded":"2024-04-25T10:29:07.714261+0000","last_fullsized":"2024-04-25T10:29:07.714261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:07.713999+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:07.713999+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.713999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:03.808249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.758382+0000","last_change":"2024-04-25T10:29:08.758553+0000","last_active":"2024-04-25T10:29:08.758382+0000","last_peered":"2024-04-25T10:29:08.758382+0000","last_clean":"2024-04-25T10:29:08.758382+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:29:08.758382+0000","last_undegraded":"2024-04-25T10:29:08.758382+0000","last_fullsized":"2024-04-25T10:29:08.758382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:08.758099+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:08.758099+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.758099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:15.860355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.704851+0000","last_change":"2024-04-25T10:29:10.704922+0000","last_active":"2024-04-25T10:29:10.704851+0000","last_peered":"2024-04-25T10:29:10.704851+0000","last_clean":"2024-04-25T10:29:10.704851+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:29:10.704851+0000","last_undegraded":"2024-04-25T10:29:10.704851+0000","last_fullsized":"2024-04-25T10:29:10.704851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-25T10:29:10.704645+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-25T10:29:10.704645+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.704645+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:15.161398+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.535421+0000","last_change":"2024-04-25T10:29:01.535489+0000","last_active":"2024-04-25T10:29:01.535421+0000","last_peered":"2024-04-25T10:29:01.535421+0000","last_clean":"2024-04-25T10:29:01.535421+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:29:01.535421+0000","last_undegraded":"2024-04-25T10:29:01.535421+0000","last_fullsized":"2024-04-25T10:29:01.535421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-25T10:29:01.535216+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-25T10:29:01.535216+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.535216+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:29.013861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.017215+0000","last_change":"2024-04-25T10:28:59.017255+0000","last_active":"2024-04-25T10:28:59.017215+0000","last_peered":"2024-04-25T10:28:59.017215+0000","last_clean":"2024-04-25T10:28:59.017215+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:28:59.017215+0000","last_undegraded":"2024-04-25T10:28:59.017215+0000","last_fullsized":"2024-04-25T10:28:59.017215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:28:59.017103+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:28:59.017103+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.017103+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.100385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.744615+0000","last_change":"2024-04-25T10:29:02.744687+0000","last_active":"2024-04-25T10:29:02.744615+0000","last_peered":"2024-04-25T10:29:02.744615+0000","last_clean":"2024-04-25T10:29:02.744615+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:29:02.744615+0000","last_undegraded":"2024-04-25T10:29:02.744615+0000","last_fullsized":"2024-04-25T10:29:02.744615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:02.744366+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:02.744366+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.744366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:06.347015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.371887+0000","last_change":"2024-04-25T10:29:00.371936+0000","last_active":"2024-04-25T10:29:00.371887+0000","last_peered":"2024-04-25T10:29:00.371887+0000","last_clean":"2024-04-25T10:29:00.371887+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:29:00.371887+0000","last_undegraded":"2024-04-25T10:29:00.371887+0000","last_fullsized":"2024-04-25T10:29:00.371887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:00.371763+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:00.371763+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.371763+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:11.379770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.748768+0000","last_change":"2024-04-25T10:29:03.748840+0000","last_active":"2024-04-25T10:29:03.748768+0000","last_peered":"2024-04-25T10:29:03.748768+0000","last_clean":"2024-04-25T10:29:03.748768+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:29:03.748768+0000","last_undegraded":"2024-04-25T10:29:03.748768+0000","last_fullsized":"2024-04-25T10:29:03.748768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T10:29:03.748562+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T10:29:03.748562+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.748562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:37.129531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.324459+0000","last_change":"2024-04-25T10:28:59.324497+0000","last_active":"2024-04-25T10:28:59.324459+0000","last_peered":"2024-04-25T10:28:59.324459+0000","last_clean":"2024-04-25T10:28:59.324459+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:28:59.324459+0000","last_undegraded":"2024-04-25T10:28:59.324459+0000","last_fullsized":"2024-04-25T10:28:59.324459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:28:59.324348+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:28:59.324348+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.324348+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:58.225226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.956605+0000","last_change":"2024-04-25T10:29:08.956635+0000","last_active":"2024-04-25T10:29:08.956605+0000","last_peered":"2024-04-25T10:29:08.956605+0000","last_clean":"2024-04-25T10:29:08.956605+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:29:08.956605+0000","last_undegraded":"2024-04-25T10:29:08.956605+0000","last_fullsized":"2024-04-25T10:29:08.956605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:08.956514+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:08.956514+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.956514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:31.356862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.004170+0000","last_change":"2024-04-25T10:29:08.004198+0000","last_active":"2024-04-25T10:29:08.004170+0000","last_peered":"2024-04-25T10:29:08.004170+0000","last_clean":"2024-04-25T10:29:08.004170+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:29:08.004170+0000","last_undegraded":"2024-04-25T10:29:08.004170+0000","last_fullsized":"2024-04-25T10:29:08.004170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T10:29:08.004066+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T10:29:08.004066+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.004066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:18.969424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.722529+0000","last_change":"2024-04-25T10:29:09.722604+0000","last_active":"2024-04-25T10:29:09.722529+0000","last_peered":"2024-04-25T10:29:09.722529+0000","last_clean":"2024-04-25T10:29:09.722529+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:29:09.722529+0000","last_undegraded":"2024-04-25T10:29:09.722529+0000","last_fullsized":"2024-04-25T10:29:09.722529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:09.722300+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:09.722300+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.722300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:59.923992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":41301,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":77,"num_read_kb":80,"num_write":170,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":82602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":122200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":712464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":159727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":158193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":892928,"data_stored":711408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:29:21.900 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:21.901 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:21.901 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T10:25:40.188887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=25, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=28, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:29:21.902 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T10:29:30.770 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:29:30.779 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:29:41.903 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:29:42.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.195+0000 7fdabe400640 1 Processor -- start 2024-04-25T10:29:42.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.195+0000 7fdabe400640 1 -- start start 2024-04-25T10:29:42.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.197+0000 7fdabe400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdab80c7f90 0x7fdab8073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.198+0000 7fdabe400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab80cac80 0x7fdab8073b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.198+0000 7fdabe400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab815a8b0 con 0x7fdab815a370 2024-04-25T10:29:42.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.198+0000 7fdabe400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdab8070f70 con 0x7fdab80c7f90 2024-04-25T10:29:42.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.198+0000 7fdabe400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdab8072ea0 con 0x7fdab80cac80 2024-04-25T10:29:42.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.198+0000 7fdabda00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab80cac80 0x7fdab8073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.198+0000 7fdab7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdab80c7f90 0x7fdab8073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.198+0000 7fdabd000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdab815a370 0x7fdab8070860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:37342/0 (socket says 172.21.15.19:37342) 2024-04-25T10:29:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.198+0000 7fdabd000640 1 -- 172.21.15.19:0/749302702 learned_addr learned my addr 172.21.15.19:0/749302702 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:29:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.198+0000 7fdabda00640 1 -- 172.21.15.19:0/749302702 >> v2:172.21.15.112:3300/0 conn(0x7fdab80c7f90 msgr2=0x7fdab8073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:29:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.199+0000 7fdabda00640 1 --2- 172.21.15.19:0/749302702 >> v2:172.21.15.112:3300/0 conn(0x7fdab80c7f90 0x7fdab8073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.198+0000 7fdab7400640 1 -- 172.21.15.19:0/749302702 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1529245085 0 0) 0x7fdab815a8b0 con 0x7fdab815a370 2024-04-25T10:29:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.199+0000 7fdabda00640 1 -- 172.21.15.19:0/749302702 >> v1:172.21.15.112:6789/0 conn(0x7fdab815a370 legacy=0x7fdab8070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.199+0000 7fdabda00640 1 -- 172.21.15.19:0/749302702 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab815ab70 con 0x7fdab80cac80 2024-04-25T10:29:42.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.199+0000 7fdab7e00640 1 --2- 172.21.15.19:0/749302702 >> v2:172.21.15.112:3300/0 conn(0x7fdab80c7f90 0x7fdab8073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.200+0000 7fdabda00640 1 --2- 172.21.15.19:0/749302702 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab80cac80 0x7fdab8073b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009d90 tx=0x7fdab002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4dd5f9cefedb0af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.200+0000 7fdab7400640 1 -- 172.21.15.19:0/749302702 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab0031600 con 0x7fdab80cac80 2024-04-25T10:29:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.200+0000 7fdab7400640 1 -- 172.21.15.19:0/749302702 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab00317a0 con 0x7fdab80cac80 2024-04-25T10:29:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.200+0000 7fdab7400640 1 -- 172.21.15.19:0/749302702 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab0031b70 con 0x7fdab80cac80 2024-04-25T10:29:42.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.201+0000 7fdabe400640 1 -- 172.21.15.19:0/749302702 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab80cac80 msgr2=0x7fdab8073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.201+0000 7fdabe400640 1 --2- 172.21.15.19:0/749302702 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab80cac80 0x7fdab8073b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009d90 tx=0x7fdab002a5d0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.201+0000 7fdabe400640 1 -- 172.21.15.19:0/749302702 shutdown_connections 2024-04-25T10:29:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.201+0000 7fdabe400640 1 --2- 172.21.15.19:0/749302702 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab80cac80 0x7fdab8073b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.201+0000 7fdabe400640 1 --2- 172.21.15.19:0/749302702 >> v2:172.21.15.112:3300/0 conn(0x7fdab80c7f90 0x7fdab8073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.201+0000 7fdabe400640 1 -- 172.21.15.19:0/749302702 >> 172.21.15.19:0/749302702 conn(0x7fdab80cdbc0 msgr2=0x7fdab80ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.201+0000 7fdabe400640 1 -- 172.21.15.19:0/749302702 shutdown_connections 2024-04-25T10:29:42.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.201+0000 7fdabe400640 1 -- 172.21.15.19:0/749302702 wait complete. 2024-04-25T10:29:42.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.203+0000 7fdabe400640 1 Processor -- start 2024-04-25T10:29:42.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.203+0000 7fdabe400640 1 -- start start 2024-04-25T10:29:42.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.205+0000 7fdabe400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab80c7f90 0x7fdab81f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.205+0000 7fdabe400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab80cac80 0x7fdab81f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.205+0000 7fdabe400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdab815a370 0x7fdab8158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.205+0000 7fdabe400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdab815b130 con 0x7fdab815a370 2024-04-25T10:29:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.205+0000 7fdabe400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdab8073180 con 0x7fdab80c7f90 2024-04-25T10:29:42.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.205+0000 7fdabe400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdab80c4b20 con 0x7fdab80cac80 2024-04-25T10:29:42.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.205+0000 7fdabda00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdab815a370 0x7fdab8158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.205+0000 7fdabda00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdab815a370 0x7fdab8158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56708/0 (socket says 172.21.15.19:56708) 2024-04-25T10:29:42.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.205+0000 7fdabda00640 1 -- 172.21.15.19:0/70194887 learned_addr learned my addr 172.21.15.19:0/70194887 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.205+0000 7fdabd000640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab80c7f90 0x7fdab81f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.205+0000 7fdab7e00640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab80cac80 0x7fdab81f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.206+0000 7fdabd000640 1 -- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab80cac80 msgr2=0x7fdab81f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.206+0000 7fdabd000640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab80cac80 0x7fdab81f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.206+0000 7fdabd000640 1 -- 172.21.15.19:0/70194887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdab815a370 msgr2=0x7fdab8158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.206+0000 7fdabd000640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdab815a370 0x7fdab8158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.206+0000 7fdabd000640 1 -- 172.21.15.19:0/70194887 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab81f6750 con 0x7fdab80c7f90 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.206+0000 7fdabda00640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdab815a370 0x7fdab8158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.206+0000 7fdabd000640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab80c7f90 0x7fdab81f6210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c410 tx=0x7fdaa400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.206+0000 7fdab4c00640 1 -- 172.21.15.19:0/70194887 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40074e0 con 0x7fdab80c7f90 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.207+0000 7fdab4c00640 1 -- 172.21.15.19:0/70194887 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa40047e0 con 0x7fdab80c7f90 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.207+0000 7fdab4c00640 1 -- 172.21.15.19:0/70194887 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4004bd0 con 0x7fdab80c7f90 2024-04-25T10:29:42.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.207+0000 7fdabe400640 1 -- 172.21.15.19:0/70194887 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab81f22c0 con 0x7fdab80c7f90 2024-04-25T10:29:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.207+0000 7fdabe400640 1 -- 172.21.15.19:0/70194887 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab80c4640 con 0x7fdab80c7f90 2024-04-25T10:29:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.208+0000 7fdabe400640 1 -- 172.21.15.19:0/70194887 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab8050740 con 0x7fdab80c7f90 2024-04-25T10:29:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.209+0000 7fdab4c00640 1 -- 172.21.15.19:0/70194887 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdaa4011070 con 0x7fdab80c7f90 2024-04-25T10:29:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.210+0000 7fdab4c00640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda980744e0 0x7fda980769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.210+0000 7fdab4c00640 1 -- 172.21.15.19:0/70194887 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7fdaa4094fe0 con 0x7fdab80c7f90 2024-04-25T10:29:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.211+0000 7fdab7e00640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda980744e0 0x7fda980769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.211+0000 7fdab7e00640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda980744e0 0x7fda980769f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdab80c3300 tx=0x7fdaa8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:42.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.215+0000 7fdab4c00640 1 -- 172.21.15.19:0/70194887 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdab81f22c0 con 0x7fdab80c7f90 2024-04-25T10:29:42.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.415+0000 7fdabe400640 1 -- 172.21.15.19:0/70194887 --> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdab80c59e0 con 0x7fda980744e0 2024-04-25T10:29:42.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.425+0000 7fdab4c00640 1 -- 172.21.15.19:0/70194887 <== mgr.4109 v2:172.21.15.112:6832/228103152 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332975 (secure 0 0 0) 0x7fdab80c59e0 con 0x7fda980744e0 2024-04-25T10:29:42.433 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:29:42.435 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-04-25T10:29:42.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 -- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda980744e0 msgr2=0x7fda980769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:42.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda980744e0 0x7fda980769f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdab80c3300 tx=0x7fdaa8009190 comp rx=0 tx=0).stop 2024-04-25T10:29:42.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 -- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab80c7f90 msgr2=0x7fdab81f6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:42.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab80c7f90 0x7fdab81f6210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c410 tx=0x7fdaa400c8d0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 -- 172.21.15.19:0/70194887 shutdown_connections 2024-04-25T10:29:42.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdab815a370 0x7fdab8158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fda980744e0 0x7fda980769f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdab80cac80 0x7fdab81f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 --2- 172.21.15.19:0/70194887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab80c7f90 0x7fdab81f6210 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 -- 172.21.15.19:0/70194887 >> 172.21.15.19:0/70194887 conn(0x7fdab80cdbc0 msgr2=0x7fdab80c61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:42.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 -- 172.21.15.19:0/70194887 shutdown_connections 2024-04-25T10:29:42.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.432+0000 7fdabe400640 1 -- 172.21.15.19:0/70194887 wait complete. 2024-04-25T10:29:42.466 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-04-25T10:29:40.648113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":631669,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":273,"num_write_kb":1729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":792,"ondisk_log_size":792,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219792,"kb_used_data":3664,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754928,"statfs":{"total":773094113280,"available":772869046272,"internally_reserved":0,"allocated":3751936,"data_stored":2230378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003529"},"pg_stats":[{"pgid":"2.1f","version":"27'14","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.781596+0000","last_change":"2024-04-25T10:29:03.781661+0000","last_active":"2024-04-25T10:29:03.781596+0000","last_peered":"2024-04-25T10:29:03.781596+0000","last_clean":"2024-04-25T10:29:03.781596+0000","last_became_active":"2024-04-25T10:25:36.182374+0000","last_became_peered":"2024-04-25T10:25:36.182374+0000","last_unstale":"2024-04-25T10:29:03.781596+0000","last_undegraded":"2024-04-25T10:29:03.781596+0000","last_fullsized":"2024-04-25T10:29:03.781596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-04-25T10:29:03.781501+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-04-25T10:29:03.781501+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.781501+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:16.988962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:13.857705+0000","last_change":"2024-04-25T10:29:13.857705+0000","last_active":"2024-04-25T10:29:13.857705+0000","last_peered":"2024-04-25T10:29:13.857705+0000","last_clean":"2024-04-25T10:29:13.857705+0000","last_became_active":"2024-04-25T10:25:37.199082+0000","last_became_peered":"2024-04-25T10:25:37.199082+0000","last_unstale":"2024-04-25T10:29:13.857705+0000","last_undegraded":"2024-04-25T10:29:13.857705+0000","last_fullsized":"2024-04-25T10:29:13.857705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:13.857580+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:13.857580+0000","last_clean_scrub_stamp":"2024-04-25T10:29:13.857580+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:27.176508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.318754+0000","last_change":"2024-04-25T10:29:07.318813+0000","last_active":"2024-04-25T10:29:07.318754+0000","last_peered":"2024-04-25T10:29:07.318754+0000","last_clean":"2024-04-25T10:29:07.318754+0000","last_became_active":"2024-04-25T10:25:41.234214+0000","last_became_peered":"2024-04-25T10:25:41.234214+0000","last_unstale":"2024-04-25T10:29:07.318754+0000","last_undegraded":"2024-04-25T10:29:07.318754+0000","last_fullsized":"2024-04-25T10:29:07.318754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:07.318643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:07.318643+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.318643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:26.916351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.027739+0000","last_change":"2024-04-25T10:29:04.027739+0000","last_active":"2024-04-25T10:29:04.027739+0000","last_peered":"2024-04-25T10:29:04.027739+0000","last_clean":"2024-04-25T10:29:04.027739+0000","last_became_active":"2024-04-25T10:25:36.166238+0000","last_became_peered":"2024-04-25T10:25:36.166238+0000","last_unstale":"2024-04-25T10:29:04.027739+0000","last_undegraded":"2024-04-25T10:29:04.027739+0000","last_fullsized":"2024-04-25T10:29:04.027739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:29:04.027602+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:29:04.027602+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.027602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:46.373925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.010998+0000","last_change":"2024-04-25T10:29:01.011030+0000","last_active":"2024-04-25T10:29:01.010998+0000","last_peered":"2024-04-25T10:29:01.010998+0000","last_clean":"2024-04-25T10:29:01.010998+0000","last_became_active":"2024-04-25T10:25:37.179330+0000","last_became_peered":"2024-04-25T10:25:37.179330+0000","last_unstale":"2024-04-25T10:29:01.010998+0000","last_undegraded":"2024-04-25T10:29:01.010998+0000","last_fullsized":"2024-04-25T10:29:01.010998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:01.010891+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:01.010891+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.010891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:02.113130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.367853+0000","last_change":"2024-04-25T10:29:06.367921+0000","last_active":"2024-04-25T10:29:06.367853+0000","last_peered":"2024-04-25T10:29:06.367853+0000","last_clean":"2024-04-25T10:29:06.367853+0000","last_became_active":"2024-04-25T10:25:41.232359+0000","last_became_peered":"2024-04-25T10:25:41.232359+0000","last_unstale":"2024-04-25T10:29:06.367853+0000","last_undegraded":"2024-04-25T10:29:06.367853+0000","last_fullsized":"2024-04-25T10:29:06.367853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:06.367640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:06.367640+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.367640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:48.713963+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.718240+0000","last_change":"2024-04-25T10:28:59.718385+0000","last_active":"2024-04-25T10:28:59.718240+0000","last_peered":"2024-04-25T10:28:59.718240+0000","last_clean":"2024-04-25T10:28:59.718240+0000","last_became_active":"2024-04-25T10:25:36.189755+0000","last_became_peered":"2024-04-25T10:25:36.189755+0000","last_unstale":"2024-04-25T10:28:59.718240+0000","last_undegraded":"2024-04-25T10:28:59.718240+0000","last_fullsized":"2024-04-25T10:28:59.718240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:28:59.717991+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:28:59.717991+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.717991+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:12.925452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":7,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.513766+0000","last_change":"2024-04-25T10:28:59.513833+0000","last_active":"2024-04-25T10:28:59.513766+0000","last_peered":"2024-04-25T10:28:59.513766+0000","last_clean":"2024-04-25T10:28:59.513766+0000","last_became_active":"2024-04-25T10:25:37.191325+0000","last_became_peered":"2024-04-25T10:25:37.191325+0000","last_unstale":"2024-04-25T10:28:59.513766+0000","last_undegraded":"2024-04-25T10:28:59.513766+0000","last_fullsized":"2024-04-25T10:28:59.513766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:28:59.513540+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:28:59.513540+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.513540+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:44.778177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.402183+0000","last_change":"2024-04-25T10:29:07.402311+0000","last_active":"2024-04-25T10:29:07.402183+0000","last_peered":"2024-04-25T10:29:07.402183+0000","last_clean":"2024-04-25T10:29:07.402183+0000","last_became_active":"2024-04-25T10:25:41.242045+0000","last_became_peered":"2024-04-25T10:25:41.242045+0000","last_unstale":"2024-04-25T10:29:07.402183+0000","last_undegraded":"2024-04-25T10:29:07.402183+0000","last_fullsized":"2024-04-25T10:29:07.402183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:07.401926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:07.401926+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.401926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:48.026975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.759827+0000","last_change":"2024-04-25T10:29:00.759882+0000","last_active":"2024-04-25T10:29:00.759827+0000","last_peered":"2024-04-25T10:29:00.759827+0000","last_clean":"2024-04-25T10:29:00.759827+0000","last_became_active":"2024-04-25T10:25:36.189939+0000","last_became_peered":"2024-04-25T10:25:36.189939+0000","last_unstale":"2024-04-25T10:29:00.759827+0000","last_undegraded":"2024-04-25T10:29:00.759827+0000","last_fullsized":"2024-04-25T10:29:00.759827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:29:00.759669+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:29:00.759669+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.759669+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:32.106371+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:16.219350+0000","last_change":"2024-04-25T10:29:16.219545+0000","last_active":"2024-04-25T10:29:16.219350+0000","last_peered":"2024-04-25T10:29:16.219350+0000","last_clean":"2024-04-25T10:29:16.219350+0000","last_became_active":"2024-04-25T10:25:37.204098+0000","last_became_peered":"2024-04-25T10:25:37.204098+0000","last_unstale":"2024-04-25T10:29:16.219350+0000","last_undegraded":"2024-04-25T10:29:16.219350+0000","last_fullsized":"2024-04-25T10:29:16.219350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-25T10:29:16.219083+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-25T10:29:16.219083+0000","last_clean_scrub_stamp":"2024-04-25T10:29:16.219083+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:34.425358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.341545+0000","last_change":"2024-04-25T10:29:05.341612+0000","last_active":"2024-04-25T10:29:05.341545+0000","last_peered":"2024-04-25T10:29:05.341545+0000","last_clean":"2024-04-25T10:29:05.341545+0000","last_became_active":"2024-04-25T10:25:41.236097+0000","last_became_peered":"2024-04-25T10:25:41.236097+0000","last_unstale":"2024-04-25T10:29:05.341545+0000","last_undegraded":"2024-04-25T10:29:05.341545+0000","last_fullsized":"2024-04-25T10:29:05.341545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:05.341306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:05.341306+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.341306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:40.175396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.247590+0000","last_change":"2024-04-25T10:28:57.247636+0000","last_active":"2024-04-25T10:28:57.247590+0000","last_peered":"2024-04-25T10:28:57.247590+0000","last_clean":"2024-04-25T10:28:57.247590+0000","last_became_active":"2024-04-25T10:25:37.187231+0000","last_became_peered":"2024-04-25T10:25:37.187231+0000","last_unstale":"2024-04-25T10:28:57.247590+0000","last_undegraded":"2024-04-25T10:28:57.247590+0000","last_fullsized":"2024-04-25T10:28:57.247590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:28:57.247441+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:28:57.247441+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.247441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:39.593764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:12.154410+0000","last_change":"2024-04-25T10:29:12.154497+0000","last_active":"2024-04-25T10:29:12.154410+0000","last_peered":"2024-04-25T10:29:12.154410+0000","last_clean":"2024-04-25T10:29:12.154410+0000","last_became_active":"2024-04-25T10:25:36.184645+0000","last_became_peered":"2024-04-25T10:25:36.184645+0000","last_unstale":"2024-04-25T10:29:12.154410+0000","last_undegraded":"2024-04-25T10:29:12.154410+0000","last_fullsized":"2024-04-25T10:29:12.154410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:12.154180+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:12.154180+0000","last_clean_scrub_stamp":"2024-04-25T10:29:12.154180+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:22.591599+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:21.245494+0000","last_change":"2024-04-25T10:29:21.245612+0000","last_active":"2024-04-25T10:29:21.245494+0000","last_peered":"2024-04-25T10:29:21.245494+0000","last_clean":"2024-04-25T10:29:21.245494+0000","last_became_active":"2024-04-25T10:25:41.258634+0000","last_became_peered":"2024-04-25T10:25:41.258634+0000","last_unstale":"2024-04-25T10:29:21.245494+0000","last_undegraded":"2024-04-25T10:29:21.245494+0000","last_fullsized":"2024-04-25T10:29:21.245494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:21.245210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:21.245210+0000","last_clean_scrub_stamp":"2024-04-25T10:29:21.245210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:57.443163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.350921+0000","last_change":"2024-04-25T10:29:04.350952+0000","last_active":"2024-04-25T10:29:04.350921+0000","last_peered":"2024-04-25T10:29:04.350921+0000","last_clean":"2024-04-25T10:29:04.350921+0000","last_became_active":"2024-04-25T10:25:37.165703+0000","last_became_peered":"2024-04-25T10:25:37.165703+0000","last_unstale":"2024-04-25T10:29:04.350921+0000","last_undegraded":"2024-04-25T10:29:04.350921+0000","last_fullsized":"2024-04-25T10:29:04.350921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:04.350824+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:04.350824+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.350824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.971582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.933904+0000","last_change":"2024-04-25T10:28:59.933936+0000","last_active":"2024-04-25T10:28:59.933904+0000","last_peered":"2024-04-25T10:28:59.933904+0000","last_clean":"2024-04-25T10:28:59.933904+0000","last_became_active":"2024-04-25T10:25:36.166757+0000","last_became_peered":"2024-04-25T10:25:36.166757+0000","last_unstale":"2024-04-25T10:28:59.933904+0000","last_undegraded":"2024-04-25T10:28:59.933904+0000","last_fullsized":"2024-04-25T10:28:59.933904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:28:59.933815+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:28:59.933815+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.933815+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:27.412460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.661100+0000","last_change":"2024-04-25T10:29:11.661165+0000","last_active":"2024-04-25T10:29:11.661100+0000","last_peered":"2024-04-25T10:29:11.661100+0000","last_clean":"2024-04-25T10:29:11.661100+0000","last_became_active":"2024-04-25T10:25:41.256777+0000","last_became_peered":"2024-04-25T10:25:41.256777+0000","last_unstale":"2024-04-25T10:29:11.661100+0000","last_undegraded":"2024-04-25T10:29:11.661100+0000","last_fullsized":"2024-04-25T10:29:11.661100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:11.660885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:11.660885+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.660885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:05:17.219877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.735882+0000","last_change":"2024-04-25T10:29:04.735913+0000","last_active":"2024-04-25T10:29:04.735882+0000","last_peered":"2024-04-25T10:29:04.735882+0000","last_clean":"2024-04-25T10:29:04.735882+0000","last_became_active":"2024-04-25T10:25:37.158515+0000","last_became_peered":"2024-04-25T10:25:37.158515+0000","last_unstale":"2024-04-25T10:29:04.735882+0000","last_undegraded":"2024-04-25T10:29:04.735882+0000","last_fullsized":"2024-04-25T10:29:04.735882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:04.735777+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:04.735777+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.735777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:36.082479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.734560+0000","last_change":"2024-04-25T10:29:01.734600+0000","last_active":"2024-04-25T10:29:01.734560+0000","last_peered":"2024-04-25T10:29:01.734560+0000","last_clean":"2024-04-25T10:29:01.734560+0000","last_became_active":"2024-04-25T10:25:36.173207+0000","last_became_peered":"2024-04-25T10:25:36.173207+0000","last_unstale":"2024-04-25T10:29:01.734560+0000","last_undegraded":"2024-04-25T10:29:01.734560+0000","last_fullsized":"2024-04-25T10:29:01.734560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:01.734468+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:01.734468+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.734468+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:31.981033+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.401475+0000","last_change":"2024-04-25T10:29:09.401507+0000","last_active":"2024-04-25T10:29:09.401475+0000","last_peered":"2024-04-25T10:29:09.401475+0000","last_clean":"2024-04-25T10:29:09.401475+0000","last_became_active":"2024-04-25T10:25:41.238358+0000","last_became_peered":"2024-04-25T10:25:41.238358+0000","last_unstale":"2024-04-25T10:29:09.401475+0000","last_undegraded":"2024-04-25T10:29:09.401475+0000","last_fullsized":"2024-04-25T10:29:09.401475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:09.401377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:09.401377+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.401377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:02.128450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.268007+0000","last_change":"2024-04-25T10:28:58.268085+0000","last_active":"2024-04-25T10:28:58.268007+0000","last_peered":"2024-04-25T10:28:58.268007+0000","last_clean":"2024-04-25T10:28:58.268007+0000","last_became_active":"2024-04-25T10:25:37.193128+0000","last_became_peered":"2024-04-25T10:25:37.193128+0000","last_unstale":"2024-04-25T10:28:58.268007+0000","last_undegraded":"2024-04-25T10:28:58.268007+0000","last_fullsized":"2024-04-25T10:28:58.268007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:28:58.267794+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:28:58.267794+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.267794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:31.648763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:56.689813+0000","last_change":"2024-04-25T10:28:56.689855+0000","last_active":"2024-04-25T10:28:56.689813+0000","last_peered":"2024-04-25T10:28:56.689813+0000","last_clean":"2024-04-25T10:28:56.689813+0000","last_became_active":"2024-04-25T10:25:36.172195+0000","last_became_peered":"2024-04-25T10:25:36.172195+0000","last_unstale":"2024-04-25T10:28:56.689813+0000","last_undegraded":"2024-04-25T10:28:56.689813+0000","last_fullsized":"2024-04-25T10:28:56.689813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:28:56.689703+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:28:56.689703+0000","last_clean_scrub_stamp":"2024-04-25T10:28:56.689703+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:04.893320+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.373281+0000","last_change":"2024-04-25T10:29:10.373350+0000","last_active":"2024-04-25T10:29:10.373281+0000","last_peered":"2024-04-25T10:29:10.373281+0000","last_clean":"2024-04-25T10:29:10.373281+0000","last_became_active":"2024-04-25T10:25:41.259218+0000","last_became_peered":"2024-04-25T10:25:41.259218+0000","last_unstale":"2024-04-25T10:29:10.373281+0000","last_undegraded":"2024-04-25T10:29:10.373281+0000","last_fullsized":"2024-04-25T10:29:10.373281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:10.373068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:10.373068+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.373068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:08.639453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.733577+0000","last_change":"2024-04-25T10:29:05.733610+0000","last_active":"2024-04-25T10:29:05.733577+0000","last_peered":"2024-04-25T10:29:05.733577+0000","last_clean":"2024-04-25T10:29:05.733577+0000","last_became_active":"2024-04-25T10:25:37.159561+0000","last_became_peered":"2024-04-25T10:25:37.159561+0000","last_unstale":"2024-04-25T10:29:05.733577+0000","last_undegraded":"2024-04-25T10:29:05.733577+0000","last_fullsized":"2024-04-25T10:29:05.733577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:05.733477+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:05.733477+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.733477+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:40.567567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:14.212820+0000","last_change":"2024-04-25T10:29:14.212910+0000","last_active":"2024-04-25T10:29:14.212820+0000","last_peered":"2024-04-25T10:29:14.212820+0000","last_clean":"2024-04-25T10:29:14.212820+0000","last_became_active":"2024-04-25T10:25:36.193686+0000","last_became_peered":"2024-04-25T10:25:36.193686+0000","last_unstale":"2024-04-25T10:29:14.212820+0000","last_undegraded":"2024-04-25T10:29:14.212820+0000","last_fullsized":"2024-04-25T10:29:14.212820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:14.212595+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:14.212595+0000","last_clean_scrub_stamp":"2024-04-25T10:29:14.212595+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:51.141361+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.370040+0000","last_change":"2024-04-25T10:29:09.370106+0000","last_active":"2024-04-25T10:29:09.370040+0000","last_peered":"2024-04-25T10:29:09.370040+0000","last_clean":"2024-04-25T10:29:09.370040+0000","last_became_active":"2024-04-25T10:25:41.260668+0000","last_became_peered":"2024-04-25T10:25:41.260668+0000","last_unstale":"2024-04-25T10:29:09.370040+0000","last_undegraded":"2024-04-25T10:29:09.370040+0000","last_fullsized":"2024-04-25T10:29:09.370040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:09.369831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:09.369831+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.369831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:28.015457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.756390+0000","last_change":"2024-04-25T10:29:06.756422+0000","last_active":"2024-04-25T10:29:06.756390+0000","last_peered":"2024-04-25T10:29:06.756390+0000","last_clean":"2024-04-25T10:29:06.756390+0000","last_became_active":"2024-04-25T10:25:37.165104+0000","last_became_peered":"2024-04-25T10:25:37.165104+0000","last_unstale":"2024-04-25T10:29:06.756390+0000","last_undegraded":"2024-04-25T10:29:06.756390+0000","last_fullsized":"2024-04-25T10:29:06.756390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:06.756287+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:06.756287+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.756287+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:49.102609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'13","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.752777+0000","last_change":"2024-04-25T10:29:02.752843+0000","last_active":"2024-04-25T10:29:02.752777+0000","last_peered":"2024-04-25T10:29:02.752777+0000","last_clean":"2024-04-25T10:29:02.752777+0000","last_became_active":"2024-04-25T10:25:36.181623+0000","last_became_peered":"2024-04-25T10:25:36.181623+0000","last_unstale":"2024-04-25T10:29:02.752777+0000","last_undegraded":"2024-04-25T10:29:02.752777+0000","last_fullsized":"2024-04-25T10:29:02.752777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-25T10:29:02.752631+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-25T10:29:02.752631+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.752631+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:03.854870+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:12.747407+0000","last_change":"2024-04-25T10:29:12.747437+0000","last_active":"2024-04-25T10:29:12.747407+0000","last_peered":"2024-04-25T10:29:12.747407+0000","last_clean":"2024-04-25T10:29:12.747407+0000","last_became_active":"2024-04-25T10:25:41.246201+0000","last_became_peered":"2024-04-25T10:25:41.246201+0000","last_unstale":"2024-04-25T10:29:12.747407+0000","last_undegraded":"2024-04-25T10:29:12.747407+0000","last_fullsized":"2024-04-25T10:29:12.747407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:12.747296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:12.747296+0000","last_clean_scrub_stamp":"2024-04-25T10:29:12.747296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:54.745372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.945174+0000","last_change":"2024-04-25T10:29:04.945227+0000","last_active":"2024-04-25T10:29:04.945174+0000","last_peered":"2024-04-25T10:29:04.945174+0000","last_clean":"2024-04-25T10:29:04.945174+0000","last_became_active":"2024-04-25T10:25:37.170370+0000","last_became_peered":"2024-04-25T10:25:37.170370+0000","last_unstale":"2024-04-25T10:29:04.945174+0000","last_undegraded":"2024-04-25T10:29:04.945174+0000","last_fullsized":"2024-04-25T10:29:04.945174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:04.945032+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:04.945032+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.945032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:35.191598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.110293+0000","last_change":"2024-04-25T10:29:08.110376+0000","last_active":"2024-04-25T10:29:08.110293+0000","last_peered":"2024-04-25T10:29:08.110293+0000","last_clean":"2024-04-25T10:29:08.110293+0000","last_became_active":"2024-04-25T10:25:36.184454+0000","last_became_peered":"2024-04-25T10:25:36.184454+0000","last_unstale":"2024-04-25T10:29:08.110293+0000","last_undegraded":"2024-04-25T10:29:08.110293+0000","last_fullsized":"2024-04-25T10:29:08.110293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:29:08.110083+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:29:08.110083+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.110083+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:53.229735+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.906600+0000","last_change":"2024-04-25T10:29:09.906631+0000","last_active":"2024-04-25T10:29:09.906600+0000","last_peered":"2024-04-25T10:29:09.906600+0000","last_clean":"2024-04-25T10:29:09.906600+0000","last_became_active":"2024-04-25T10:25:41.244490+0000","last_became_peered":"2024-04-25T10:25:41.244490+0000","last_unstale":"2024-04-25T10:29:09.906600+0000","last_undegraded":"2024-04-25T10:29:09.906600+0000","last_fullsized":"2024-04-25T10:29:09.906600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:09.906492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:09.906492+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.906492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:50.531542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.321741+0000","last_change":"2024-04-25T10:28:58.321787+0000","last_active":"2024-04-25T10:28:58.321741+0000","last_peered":"2024-04-25T10:28:58.321741+0000","last_clean":"2024-04-25T10:28:58.321741+0000","last_became_active":"2024-04-25T10:25:37.181267+0000","last_became_peered":"2024-04-25T10:25:37.181267+0000","last_unstale":"2024-04-25T10:28:58.321741+0000","last_undegraded":"2024-04-25T10:28:58.321741+0000","last_fullsized":"2024-04-25T10:28:58.321741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:28:58.321649+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:28:58.321649+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.321649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:22.455633+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.982456+0000","last_change":"2024-04-25T10:29:02.982481+0000","last_active":"2024-04-25T10:29:02.982456+0000","last_peered":"2024-04-25T10:29:02.982456+0000","last_clean":"2024-04-25T10:29:02.982456+0000","last_became_active":"2024-04-25T10:25:36.166036+0000","last_became_peered":"2024-04-25T10:25:36.166036+0000","last_unstale":"2024-04-25T10:29:02.982456+0000","last_undegraded":"2024-04-25T10:29:02.982456+0000","last_fullsized":"2024-04-25T10:29:02.982456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:02.982364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:02.982364+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.982364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:37.816454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.954103+0000","last_change":"2024-04-25T10:29:08.954134+0000","last_active":"2024-04-25T10:29:08.954103+0000","last_peered":"2024-04-25T10:29:08.954103+0000","last_clean":"2024-04-25T10:29:08.954103+0000","last_became_active":"2024-04-25T10:25:41.236654+0000","last_became_peered":"2024-04-25T10:25:41.236654+0000","last_unstale":"2024-04-25T10:29:08.954103+0000","last_undegraded":"2024-04-25T10:29:08.954103+0000","last_fullsized":"2024-04-25T10:29:08.954103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:08.953998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:08.953998+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.953998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:51.300320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.753112+0000","last_change":"2024-04-25T10:29:06.753179+0000","last_active":"2024-04-25T10:29:06.753112+0000","last_peered":"2024-04-25T10:29:06.753112+0000","last_clean":"2024-04-25T10:29:06.753112+0000","last_became_active":"2024-04-25T10:25:37.192329+0000","last_became_peered":"2024-04-25T10:25:37.192329+0000","last_unstale":"2024-04-25T10:29:06.753112+0000","last_undegraded":"2024-04-25T10:29:06.753112+0000","last_fullsized":"2024-04-25T10:29:06.753112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:06.752905+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:06.752905+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.752905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:05.704236+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.138900+0000","last_change":"2024-04-25T10:29:07.139044+0000","last_active":"2024-04-25T10:29:07.138900+0000","last_peered":"2024-04-25T10:29:07.138900+0000","last_clean":"2024-04-25T10:29:07.138900+0000","last_became_active":"2024-04-25T10:25:36.181108+0000","last_became_peered":"2024-04-25T10:25:36.181108+0000","last_unstale":"2024-04-25T10:29:07.138900+0000","last_undegraded":"2024-04-25T10:29:07.138900+0000","last_fullsized":"2024-04-25T10:29:07.138900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:29:07.138628+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:29:07.138628+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.138628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:20.457556+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.962467+0000","last_change":"2024-04-25T10:29:11.962497+0000","last_active":"2024-04-25T10:29:11.962467+0000","last_peered":"2024-04-25T10:29:11.962467+0000","last_clean":"2024-04-25T10:29:11.962467+0000","last_became_active":"2024-04-25T10:25:41.246827+0000","last_became_peered":"2024-04-25T10:25:41.246827+0000","last_unstale":"2024-04-25T10:29:11.962467+0000","last_undegraded":"2024-04-25T10:29:11.962467+0000","last_fullsized":"2024-04-25T10:29:11.962467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:11.962365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:11.962365+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.962365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:22.927722+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.020185+0000","last_change":"2024-04-25T10:29:02.020185+0000","last_active":"2024-04-25T10:29:02.020185+0000","last_peered":"2024-04-25T10:29:02.020185+0000","last_clean":"2024-04-25T10:29:02.020185+0000","last_became_active":"2024-04-25T10:25:37.171551+0000","last_became_peered":"2024-04-25T10:25:37.171551+0000","last_unstale":"2024-04-25T10:29:02.020185+0000","last_undegraded":"2024-04-25T10:29:02.020185+0000","last_fullsized":"2024-04-25T10:29:02.020185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:02.020056+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:02.020056+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.020056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:15.227517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'10","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.291235+0000","last_change":"2024-04-25T10:29:02.291306+0000","last_active":"2024-04-25T10:29:02.291235+0000","last_peered":"2024-04-25T10:29:02.291235+0000","last_clean":"2024-04-25T10:29:02.291235+0000","last_became_active":"2024-04-25T10:25:36.167563+0000","last_became_peered":"2024-04-25T10:25:36.167563+0000","last_unstale":"2024-04-25T10:29:02.291235+0000","last_undegraded":"2024-04-25T10:29:02.291235+0000","last_fullsized":"2024-04-25T10:29:02.291235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:02.291108+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:02.291108+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.291108+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.145907+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:12.923149+0000","last_change":"2024-04-25T10:29:12.923181+0000","last_active":"2024-04-25T10:29:12.923149+0000","last_peered":"2024-04-25T10:29:12.923149+0000","last_clean":"2024-04-25T10:29:12.923149+0000","last_became_active":"2024-04-25T10:25:41.249951+0000","last_became_peered":"2024-04-25T10:25:41.249951+0000","last_unstale":"2024-04-25T10:29:12.923149+0000","last_undegraded":"2024-04-25T10:29:12.923149+0000","last_fullsized":"2024-04-25T10:29:12.923149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:12.923052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:12.923052+0000","last_clean_scrub_stamp":"2024-04-25T10:29:12.923052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:35.323401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.965891+0000","last_change":"2024-04-25T10:29:05.965919+0000","last_active":"2024-04-25T10:29:05.965891+0000","last_peered":"2024-04-25T10:29:05.965891+0000","last_clean":"2024-04-25T10:29:05.965891+0000","last_became_active":"2024-04-25T10:25:37.179311+0000","last_became_peered":"2024-04-25T10:25:37.179311+0000","last_unstale":"2024-04-25T10:29:05.965891+0000","last_undegraded":"2024-04-25T10:29:05.965891+0000","last_fullsized":"2024-04-25T10:29:05.965891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:05.965794+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:05.965794+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.965794+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:07.068033+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.161649+0000","last_change":"2024-04-25T10:29:11.161649+0000","last_active":"2024-04-25T10:29:11.161649+0000","last_peered":"2024-04-25T10:29:11.161649+0000","last_clean":"2024-04-25T10:29:11.161649+0000","last_became_active":"2024-04-25T10:25:36.184570+0000","last_became_peered":"2024-04-25T10:25:36.184570+0000","last_unstale":"2024-04-25T10:29:11.161649+0000","last_undegraded":"2024-04-25T10:29:11.161649+0000","last_fullsized":"2024-04-25T10:29:11.161649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T10:29:11.161262+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T10:29:11.161262+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.161262+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:33.179952+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:15.779935+0000","last_change":"2024-04-25T10:29:15.779969+0000","last_active":"2024-04-25T10:29:15.779935+0000","last_peered":"2024-04-25T10:29:15.779935+0000","last_clean":"2024-04-25T10:29:15.779935+0000","last_became_active":"2024-04-25T10:25:41.239256+0000","last_became_peered":"2024-04-25T10:25:41.239256+0000","last_unstale":"2024-04-25T10:29:15.779935+0000","last_undegraded":"2024-04-25T10:29:15.779935+0000","last_fullsized":"2024-04-25T10:29:15.779935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:15.779836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:15.779836+0000","last_clean_scrub_stamp":"2024-04-25T10:29:15.779836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:22.071234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.694903+0000","last_change":"2024-04-25T10:28:58.694935+0000","last_active":"2024-04-25T10:28:58.694903+0000","last_peered":"2024-04-25T10:28:58.694903+0000","last_clean":"2024-04-25T10:28:58.694903+0000","last_became_active":"2024-04-25T10:25:37.172640+0000","last_became_peered":"2024-04-25T10:25:37.172640+0000","last_unstale":"2024-04-25T10:28:58.694903+0000","last_undegraded":"2024-04-25T10:28:58.694903+0000","last_fullsized":"2024-04-25T10:28:58.694903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:28:58.694754+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:28:58.694754+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.694754+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:57.595631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.152978+0000","last_change":"2024-04-25T10:29:10.153140+0000","last_active":"2024-04-25T10:29:10.152978+0000","last_peered":"2024-04-25T10:29:10.152978+0000","last_clean":"2024-04-25T10:29:10.152978+0000","last_became_active":"2024-04-25T10:25:36.184134+0000","last_became_peered":"2024-04-25T10:25:36.184134+0000","last_unstale":"2024-04-25T10:29:10.152978+0000","last_undegraded":"2024-04-25T10:29:10.152978+0000","last_fullsized":"2024-04-25T10:29:10.152978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:10.152715+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:10.152715+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.152715+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:33.709067+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":137,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:55.578640+0000","last_change":"2024-04-25T10:28:55.578640+0000","last_active":"2024-04-25T10:28:55.578640+0000","last_peered":"2024-04-25T10:28:55.578640+0000","last_clean":"2024-04-25T10:28:55.578640+0000","last_became_active":"2024-04-25T10:25:25.810417+0000","last_became_peered":"2024-04-25T10:25:25.810417+0000","last_unstale":"2024-04-25T10:28:55.578640+0000","last_undegraded":"2024-04-25T10:28:55.578640+0000","last_fullsized":"2024-04-25T10:28:55.578640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-04-25T10:28:55.578322+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-04-25T10:28:55.578322+0000","last_clean_scrub_stamp":"2024-04-25T10:28:55.578322+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:49.614946+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:20.266022+0000","last_change":"2024-04-25T10:29:20.266107+0000","last_active":"2024-04-25T10:29:20.266022+0000","last_peered":"2024-04-25T10:29:20.266022+0000","last_clean":"2024-04-25T10:29:20.266022+0000","last_became_active":"2024-04-25T10:25:41.256597+0000","last_became_peered":"2024-04-25T10:25:41.256597+0000","last_unstale":"2024-04-25T10:29:20.266022+0000","last_undegraded":"2024-04-25T10:29:20.266022+0000","last_fullsized":"2024-04-25T10:29:20.266022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:20.265792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:20.265792+0000","last_clean_scrub_stamp":"2024-04-25T10:29:20.265792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:00.217471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.303861+0000","last_change":"2024-04-25T10:29:00.303900+0000","last_active":"2024-04-25T10:29:00.303861+0000","last_peered":"2024-04-25T10:29:00.303861+0000","last_clean":"2024-04-25T10:29:00.303861+0000","last_became_active":"2024-04-25T10:25:37.187142+0000","last_became_peered":"2024-04-25T10:25:37.187142+0000","last_unstale":"2024-04-25T10:29:00.303861+0000","last_undegraded":"2024-04-25T10:29:00.303861+0000","last_fullsized":"2024-04-25T10:29:00.303861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:00.303736+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:00.303736+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.303736+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:11.269094+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.950800+0000","last_change":"2024-04-25T10:29:01.950858+0000","last_active":"2024-04-25T10:29:01.950800+0000","last_peered":"2024-04-25T10:29:01.950800+0000","last_clean":"2024-04-25T10:29:01.950800+0000","last_became_active":"2024-04-25T10:25:36.190152+0000","last_became_peered":"2024-04-25T10:25:36.190152+0000","last_unstale":"2024-04-25T10:29:01.950800+0000","last_undegraded":"2024-04-25T10:29:01.950800+0000","last_fullsized":"2024-04-25T10:29:01.950800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:01.950645+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:01.950645+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.950645+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:21.548353+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.353834+0000","last_change":"2024-04-25T10:29:08.353901+0000","last_active":"2024-04-25T10:29:08.353834+0000","last_peered":"2024-04-25T10:29:08.353834+0000","last_clean":"2024-04-25T10:29:08.353834+0000","last_became_active":"2024-04-25T10:25:41.248065+0000","last_became_peered":"2024-04-25T10:25:41.248065+0000","last_unstale":"2024-04-25T10:29:08.353834+0000","last_undegraded":"2024-04-25T10:29:08.353834+0000","last_fullsized":"2024-04-25T10:29:08.353834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:08.353605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:08.353605+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.353605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:05.811055+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:55.642149+0000","last_change":"2024-04-25T10:28:55.642284+0000","last_active":"2024-04-25T10:28:55.642149+0000","last_peered":"2024-04-25T10:28:55.642149+0000","last_clean":"2024-04-25T10:28:55.642149+0000","last_became_active":"2024-04-25T10:25:37.176181+0000","last_became_peered":"2024-04-25T10:25:37.176181+0000","last_unstale":"2024-04-25T10:28:55.642149+0000","last_undegraded":"2024-04-25T10:28:55.642149+0000","last_fullsized":"2024-04-25T10:28:55.642149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:28:55.641849+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:28:55.641849+0000","last_clean_scrub_stamp":"2024-04-25T10:28:55.641849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:06.649856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.027851+0000","last_change":"2024-04-25T10:29:06.027898+0000","last_active":"2024-04-25T10:29:06.027851+0000","last_peered":"2024-04-25T10:29:06.027851+0000","last_clean":"2024-04-25T10:29:06.027851+0000","last_became_active":"2024-04-25T10:25:36.175232+0000","last_became_peered":"2024-04-25T10:25:36.175232+0000","last_unstale":"2024-04-25T10:29:06.027851+0000","last_undegraded":"2024-04-25T10:29:06.027851+0000","last_fullsized":"2024-04-25T10:29:06.027851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:29:06.027737+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:29:06.027737+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.027737+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:03.485186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:17.757200+0000","last_change":"2024-04-25T10:29:17.757258+0000","last_active":"2024-04-25T10:29:17.757200+0000","last_peered":"2024-04-25T10:29:17.757200+0000","last_clean":"2024-04-25T10:29:17.757200+0000","last_became_active":"2024-04-25T10:25:41.256154+0000","last_became_peered":"2024-04-25T10:25:41.256154+0000","last_unstale":"2024-04-25T10:29:17.757200+0000","last_undegraded":"2024-04-25T10:29:17.757200+0000","last_fullsized":"2024-04-25T10:29:17.757200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:17.757079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:17.757079+0000","last_clean_scrub_stamp":"2024-04-25T10:29:17.757079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.313431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:54.624310+0000","last_change":"2024-04-25T10:28:54.624376+0000","last_active":"2024-04-25T10:28:54.624310+0000","last_peered":"2024-04-25T10:28:54.624310+0000","last_clean":"2024-04-25T10:28:54.624310+0000","last_became_active":"2024-04-25T10:25:37.184778+0000","last_became_peered":"2024-04-25T10:25:37.184778+0000","last_unstale":"2024-04-25T10:28:54.624310+0000","last_undegraded":"2024-04-25T10:28:54.624310+0000","last_fullsized":"2024-04-25T10:28:54.624310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:28:54.624108+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:28:54.624108+0000","last_clean_scrub_stamp":"2024-04-25T10:28:54.624108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.524986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.730386+0000","last_change":"2024-04-25T10:29:00.730445+0000","last_active":"2024-04-25T10:29:00.730386+0000","last_peered":"2024-04-25T10:29:00.730386+0000","last_clean":"2024-04-25T10:29:00.730386+0000","last_became_active":"2024-04-25T10:25:36.168197+0000","last_became_peered":"2024-04-25T10:25:36.168197+0000","last_unstale":"2024-04-25T10:29:00.730386+0000","last_undegraded":"2024-04-25T10:29:00.730386+0000","last_fullsized":"2024-04-25T10:29:00.730386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:29:00.730243+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:29:00.730243+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.730243+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:08.933859+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:18.201676+0000","last_change":"2024-04-25T10:29:18.201823+0000","last_active":"2024-04-25T10:29:18.201676+0000","last_peered":"2024-04-25T10:29:18.201676+0000","last_clean":"2024-04-25T10:29:18.201676+0000","last_became_active":"2024-04-25T10:25:41.241529+0000","last_became_peered":"2024-04-25T10:25:41.241529+0000","last_unstale":"2024-04-25T10:29:18.201676+0000","last_undegraded":"2024-04-25T10:29:18.201676+0000","last_fullsized":"2024-04-25T10:29:18.201676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:18.201286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:18.201286+0000","last_clean_scrub_stamp":"2024-04-25T10:29:18.201286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:51.732085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.349704+0000","last_change":"2024-04-25T10:29:04.349773+0000","last_active":"2024-04-25T10:29:04.349704+0000","last_peered":"2024-04-25T10:29:04.349704+0000","last_clean":"2024-04-25T10:29:04.349704+0000","last_became_active":"2024-04-25T10:25:37.198140+0000","last_became_peered":"2024-04-25T10:25:37.198140+0000","last_unstale":"2024-04-25T10:29:04.349704+0000","last_undegraded":"2024-04-25T10:29:04.349704+0000","last_fullsized":"2024-04-25T10:29:04.349704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:04.349459+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:04.349459+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.349459+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:17.556919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.683375+0000","last_change":"2024-04-25T10:28:57.683452+0000","last_active":"2024-04-25T10:28:57.683375+0000","last_peered":"2024-04-25T10:28:57.683375+0000","last_clean":"2024-04-25T10:28:57.683375+0000","last_became_active":"2024-04-25T10:25:36.179292+0000","last_became_peered":"2024-04-25T10:25:36.179292+0000","last_unstale":"2024-04-25T10:28:57.683375+0000","last_undegraded":"2024-04-25T10:28:57.683375+0000","last_fullsized":"2024-04-25T10:28:57.683375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:28:57.683180+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:28:57.683180+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.683180+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:27.929746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.539866+0000","last_change":"2024-04-25T10:29:02.540000+0000","last_active":"2024-04-25T10:29:02.539866+0000","last_peered":"2024-04-25T10:29:02.539866+0000","last_clean":"2024-04-25T10:29:02.539866+0000","last_became_active":"2024-04-25T10:25:41.249325+0000","last_became_peered":"2024-04-25T10:25:41.249325+0000","last_unstale":"2024-04-25T10:29:02.539866+0000","last_undegraded":"2024-04-25T10:29:02.539866+0000","last_fullsized":"2024-04-25T10:29:02.539866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:02.539577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:02.539577+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.539577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:26.673560+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.168104+0000","last_change":"2024-04-25T10:29:05.168184+0000","last_active":"2024-04-25T10:29:05.168104+0000","last_peered":"2024-04-25T10:29:05.168104+0000","last_clean":"2024-04-25T10:29:05.168104+0000","last_became_active":"2024-04-25T10:25:37.202025+0000","last_became_peered":"2024-04-25T10:25:37.202025+0000","last_unstale":"2024-04-25T10:29:05.168104+0000","last_undegraded":"2024-04-25T10:29:05.168104+0000","last_fullsized":"2024-04-25T10:29:05.168104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:05.167882+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:05.167882+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.167882+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:16.353420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'25","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.701332+0000","last_change":"2024-04-25T10:28:59.701381+0000","last_active":"2024-04-25T10:28:59.701332+0000","last_peered":"2024-04-25T10:28:59.701332+0000","last_clean":"2024-04-25T10:28:59.701332+0000","last_became_active":"2024-04-25T10:25:36.154529+0000","last_became_peered":"2024-04-25T10:25:36.154529+0000","last_unstale":"2024-04-25T10:28:59.701332+0000","last_undegraded":"2024-04-25T10:28:59.701332+0000","last_fullsized":"2024-04-25T10:28:59.701332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-25T10:28:59.701224+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-25T10:28:59.701224+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.701224+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:10.709231+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:14.818220+0000","last_change":"2024-04-25T10:29:14.818281+0000","last_active":"2024-04-25T10:29:14.818220+0000","last_peered":"2024-04-25T10:29:14.818220+0000","last_clean":"2024-04-25T10:29:14.818220+0000","last_became_active":"2024-04-25T10:25:41.239134+0000","last_became_peered":"2024-04-25T10:25:41.239134+0000","last_unstale":"2024-04-25T10:29:14.818220+0000","last_undegraded":"2024-04-25T10:29:14.818220+0000","last_fullsized":"2024-04-25T10:29:14.818220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:14.818089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:14.818089+0000","last_clean_scrub_stamp":"2024-04-25T10:29:14.818089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:59.937742+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.569372+0000","last_change":"2024-04-25T10:28:57.569425+0000","last_active":"2024-04-25T10:28:57.569372+0000","last_peered":"2024-04-25T10:28:57.569372+0000","last_clean":"2024-04-25T10:28:57.569372+0000","last_became_active":"2024-04-25T10:25:37.180072+0000","last_became_peered":"2024-04-25T10:25:37.180072+0000","last_unstale":"2024-04-25T10:28:57.569372+0000","last_undegraded":"2024-04-25T10:28:57.569372+0000","last_fullsized":"2024-04-25T10:28:57.569372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:28:57.569233+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:28:57.569233+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.569233+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:26.337773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.753556+0000","last_change":"2024-04-25T10:29:01.753644+0000","last_active":"2024-04-25T10:29:01.753556+0000","last_peered":"2024-04-25T10:29:01.753556+0000","last_clean":"2024-04-25T10:29:01.753556+0000","last_became_active":"2024-04-25T10:25:36.191898+0000","last_became_peered":"2024-04-25T10:25:36.191898+0000","last_unstale":"2024-04-25T10:29:01.753556+0000","last_undegraded":"2024-04-25T10:29:01.753556+0000","last_fullsized":"2024-04-25T10:29:01.753556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:01.753326+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:01.753326+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.753326+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:36.587415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:16.761724+0000","last_change":"2024-04-25T10:29:16.761774+0000","last_active":"2024-04-25T10:29:16.761724+0000","last_peered":"2024-04-25T10:29:16.761724+0000","last_clean":"2024-04-25T10:29:16.761724+0000","last_became_active":"2024-04-25T10:25:41.244152+0000","last_became_peered":"2024-04-25T10:25:41.244152+0000","last_unstale":"2024-04-25T10:29:16.761724+0000","last_undegraded":"2024-04-25T10:29:16.761724+0000","last_fullsized":"2024-04-25T10:29:16.761724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:16.761585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:16.761585+0000","last_clean_scrub_stamp":"2024-04-25T10:29:16.761585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:36.261718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:17.227977+0000","last_change":"2024-04-25T10:29:17.228054+0000","last_active":"2024-04-25T10:29:17.227977+0000","last_peered":"2024-04-25T10:29:17.227977+0000","last_clean":"2024-04-25T10:29:17.227977+0000","last_became_active":"2024-04-25T10:25:37.208580+0000","last_became_peered":"2024-04-25T10:25:37.208580+0000","last_unstale":"2024-04-25T10:29:17.227977+0000","last_undegraded":"2024-04-25T10:29:17.227977+0000","last_fullsized":"2024-04-25T10:29:17.227977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-25T10:29:17.227756+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-25T10:29:17.227756+0000","last_clean_scrub_stamp":"2024-04-25T10:29:17.227756+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:57.353028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.146231+0000","last_change":"2024-04-25T10:29:09.146310+0000","last_active":"2024-04-25T10:29:09.146231+0000","last_peered":"2024-04-25T10:29:09.146231+0000","last_clean":"2024-04-25T10:29:09.146231+0000","last_became_active":"2024-04-25T10:25:36.181535+0000","last_became_peered":"2024-04-25T10:25:36.181535+0000","last_unstale":"2024-04-25T10:29:09.146231+0000","last_undegraded":"2024-04-25T10:29:09.146231+0000","last_fullsized":"2024-04-25T10:29:09.146231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:09.146020+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:09.146020+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.146020+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:29.099742+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.947442+0000","last_change":"2024-04-25T10:29:10.947489+0000","last_active":"2024-04-25T10:29:10.947442+0000","last_peered":"2024-04-25T10:29:10.947442+0000","last_clean":"2024-04-25T10:29:10.947442+0000","last_became_active":"2024-04-25T10:25:41.246895+0000","last_became_peered":"2024-04-25T10:25:41.246895+0000","last_unstale":"2024-04-25T10:29:10.947442+0000","last_undegraded":"2024-04-25T10:29:10.947442+0000","last_fullsized":"2024-04-25T10:29:10.947442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:10.947313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:10.947313+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.947313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:08.404762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.956117+0000","last_change":"2024-04-25T10:29:07.956147+0000","last_active":"2024-04-25T10:29:07.956117+0000","last_peered":"2024-04-25T10:29:07.956117+0000","last_clean":"2024-04-25T10:29:07.956117+0000","last_became_active":"2024-04-25T10:25:37.193433+0000","last_became_peered":"2024-04-25T10:25:37.193433+0000","last_unstale":"2024-04-25T10:29:07.956117+0000","last_undegraded":"2024-04-25T10:29:07.956117+0000","last_fullsized":"2024-04-25T10:29:07.956117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:07.956001+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:07.956001+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.956001+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:15.200107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'10","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.332574+0000","last_change":"2024-04-25T10:29:03.332647+0000","last_active":"2024-04-25T10:29:03.332574+0000","last_peered":"2024-04-25T10:29:03.332574+0000","last_clean":"2024-04-25T10:29:03.332574+0000","last_became_active":"2024-04-25T10:25:36.181541+0000","last_became_peered":"2024-04-25T10:25:36.181541+0000","last_unstale":"2024-04-25T10:29:03.332574+0000","last_undegraded":"2024-04-25T10:29:03.332574+0000","last_fullsized":"2024-04-25T10:29:03.332574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:03.332466+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:03.332466+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.332466+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:30.093197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:19.227012+0000","last_change":"2024-04-25T10:29:19.227092+0000","last_active":"2024-04-25T10:29:19.227012+0000","last_peered":"2024-04-25T10:29:19.227012+0000","last_clean":"2024-04-25T10:29:19.227012+0000","last_became_active":"2024-04-25T10:25:41.246536+0000","last_became_peered":"2024-04-25T10:25:41.246536+0000","last_unstale":"2024-04-25T10:29:19.227012+0000","last_undegraded":"2024-04-25T10:29:19.227012+0000","last_fullsized":"2024-04-25T10:29:19.227012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:19.226737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:19.226737+0000","last_clean_scrub_stamp":"2024-04-25T10:29:19.226737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:13.205773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.724783+0000","last_change":"2024-04-25T10:29:04.724851+0000","last_active":"2024-04-25T10:29:04.724783+0000","last_peered":"2024-04-25T10:29:04.724783+0000","last_clean":"2024-04-25T10:29:04.724783+0000","last_became_active":"2024-04-25T10:25:37.182447+0000","last_became_peered":"2024-04-25T10:25:37.182447+0000","last_unstale":"2024-04-25T10:29:04.724783+0000","last_undegraded":"2024-04-25T10:29:04.724783+0000","last_fullsized":"2024-04-25T10:29:04.724783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:04.724573+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:04.724573+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.724573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:15.036830+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'31","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:57.281097+0000","last_change":"2024-04-25T10:28:57.281154+0000","last_active":"2024-04-25T10:28:57.281097+0000","last_peered":"2024-04-25T10:28:57.281097+0000","last_clean":"2024-04-25T10:28:57.281097+0000","last_became_active":"2024-04-25T10:25:36.166579+0000","last_became_peered":"2024-04-25T10:25:36.166579+0000","last_unstale":"2024-04-25T10:28:57.281097+0000","last_undegraded":"2024-04-25T10:28:57.281097+0000","last_fullsized":"2024-04-25T10:28:57.281097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-25T10:28:57.280949+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-25T10:28:57.280949+0000","last_clean_scrub_stamp":"2024-04-25T10:28:57.280949+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:57.934071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:13.780429+0000","last_change":"2024-04-25T10:29:13.780463+0000","last_active":"2024-04-25T10:29:13.780429+0000","last_peered":"2024-04-25T10:29:13.780429+0000","last_clean":"2024-04-25T10:29:13.780429+0000","last_became_active":"2024-04-25T10:25:41.247533+0000","last_became_peered":"2024-04-25T10:25:41.247533+0000","last_unstale":"2024-04-25T10:29:13.780429+0000","last_undegraded":"2024-04-25T10:29:13.780429+0000","last_fullsized":"2024-04-25T10:29:13.780429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:29:13.780320+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:29:13.780320+0000","last_clean_scrub_stamp":"2024-04-25T10:29:13.780320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:25.509980+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.273291+0000","last_change":"2024-04-25T10:29:01.273340+0000","last_active":"2024-04-25T10:29:01.273291+0000","last_peered":"2024-04-25T10:29:01.273291+0000","last_clean":"2024-04-25T10:29:01.273291+0000","last_became_active":"2024-04-25T10:25:37.196199+0000","last_became_peered":"2024-04-25T10:25:37.196199+0000","last_unstale":"2024-04-25T10:29:01.273291+0000","last_undegraded":"2024-04-25T10:29:01.273291+0000","last_fullsized":"2024-04-25T10:29:01.273291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-25T10:29:01.273160+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-25T10:29:01.273160+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.273160+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:52.969965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.335282+0000","last_change":"2024-04-25T10:29:01.335322+0000","last_active":"2024-04-25T10:29:01.335282+0000","last_peered":"2024-04-25T10:29:01.335282+0000","last_clean":"2024-04-25T10:29:01.335282+0000","last_became_active":"2024-04-25T10:25:36.156255+0000","last_became_peered":"2024-04-25T10:25:36.156255+0000","last_unstale":"2024-04-25T10:29:01.335282+0000","last_undegraded":"2024-04-25T10:29:01.335282+0000","last_fullsized":"2024-04-25T10:29:01.335282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:01.335172+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:01.335172+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.335172+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:07.125699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.331189+0000","last_change":"2024-04-25T10:29:11.331257+0000","last_active":"2024-04-25T10:29:11.331189+0000","last_peered":"2024-04-25T10:29:11.331189+0000","last_clean":"2024-04-25T10:29:11.331189+0000","last_became_active":"2024-04-25T10:26:18.708320+0000","last_became_peered":"2024-04-25T10:26:18.708320+0000","last_unstale":"2024-04-25T10:29:11.331189+0000","last_undegraded":"2024-04-25T10:29:11.331189+0000","last_fullsized":"2024-04-25T10:29:11.331189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:11.330974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:11.330974+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.330974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:10.282305+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,7],"acting":[2,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.926702+0000","last_change":"2024-04-25T10:29:11.926732+0000","last_active":"2024-04-25T10:29:11.926702+0000","last_peered":"2024-04-25T10:29:11.926702+0000","last_clean":"2024-04-25T10:29:11.926702+0000","last_became_active":"2024-04-25T10:25:37.187069+0000","last_became_peered":"2024-04-25T10:25:37.187069+0000","last_unstale":"2024-04-25T10:29:11.926702+0000","last_undegraded":"2024-04-25T10:29:11.926702+0000","last_fullsized":"2024-04-25T10:29:11.926702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:11.926583+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:11.926583+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.926583+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:23.112121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.668746+0000","last_change":"2024-04-25T10:28:58.668801+0000","last_active":"2024-04-25T10:28:58.668746+0000","last_peered":"2024-04-25T10:28:58.668746+0000","last_clean":"2024-04-25T10:28:58.668746+0000","last_became_active":"2024-04-25T10:25:36.181334+0000","last_became_peered":"2024-04-25T10:25:36.181334+0000","last_unstale":"2024-04-25T10:28:58.668746+0000","last_undegraded":"2024-04-25T10:28:58.668746+0000","last_fullsized":"2024-04-25T10:28:58.668746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:28:58.668621+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:28:58.668621+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.668621+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:59.770861+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.364970+0000","last_change":"2024-04-25T10:29:08.365004+0000","last_active":"2024-04-25T10:29:08.364970+0000","last_peered":"2024-04-25T10:29:08.364970+0000","last_clean":"2024-04-25T10:29:08.364970+0000","last_became_active":"2024-04-25T10:25:41.237999+0000","last_became_peered":"2024-04-25T10:25:41.237999+0000","last_unstale":"2024-04-25T10:29:08.364970+0000","last_undegraded":"2024-04-25T10:29:08.364970+0000","last_fullsized":"2024-04-25T10:29:08.364970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:08.364859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:08.364859+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.364859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:22.242350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.316800+0000","last_change":"2024-04-25T10:29:02.316948+0000","last_active":"2024-04-25T10:29:02.316800+0000","last_peered":"2024-04-25T10:29:02.316800+0000","last_clean":"2024-04-25T10:29:02.316800+0000","last_became_active":"2024-04-25T10:25:37.188634+0000","last_became_peered":"2024-04-25T10:25:37.188634+0000","last_unstale":"2024-04-25T10:29:02.316800+0000","last_undegraded":"2024-04-25T10:29:02.316800+0000","last_fullsized":"2024-04-25T10:29:02.316800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:02.316468+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:02.316468+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.316468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:32.563033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:56.590175+0000","last_change":"2024-04-25T10:28:56.590227+0000","last_active":"2024-04-25T10:28:56.590175+0000","last_peered":"2024-04-25T10:28:56.590175+0000","last_clean":"2024-04-25T10:28:56.590175+0000","last_became_active":"2024-04-25T10:25:36.172001+0000","last_became_peered":"2024-04-25T10:25:36.172001+0000","last_unstale":"2024-04-25T10:28:56.590175+0000","last_undegraded":"2024-04-25T10:28:56.590175+0000","last_fullsized":"2024-04-25T10:28:56.590175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:28:56.590042+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:28:56.590042+0000","last_clean_scrub_stamp":"2024-04-25T10:28:56.590042+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:00.077883+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:14.774633+0000","last_change":"2024-04-25T10:29:14.774661+0000","last_active":"2024-04-25T10:29:14.774633+0000","last_peered":"2024-04-25T10:29:14.774633+0000","last_clean":"2024-04-25T10:29:14.774633+0000","last_became_active":"2024-04-25T10:25:41.247323+0000","last_became_peered":"2024-04-25T10:25:41.247323+0000","last_unstale":"2024-04-25T10:29:14.774633+0000","last_undegraded":"2024-04-25T10:29:14.774633+0000","last_fullsized":"2024-04-25T10:29:14.774633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:14.774495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:14.774495+0000","last_clean_scrub_stamp":"2024-04-25T10:29:14.774495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:25.960034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:11.770445+0000","last_change":"2024-04-25T10:29:11.770473+0000","last_active":"2024-04-25T10:29:11.770445+0000","last_peered":"2024-04-25T10:29:11.770445+0000","last_clean":"2024-04-25T10:29:11.770445+0000","last_became_active":"2024-04-25T10:25:41.246267+0000","last_became_peered":"2024-04-25T10:25:41.246267+0000","last_unstale":"2024-04-25T10:29:11.770445+0000","last_undegraded":"2024-04-25T10:29:11.770445+0000","last_fullsized":"2024-04-25T10:29:11.770445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:11.770343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:11.770343+0000","last_clean_scrub_stamp":"2024-04-25T10:29:11.770343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:34.170692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.713672+0000","last_change":"2024-04-25T10:29:07.713700+0000","last_active":"2024-04-25T10:29:07.713672+0000","last_peered":"2024-04-25T10:29:07.713672+0000","last_clean":"2024-04-25T10:29:07.713672+0000","last_became_active":"2024-04-25T10:25:37.178445+0000","last_became_peered":"2024-04-25T10:25:37.178445+0000","last_unstale":"2024-04-25T10:29:07.713672+0000","last_undegraded":"2024-04-25T10:29:07.713672+0000","last_fullsized":"2024-04-25T10:29:07.713672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:07.713580+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:07.713580+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.713580+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:41.094550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:13.167226+0000","last_change":"2024-04-25T10:29:13.167312+0000","last_active":"2024-04-25T10:29:13.167226+0000","last_peered":"2024-04-25T10:29:13.167226+0000","last_clean":"2024-04-25T10:29:13.167226+0000","last_became_active":"2024-04-25T10:25:36.186577+0000","last_became_peered":"2024-04-25T10:25:36.186577+0000","last_unstale":"2024-04-25T10:29:13.167226+0000","last_undegraded":"2024-04-25T10:29:13.167226+0000","last_fullsized":"2024-04-25T10:29:13.167226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-04-25T10:29:13.166984+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-04-25T10:29:13.166984+0000","last_clean_scrub_stamp":"2024-04-25T10:29:13.166984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:58.398965+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:22.215951+0000","last_change":"2024-04-25T10:29:22.216024+0000","last_active":"2024-04-25T10:29:22.215951+0000","last_peered":"2024-04-25T10:29:22.215951+0000","last_clean":"2024-04-25T10:29:22.215951+0000","last_became_active":"2024-04-25T10:25:41.259934+0000","last_became_peered":"2024-04-25T10:25:41.259934+0000","last_unstale":"2024-04-25T10:29:22.215951+0000","last_undegraded":"2024-04-25T10:29:22.215951+0000","last_fullsized":"2024-04-25T10:29:22.215951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:22.215726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:22.215726+0000","last_clean_scrub_stamp":"2024-04-25T10:29:22.215726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:14.179280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.957557+0000","last_change":"2024-04-25T10:29:09.957586+0000","last_active":"2024-04-25T10:29:09.957557+0000","last_peered":"2024-04-25T10:29:09.957557+0000","last_clean":"2024-04-25T10:29:09.957557+0000","last_became_active":"2024-04-25T10:25:37.170310+0000","last_became_peered":"2024-04-25T10:25:37.170310+0000","last_unstale":"2024-04-25T10:29:09.957557+0000","last_undegraded":"2024-04-25T10:29:09.957557+0000","last_fullsized":"2024-04-25T10:29:09.957557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:09.957466+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:09.957466+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.957466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:51.955541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.939905+0000","last_change":"2024-04-25T10:29:00.939940+0000","last_active":"2024-04-25T10:29:00.939905+0000","last_peered":"2024-04-25T10:29:00.939905+0000","last_clean":"2024-04-25T10:29:00.939905+0000","last_became_active":"2024-04-25T10:25:36.173418+0000","last_became_peered":"2024-04-25T10:25:36.173418+0000","last_unstale":"2024-04-25T10:29:00.939905+0000","last_undegraded":"2024-04-25T10:29:00.939905+0000","last_fullsized":"2024-04-25T10:29:00.939905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T10:29:00.939802+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T10:29:00.939802+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.939802+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:05.337267+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.163550+0000","last_change":"2024-04-25T10:29:06.163699+0000","last_active":"2024-04-25T10:29:06.163550+0000","last_peered":"2024-04-25T10:29:06.163550+0000","last_clean":"2024-04-25T10:29:06.163550+0000","last_became_active":"2024-04-25T10:25:36.195179+0000","last_became_peered":"2024-04-25T10:25:36.195179+0000","last_unstale":"2024-04-25T10:29:06.163550+0000","last_undegraded":"2024-04-25T10:29:06.163550+0000","last_fullsized":"2024-04-25T10:29:06.163550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T10:29:06.163257+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T10:29:06.163257+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.163257+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:52.003109+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.725932+0000","last_change":"2024-04-25T10:29:08.725962+0000","last_active":"2024-04-25T10:29:08.725932+0000","last_peered":"2024-04-25T10:29:08.725932+0000","last_clean":"2024-04-25T10:29:08.725932+0000","last_became_active":"2024-04-25T10:25:37.180513+0000","last_became_peered":"2024-04-25T10:25:37.180513+0000","last_unstale":"2024-04-25T10:29:08.725932+0000","last_undegraded":"2024-04-25T10:29:08.725932+0000","last_fullsized":"2024-04-25T10:29:08.725932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:08.725831+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:08.725831+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.725831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:27.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.775520+0000","last_change":"2024-04-25T10:29:10.775585+0000","last_active":"2024-04-25T10:29:10.775520+0000","last_peered":"2024-04-25T10:29:10.775520+0000","last_clean":"2024-04-25T10:29:10.775520+0000","last_became_active":"2024-04-25T10:25:41.231218+0000","last_became_peered":"2024-04-25T10:25:41.231218+0000","last_unstale":"2024-04-25T10:29:10.775520+0000","last_undegraded":"2024-04-25T10:29:10.775520+0000","last_fullsized":"2024-04-25T10:29:10.775520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:10.775395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:10.775395+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.775395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:02.472200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.053091+0000","last_change":"2024-04-25T10:29:05.053144+0000","last_active":"2024-04-25T10:29:05.053091+0000","last_peered":"2024-04-25T10:29:05.053091+0000","last_clean":"2024-04-25T10:29:05.053091+0000","last_became_active":"2024-04-25T10:25:36.166425+0000","last_became_peered":"2024-04-25T10:25:36.166425+0000","last_unstale":"2024-04-25T10:29:05.053091+0000","last_undegraded":"2024-04-25T10:29:05.053091+0000","last_fullsized":"2024-04-25T10:29:05.053091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:05.052957+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:05.052957+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.052957+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:45.678007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:58.528082+0000","last_change":"2024-04-25T10:28:58.528153+0000","last_active":"2024-04-25T10:28:58.528082+0000","last_peered":"2024-04-25T10:28:58.528082+0000","last_clean":"2024-04-25T10:28:58.528082+0000","last_became_active":"2024-04-25T10:25:37.183381+0000","last_became_peered":"2024-04-25T10:25:37.183381+0000","last_unstale":"2024-04-25T10:28:58.528082+0000","last_undegraded":"2024-04-25T10:28:58.528082+0000","last_fullsized":"2024-04-25T10:28:58.528082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:28:58.527876+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:28:58.527876+0000","last_clean_scrub_stamp":"2024-04-25T10:28:58.527876+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:49.562543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.355356+0000","last_change":"2024-04-25T10:29:10.355387+0000","last_active":"2024-04-25T10:29:10.355356+0000","last_peered":"2024-04-25T10:29:10.355356+0000","last_clean":"2024-04-25T10:29:10.355356+0000","last_became_active":"2024-04-25T10:25:41.257837+0000","last_became_peered":"2024-04-25T10:25:41.257837+0000","last_unstale":"2024-04-25T10:29:10.355356+0000","last_undegraded":"2024-04-25T10:29:10.355356+0000","last_fullsized":"2024-04-25T10:29:10.355356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:29:10.355216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:29:10.355216+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.355216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:45.009509+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.343609+0000","last_change":"2024-04-25T10:29:01.343753+0000","last_active":"2024-04-25T10:29:01.343609+0000","last_peered":"2024-04-25T10:29:01.343609+0000","last_clean":"2024-04-25T10:29:01.343609+0000","last_became_active":"2024-04-25T10:25:37.182839+0000","last_became_peered":"2024-04-25T10:25:37.182839+0000","last_unstale":"2024-04-25T10:29:01.343609+0000","last_undegraded":"2024-04-25T10:29:01.343609+0000","last_fullsized":"2024-04-25T10:29:01.343609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:01.343344+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:01.343344+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.343344+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:05.426626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.327579+0000","last_change":"2024-04-25T10:29:05.327606+0000","last_active":"2024-04-25T10:29:05.327579+0000","last_peered":"2024-04-25T10:29:05.327579+0000","last_clean":"2024-04-25T10:29:05.327579+0000","last_became_active":"2024-04-25T10:25:37.179842+0000","last_became_peered":"2024-04-25T10:25:37.179842+0000","last_unstale":"2024-04-25T10:29:05.327579+0000","last_undegraded":"2024-04-25T10:29:05.327579+0000","last_fullsized":"2024-04-25T10:29:05.327579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-25T10:29:05.327469+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-25T10:29:05.327469+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.327469+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:53.313421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.277166+0000","last_change":"2024-04-25T10:29:02.277241+0000","last_active":"2024-04-25T10:29:02.277166+0000","last_peered":"2024-04-25T10:29:02.277166+0000","last_clean":"2024-04-25T10:29:02.277166+0000","last_became_active":"2024-04-25T10:25:37.186591+0000","last_became_peered":"2024-04-25T10:25:37.186591+0000","last_unstale":"2024-04-25T10:29:02.277166+0000","last_undegraded":"2024-04-25T10:29:02.277166+0000","last_fullsized":"2024-04-25T10:29:02.277166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:02.276957+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:02.276957+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.276957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:24.677305+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.999418+0000","last_change":"2024-04-25T10:29:06.999465+0000","last_active":"2024-04-25T10:29:06.999418+0000","last_peered":"2024-04-25T10:29:06.999418+0000","last_clean":"2024-04-25T10:29:06.999418+0000","last_became_active":"2024-04-25T10:25:37.164880+0000","last_became_peered":"2024-04-25T10:25:37.164880+0000","last_unstale":"2024-04-25T10:29:06.999418+0000","last_undegraded":"2024-04-25T10:29:06.999418+0000","last_fullsized":"2024-04-25T10:29:06.999418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:06.999293+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:06.999293+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.999293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:25.644920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:13.888338+0000","last_change":"2024-04-25T10:29:13.888388+0000","last_active":"2024-04-25T10:29:13.888338+0000","last_peered":"2024-04-25T10:29:13.888338+0000","last_clean":"2024-04-25T10:29:13.888338+0000","last_became_active":"2024-04-25T10:26:18.698625+0000","last_became_peered":"2024-04-25T10:26:18.698625+0000","last_unstale":"2024-04-25T10:29:13.888338+0000","last_undegraded":"2024-04-25T10:29:13.888338+0000","last_fullsized":"2024-04-25T10:29:13.888338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T10:29:13.888193+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T10:29:13.888193+0000","last_clean_scrub_stamp":"2024-04-25T10:29:13.888193+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:55.886269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.930374+0000","last_change":"2024-04-25T10:29:03.930415+0000","last_active":"2024-04-25T10:29:03.930374+0000","last_peered":"2024-04-25T10:29:03.930374+0000","last_clean":"2024-04-25T10:29:03.930374+0000","last_became_active":"2024-04-25T10:25:37.170281+0000","last_became_peered":"2024-04-25T10:25:37.170281+0000","last_unstale":"2024-04-25T10:29:03.930374+0000","last_undegraded":"2024-04-25T10:29:03.930374+0000","last_fullsized":"2024-04-25T10:29:03.930374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:03.930273+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:03.930273+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.930273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:08.013555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.300970+0000","last_change":"2024-04-25T10:29:03.301048+0000","last_active":"2024-04-25T10:29:03.300970+0000","last_peered":"2024-04-25T10:29:03.300970+0000","last_clean":"2024-04-25T10:29:03.300970+0000","last_became_active":"2024-04-25T10:25:37.189086+0000","last_became_peered":"2024-04-25T10:25:37.189086+0000","last_unstale":"2024-04-25T10:29:03.300970+0000","last_undegraded":"2024-04-25T10:29:03.300970+0000","last_fullsized":"2024-04-25T10:29:03.300970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-25T10:29:03.300773+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-25T10:29:03.300773+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.300773+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:04.403012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.928587+0000","last_change":"2024-04-25T10:29:10.928617+0000","last_active":"2024-04-25T10:29:10.928587+0000","last_peered":"2024-04-25T10:29:10.928587+0000","last_clean":"2024-04-25T10:29:10.928587+0000","last_became_active":"2024-04-25T10:25:37.186102+0000","last_became_peered":"2024-04-25T10:25:37.186102+0000","last_unstale":"2024-04-25T10:29:10.928587+0000","last_undegraded":"2024-04-25T10:29:10.928587+0000","last_fullsized":"2024-04-25T10:29:10.928587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T10:29:10.928494+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T10:29:10.928494+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.928494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:22.658153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:04.213873+0000","last_change":"2024-04-25T10:29:04.213949+0000","last_active":"2024-04-25T10:29:04.213873+0000","last_peered":"2024-04-25T10:29:04.213873+0000","last_clean":"2024-04-25T10:29:04.213873+0000","last_became_active":"2024-04-25T10:25:37.184153+0000","last_became_peered":"2024-04-25T10:25:37.184153+0000","last_unstale":"2024-04-25T10:29:04.213873+0000","last_undegraded":"2024-04-25T10:29:04.213873+0000","last_fullsized":"2024-04-25T10:29:04.213873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:04.213655+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:04.213655+0000","last_clean_scrub_stamp":"2024-04-25T10:29:04.213655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:15.943315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:12.894685+0000","last_change":"2024-04-25T10:29:12.894761+0000","last_active":"2024-04-25T10:29:12.894685+0000","last_peered":"2024-04-25T10:29:12.894685+0000","last_clean":"2024-04-25T10:29:12.894685+0000","last_became_active":"2024-04-25T10:25:37.196321+0000","last_became_peered":"2024-04-25T10:25:37.196321+0000","last_unstale":"2024-04-25T10:29:12.894685+0000","last_undegraded":"2024-04-25T10:29:12.894685+0000","last_fullsized":"2024-04-25T10:29:12.894685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:12.894557+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:12.894557+0000","last_clean_scrub_stamp":"2024-04-25T10:29:12.894557+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:33.342795+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.513734+0000","last_change":"2024-04-25T10:29:00.513785+0000","last_active":"2024-04-25T10:29:00.513734+0000","last_peered":"2024-04-25T10:29:00.513734+0000","last_clean":"2024-04-25T10:29:00.513734+0000","last_became_active":"2024-04-25T10:25:37.191764+0000","last_became_peered":"2024-04-25T10:25:37.191764+0000","last_unstale":"2024-04-25T10:29:00.513734+0000","last_undegraded":"2024-04-25T10:29:00.513734+0000","last_fullsized":"2024-04-25T10:29:00.513734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:00.513590+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:00.513590+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.513590+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:01.166712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.767510+0000","last_change":"2024-04-25T10:29:09.767551+0000","last_active":"2024-04-25T10:29:09.767510+0000","last_peered":"2024-04-25T10:29:09.767510+0000","last_clean":"2024-04-25T10:29:09.767510+0000","last_became_active":"2024-04-25T10:25:37.183708+0000","last_became_peered":"2024-04-25T10:25:37.183708+0000","last_unstale":"2024-04-25T10:29:09.767510+0000","last_undegraded":"2024-04-25T10:29:09.767510+0000","last_fullsized":"2024-04-25T10:29:09.767510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-25T10:29:09.767413+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-25T10:29:09.767413+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.767413+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:20.732770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:05.716566+0000","last_change":"2024-04-25T10:29:05.716637+0000","last_active":"2024-04-25T10:29:05.716566+0000","last_peered":"2024-04-25T10:29:05.716566+0000","last_clean":"2024-04-25T10:29:05.716566+0000","last_became_active":"2024-04-25T10:25:37.187044+0000","last_became_peered":"2024-04-25T10:25:37.187044+0000","last_unstale":"2024-04-25T10:29:05.716566+0000","last_undegraded":"2024-04-25T10:29:05.716566+0000","last_fullsized":"2024-04-25T10:29:05.716566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:05.716330+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:05.716330+0000","last_clean_scrub_stamp":"2024-04-25T10:29:05.716330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:03.982715+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.282786+0000","last_change":"2024-04-25T10:28:59.282844+0000","last_active":"2024-04-25T10:28:59.282786+0000","last_peered":"2024-04-25T10:28:59.282786+0000","last_clean":"2024-04-25T10:28:59.282786+0000","last_became_active":"2024-04-25T10:25:37.193881+0000","last_became_peered":"2024-04-25T10:25:37.193881+0000","last_unstale":"2024-04-25T10:28:59.282786+0000","last_undegraded":"2024-04-25T10:28:59.282786+0000","last_fullsized":"2024-04-25T10:28:59.282786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:28:59.282645+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:28:59.282645+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.282645+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:17.928272+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.298901+0000","last_change":"2024-04-25T10:29:06.298940+0000","last_active":"2024-04-25T10:29:06.298901+0000","last_peered":"2024-04-25T10:29:06.298901+0000","last_clean":"2024-04-25T10:29:06.298901+0000","last_became_active":"2024-04-25T10:25:37.198373+0000","last_became_peered":"2024-04-25T10:25:37.198373+0000","last_unstale":"2024-04-25T10:29:06.298901+0000","last_undegraded":"2024-04-25T10:29:06.298901+0000","last_fullsized":"2024-04-25T10:29:06.298901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:06.298792+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:06.298792+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.298792+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:10.696257+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:15.206226+0000","last_change":"2024-04-25T10:29:15.206363+0000","last_active":"2024-04-25T10:29:15.206226+0000","last_peered":"2024-04-25T10:29:15.206226+0000","last_clean":"2024-04-25T10:29:15.206226+0000","last_became_active":"2024-04-25T10:25:37.202837+0000","last_became_peered":"2024-04-25T10:25:37.202837+0000","last_unstale":"2024-04-25T10:29:15.206226+0000","last_undegraded":"2024-04-25T10:29:15.206226+0000","last_fullsized":"2024-04-25T10:29:15.206226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:15.205890+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:15.205890+0000","last_clean_scrub_stamp":"2024-04-25T10:29:15.205890+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:16.536941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.248969+0000","last_change":"2024-04-25T10:29:03.249045+0000","last_active":"2024-04-25T10:29:03.248969+0000","last_peered":"2024-04-25T10:29:03.248969+0000","last_clean":"2024-04-25T10:29:03.248969+0000","last_became_active":"2024-04-25T10:25:37.199524+0000","last_became_peered":"2024-04-25T10:25:37.199524+0000","last_unstale":"2024-04-25T10:29:03.248969+0000","last_undegraded":"2024-04-25T10:29:03.248969+0000","last_fullsized":"2024-04-25T10:29:03.248969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:29:03.248741+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:29:03.248741+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.248741+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:01.100929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.029604+0000","last_change":"2024-04-25T10:29:00.029651+0000","last_active":"2024-04-25T10:29:00.029604+0000","last_peered":"2024-04-25T10:29:00.029604+0000","last_clean":"2024-04-25T10:29:00.029604+0000","last_became_active":"2024-04-25T10:25:37.177120+0000","last_became_peered":"2024-04-25T10:25:37.177120+0000","last_unstale":"2024-04-25T10:29:00.029604+0000","last_undegraded":"2024-04-25T10:29:00.029604+0000","last_fullsized":"2024-04-25T10:29:00.029604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:00.029501+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:00.029501+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.029501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:30.276066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.977371+0000","last_change":"2024-04-25T10:29:02.977402+0000","last_active":"2024-04-25T10:29:02.977371+0000","last_peered":"2024-04-25T10:29:02.977371+0000","last_clean":"2024-04-25T10:29:02.977371+0000","last_became_active":"2024-04-25T10:25:37.167403+0000","last_became_peered":"2024-04-25T10:25:37.167403+0000","last_unstale":"2024-04-25T10:29:02.977371+0000","last_undegraded":"2024-04-25T10:29:02.977371+0000","last_fullsized":"2024-04-25T10:29:02.977371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:02.977260+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:02.977260+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.977260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:16.854752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:06.952186+0000","last_change":"2024-04-25T10:29:06.952237+0000","last_active":"2024-04-25T10:29:06.952186+0000","last_peered":"2024-04-25T10:29:06.952186+0000","last_clean":"2024-04-25T10:29:06.952186+0000","last_became_active":"2024-04-25T10:25:37.180476+0000","last_became_peered":"2024-04-25T10:25:37.180476+0000","last_unstale":"2024-04-25T10:29:06.952186+0000","last_undegraded":"2024-04-25T10:29:06.952186+0000","last_fullsized":"2024-04-25T10:29:06.952186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T10:29:06.952066+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T10:29:06.952066+0000","last_clean_scrub_stamp":"2024-04-25T10:29:06.952066+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:46.512747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:07.714261+0000","last_change":"2024-04-25T10:29:07.714387+0000","last_active":"2024-04-25T10:29:07.714261+0000","last_peered":"2024-04-25T10:29:07.714261+0000","last_clean":"2024-04-25T10:29:07.714261+0000","last_became_active":"2024-04-25T10:25:37.192335+0000","last_became_peered":"2024-04-25T10:25:37.192335+0000","last_unstale":"2024-04-25T10:29:07.714261+0000","last_undegraded":"2024-04-25T10:29:07.714261+0000","last_fullsized":"2024-04-25T10:29:07.714261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:07.713999+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:07.713999+0000","last_clean_scrub_stamp":"2024-04-25T10:29:07.713999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:03.808249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.758382+0000","last_change":"2024-04-25T10:29:08.758553+0000","last_active":"2024-04-25T10:29:08.758382+0000","last_peered":"2024-04-25T10:29:08.758382+0000","last_clean":"2024-04-25T10:29:08.758382+0000","last_became_active":"2024-04-25T10:25:37.194694+0000","last_became_peered":"2024-04-25T10:25:37.194694+0000","last_unstale":"2024-04-25T10:29:08.758382+0000","last_undegraded":"2024-04-25T10:29:08.758382+0000","last_fullsized":"2024-04-25T10:29:08.758382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:08.758099+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:08.758099+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.758099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:15.860355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:10.704851+0000","last_change":"2024-04-25T10:29:10.704922+0000","last_active":"2024-04-25T10:29:10.704851+0000","last_peered":"2024-04-25T10:29:10.704851+0000","last_clean":"2024-04-25T10:29:10.704851+0000","last_became_active":"2024-04-25T10:25:37.199840+0000","last_became_peered":"2024-04-25T10:25:37.199840+0000","last_unstale":"2024-04-25T10:29:10.704851+0000","last_undegraded":"2024-04-25T10:29:10.704851+0000","last_fullsized":"2024-04-25T10:29:10.704851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-25T10:29:10.704645+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-25T10:29:10.704645+0000","last_clean_scrub_stamp":"2024-04-25T10:29:10.704645+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:15.161398+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:01.535421+0000","last_change":"2024-04-25T10:29:01.535489+0000","last_active":"2024-04-25T10:29:01.535421+0000","last_peered":"2024-04-25T10:29:01.535421+0000","last_clean":"2024-04-25T10:29:01.535421+0000","last_became_active":"2024-04-25T10:25:37.194223+0000","last_became_peered":"2024-04-25T10:25:37.194223+0000","last_unstale":"2024-04-25T10:29:01.535421+0000","last_undegraded":"2024-04-25T10:29:01.535421+0000","last_fullsized":"2024-04-25T10:29:01.535421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-25T10:29:01.535216+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-25T10:29:01.535216+0000","last_clean_scrub_stamp":"2024-04-25T10:29:01.535216+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:29.013861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.017215+0000","last_change":"2024-04-25T10:28:59.017255+0000","last_active":"2024-04-25T10:28:59.017215+0000","last_peered":"2024-04-25T10:28:59.017215+0000","last_clean":"2024-04-25T10:28:59.017215+0000","last_became_active":"2024-04-25T10:25:37.177407+0000","last_became_peered":"2024-04-25T10:25:37.177407+0000","last_unstale":"2024-04-25T10:28:59.017215+0000","last_undegraded":"2024-04-25T10:28:59.017215+0000","last_fullsized":"2024-04-25T10:28:59.017215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T10:28:59.017103+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T10:28:59.017103+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.017103+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:03.100385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:02.744615+0000","last_change":"2024-04-25T10:29:02.744687+0000","last_active":"2024-04-25T10:29:02.744615+0000","last_peered":"2024-04-25T10:29:02.744615+0000","last_clean":"2024-04-25T10:29:02.744615+0000","last_became_active":"2024-04-25T10:25:37.173040+0000","last_became_peered":"2024-04-25T10:25:37.173040+0000","last_unstale":"2024-04-25T10:29:02.744615+0000","last_undegraded":"2024-04-25T10:29:02.744615+0000","last_fullsized":"2024-04-25T10:29:02.744615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T10:29:02.744366+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T10:29:02.744366+0000","last_clean_scrub_stamp":"2024-04-25T10:29:02.744366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:06.347015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:00.371887+0000","last_change":"2024-04-25T10:29:00.371936+0000","last_active":"2024-04-25T10:29:00.371887+0000","last_peered":"2024-04-25T10:29:00.371887+0000","last_clean":"2024-04-25T10:29:00.371887+0000","last_became_active":"2024-04-25T10:25:37.182512+0000","last_became_peered":"2024-04-25T10:25:37.182512+0000","last_unstale":"2024-04-25T10:29:00.371887+0000","last_undegraded":"2024-04-25T10:29:00.371887+0000","last_fullsized":"2024-04-25T10:29:00.371887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T10:29:00.371763+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T10:29:00.371763+0000","last_clean_scrub_stamp":"2024-04-25T10:29:00.371763+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:11.379770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:03.748768+0000","last_change":"2024-04-25T10:29:03.748840+0000","last_active":"2024-04-25T10:29:03.748768+0000","last_peered":"2024-04-25T10:29:03.748768+0000","last_clean":"2024-04-25T10:29:03.748768+0000","last_became_active":"2024-04-25T10:25:37.173090+0000","last_became_peered":"2024-04-25T10:25:37.173090+0000","last_unstale":"2024-04-25T10:29:03.748768+0000","last_undegraded":"2024-04-25T10:29:03.748768+0000","last_fullsized":"2024-04-25T10:29:03.748768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T10:29:03.748562+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T10:29:03.748562+0000","last_clean_scrub_stamp":"2024-04-25T10:29:03.748562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:37.129531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:28:59.324497+0000","last_change":"2024-04-25T10:28:59.324497+0000","last_active":"2024-04-25T10:28:59.324497+0000","last_peered":"2024-04-25T10:28:59.324497+0000","last_clean":"2024-04-25T10:28:59.324497+0000","last_became_active":"2024-04-25T10:25:37.181942+0000","last_became_peered":"2024-04-25T10:25:37.181942+0000","last_unstale":"2024-04-25T10:28:59.324497+0000","last_undegraded":"2024-04-25T10:28:59.324497+0000","last_fullsized":"2024-04-25T10:28:59.324497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:28:59.324348+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:28:59.324348+0000","last_clean_scrub_stamp":"2024-04-25T10:28:59.324348+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:58.225226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.956605+0000","last_change":"2024-04-25T10:29:08.956635+0000","last_active":"2024-04-25T10:29:08.956605+0000","last_peered":"2024-04-25T10:29:08.956605+0000","last_clean":"2024-04-25T10:29:08.956605+0000","last_became_active":"2024-04-25T10:25:37.170024+0000","last_became_peered":"2024-04-25T10:25:37.170024+0000","last_unstale":"2024-04-25T10:29:08.956605+0000","last_undegraded":"2024-04-25T10:29:08.956605+0000","last_fullsized":"2024-04-25T10:29:08.956605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T10:29:08.956514+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T10:29:08.956514+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.956514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:31.356862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:08.004170+0000","last_change":"2024-04-25T10:29:08.004198+0000","last_active":"2024-04-25T10:29:08.004170+0000","last_peered":"2024-04-25T10:29:08.004170+0000","last_clean":"2024-04-25T10:29:08.004170+0000","last_became_active":"2024-04-25T10:25:37.167362+0000","last_became_peered":"2024-04-25T10:25:37.167362+0000","last_unstale":"2024-04-25T10:29:08.004170+0000","last_undegraded":"2024-04-25T10:29:08.004170+0000","last_fullsized":"2024-04-25T10:29:08.004170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T10:29:08.004066+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T10:29:08.004066+0000","last_clean_scrub_stamp":"2024-04-25T10:29:08.004066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:18.969424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:29:09.722529+0000","last_change":"2024-04-25T10:29:09.722604+0000","last_active":"2024-04-25T10:29:09.722529+0000","last_peered":"2024-04-25T10:29:09.722529+0000","last_clean":"2024-04-25T10:29:09.722529+0000","last_became_active":"2024-04-25T10:25:37.196206+0000","last_became_peered":"2024-04-25T10:25:37.196206+0000","last_unstale":"2024-04-25T10:29:09.722529+0000","last_undegraded":"2024-04-25T10:29:09.722529+0000","last_fullsized":"2024-04-25T10:29:09.722529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T10:29:09.722300+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T10:29:09.722300+0000","last_clean_scrub_stamp":"2024-04-25T10:29:09.722300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:59.923992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":41301,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":77,"num_read_kb":80,"num_write":170,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":82602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":122200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":712464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":159727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":158193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":892928,"data_stored":711408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:29:42.475 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T10:29:42.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.789+0000 7f5a69200640 1 Processor -- start 2024-04-25T10:29:42.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.790+0000 7f5a69200640 1 -- start start 2024-04-25T10:29:42.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.792+0000 7f5a69200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a64153fa0 0x7f5a641543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.792+0000 7f5a69200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5a6406ef40 0x7f5a6406f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.792+0000 7f5a69200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a6415af60 con 0x7f5a6406fd20 2024-04-25T10:29:42.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.792+0000 7f5a69200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f5a641548f0 con 0x7f5a6406ef40 2024-04-25T10:29:42.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.792+0000 7f5a69200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5a640c6dd0 con 0x7f5a64153fa0 2024-04-25T10:29:42.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.792+0000 7f5a63e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5a6406ef40 0x7f5a6406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.792+0000 7f5a62a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a64153fa0 0x7f5a641543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.792+0000 7f5a63400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5a6406fd20 0x7f5a640c7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:37348/0 (socket says 172.21.15.19:37348) 2024-04-25T10:29:42.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.792+0000 7f5a63400640 1 -- 172.21.15.19:0/4275926388 learned_addr learned my addr 172.21.15.19:0/4275926388 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:29:42.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.793+0000 7f5a62000640 1 -- 172.21.15.19:0/4275926388 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185099248 0 0) 0x7f5a6415af60 con 0x7f5a6406fd20 2024-04-25T10:29:42.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.793+0000 7f5a62000640 1 -- 172.21.15.19:0/4275926388 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a48003520 con 0x7f5a6406fd20 2024-04-25T10:29:42.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.793+0000 7f5a62a00640 1 -- 172.21.15.19:0/4275926388 >> v2:172.21.15.19:3300/0 conn(0x7f5a6406ef40 msgr2=0x7f5a6406f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:29:42.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.793+0000 7f5a62a00640 1 --2- 172.21.15.19:0/4275926388 >> v2:172.21.15.19:3300/0 conn(0x7f5a6406ef40 0x7f5a6406f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.793+0000 7f5a62a00640 1 -- 172.21.15.19:0/4275926388 >> v1:172.21.15.112:6789/0 conn(0x7f5a6406fd20 legacy=0x7f5a640c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:42.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.793+0000 7f5a62a00640 1 -- 172.21.15.19:0/4275926388 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a640c61c0 con 0x7f5a64153fa0 2024-04-25T10:29:42.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.793+0000 7f5a63e00640 1 --2- 172.21.15.19:0/4275926388 >> v2:172.21.15.19:3300/0 conn(0x7f5a6406ef40 0x7f5a6406f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:42.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.794+0000 7f5a62a00640 1 --2- 172.21.15.19:0/4275926388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a64153fa0 0x7f5a641543b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5a500097a0 tx=0x7f5a5002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9169172ecf69ee0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:42.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.794+0000 7f5a62000640 1 -- 172.21.15.19:0/4275926388 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50037070 con 0x7f5a64153fa0 2024-04-25T10:29:42.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.795+0000 7f5a62000640 1 -- 172.21.15.19:0/4275926388 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a50032440 con 0x7f5a64153fa0 2024-04-25T10:29:42.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.795+0000 7f5a62000640 1 -- 172.21.15.19:0/4275926388 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50032810 con 0x7f5a64153fa0 2024-04-25T10:29:42.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.795+0000 7f5a69200640 1 -- 172.21.15.19:0/4275926388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a64153fa0 msgr2=0x7f5a641543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:42.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.795+0000 7f5a69200640 1 --2- 172.21.15.19:0/4275926388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a64153fa0 0x7f5a641543b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5a500097a0 tx=0x7f5a5002a210 comp rx=0 tx=0).stop 2024-04-25T10:29:42.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.796+0000 7f5a69200640 1 -- 172.21.15.19:0/4275926388 shutdown_connections 2024-04-25T10:29:42.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.796+0000 7f5a69200640 1 --2- 172.21.15.19:0/4275926388 >> v2:172.21.15.19:3300/0 conn(0x7f5a6406ef40 0x7f5a6406f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.796+0000 7f5a69200640 1 --2- 172.21.15.19:0/4275926388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a64153fa0 0x7f5a641543b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.796+0000 7f5a69200640 1 -- 172.21.15.19:0/4275926388 >> 172.21.15.19:0/4275926388 conn(0x7f5a640ca120 msgr2=0x7f5a640ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:42.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.796+0000 7f5a69200640 1 -- 172.21.15.19:0/4275926388 shutdown_connections 2024-04-25T10:29:42.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.796+0000 7f5a69200640 1 -- 172.21.15.19:0/4275926388 wait complete. 2024-04-25T10:29:42.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.798+0000 7f5a69200640 1 Processor -- start 2024-04-25T10:29:42.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.798+0000 7f5a69200640 1 -- start start 2024-04-25T10:29:42.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a69200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a6406ef40 0x7f5a64152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a69200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a6406fd20 0x7f5a64150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a69200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a64153fa0 0x7f5a640c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a69200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a640c6a60 con 0x7f5a64153fa0 2024-04-25T10:29:42.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a69200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5a640c6780 con 0x7f5a6406fd20 2024-04-25T10:29:42.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a69200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5a64073010 con 0x7f5a6406ef40 2024-04-25T10:29:42.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a63e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a64153fa0 0x7f5a640c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a63400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a6406ef40 0x7f5a64152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a62a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a6406fd20 0x7f5a64150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a63e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a64153fa0 0x7f5a640c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56736/0 (socket says 172.21.15.19:56736) 2024-04-25T10:29:42.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a63e00640 1 -- 172.21.15.19:0/3812483802 learned_addr learned my addr 172.21.15.19:0/3812483802 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:42.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a63e00640 1 -- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a6406ef40 msgr2=0x7f5a64152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:42.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.800+0000 7f5a63e00640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a6406ef40 0x7f5a64152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.801+0000 7f5a63e00640 1 -- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a6406fd20 msgr2=0x7f5a64150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:42.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.801+0000 7f5a63e00640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a6406fd20 0x7f5a64150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:42.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.801+0000 7f5a63e00640 1 -- 172.21.15.19:0/3812483802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a64152f90 con 0x7f5a64153fa0 2024-04-25T10:29:42.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.801+0000 7f5a63e00640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a64153fa0 0x7f5a640c3870 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00e850 tx=0x7f5a5c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:42.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.801+0000 7f5a5b400640 1 -- 172.21.15.19:0/3812483802 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c017070 con 0x7f5a64153fa0 2024-04-25T10:29:42.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.801+0000 7f5a5b400640 1 -- 172.21.15.19:0/3812483802 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5c00c8e0 con 0x7f5a64153fa0 2024-04-25T10:29:42.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.801+0000 7f5a69200640 1 -- 172.21.15.19:0/3812483802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a641519f0 con 0x7f5a64153fa0 2024-04-25T10:29:42.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.801+0000 7f5a5b400640 1 -- 172.21.15.19:0/3812483802 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c00cc90 con 0x7f5a64153fa0 2024-04-25T10:29:42.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.801+0000 7f5a69200640 1 -- 172.21.15.19:0/3812483802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a64151c90 con 0x7f5a64153fa0 2024-04-25T10:29:42.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.802+0000 7f5a69200640 1 -- 172.21.15.19:0/3812483802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a64076520 con 0x7f5a64153fa0 2024-04-25T10:29:42.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.804+0000 7f5a5b400640 1 -- 172.21.15.19:0/3812483802 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5a5c01a070 con 0x7f5a64153fa0 2024-04-25T10:29:42.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.805+0000 7f5a5b400640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5a440744e0 0x7f5a440769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:42.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.805+0000 7f5a5b400640 1 -- 172.21.15.19:0/3812483802 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f5a5c095340 con 0x7f5a64153fa0 2024-04-25T10:29:42.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.805+0000 7f5a63400640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5a440744e0 0x7f5a440769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:42.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.806+0000 7f5a63400640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5a440744e0 0x7f5a440769f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a54005c00 tx=0x7f5a54009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:42.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:42.810+0000 7f5a5b400640 1 -- 172.21.15.19:0/3812483802 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a5c05f0a0 con 0x7f5a64153fa0 2024-04-25T10:29:43.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.013+0000 7f5a69200640 1 -- 172.21.15.19:0/3812483802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f5a64157e90 con 0x7f5a64153fa0 2024-04-25T10:29:43.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.021+0000 7f5a5b400640 1 -- 172.21.15.19:0/3812483802 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f5a5c0633a0 con 0x7f5a64153fa0 2024-04-25T10:29:43.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.024+0000 7f5a5b400640 1 -- 172.21.15.19:0/3812483802 <== mon.0 v2:172.21.15.19:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5a5c00ce30 con 0x7f5a64153fa0 2024-04-25T10:29:43.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 -- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5a440744e0 msgr2=0x7f5a440769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5a440744e0 0x7f5a440769f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a54005c00 tx=0x7f5a54009040 comp rx=0 tx=0).stop 2024-04-25T10:29:43.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 -- 172.21.15.19:0/3812483802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a64153fa0 msgr2=0x7f5a640c3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a64153fa0 0x7f5a640c3870 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00e850 tx=0x7f5a5c00ed10 comp rx=0 tx=0).stop 2024-04-25T10:29:43.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 -- 172.21.15.19:0/3812483802 shutdown_connections 2024-04-25T10:29:43.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a64153fa0 0x7f5a640c3870 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a6406fd20 0x7f5a64150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f5a440744e0 0x7f5a440769f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 --2- 172.21.15.19:0/3812483802 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5a6406ef40 0x7f5a64152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 -- 172.21.15.19:0/3812483802 >> 172.21.15.19:0/3812483802 conn(0x7f5a640ca120 msgr2=0x7f5a641593e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:43.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 -- 172.21.15.19:0/3812483802 shutdown_connections 2024-04-25T10:29:43.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.026+0000 7f5a69200640 1 -- 172.21.15.19:0/3812483802 wait complete. 2024-04-25T10:29:43.062 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:29:43.062 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:29:43.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.345+0000 7f9c00000640 1 Processor -- start 2024-04-25T10:29:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.345+0000 7f9c00000640 1 -- start start 2024-04-25T10:29:43.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.347+0000 7f9c00000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9bf8156850 0x7f9bf815d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:43.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.347+0000 7f9c00000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf8074460 0x7f9bf80ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:43.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.347+0000 7f9c00000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf80af780 con 0x7f9bf80cdde0 2024-04-25T10:29:43.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.347+0000 7f9c00000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf815d540 con 0x7f9bf8156850 2024-04-25T10:29:43.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.347+0000 7f9c00000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf8156c60 con 0x7f9bf8074460 2024-04-25T10:29:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.348+0000 7f9bfcc00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9bf80cdde0 0x7f9bf8073d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:37364/0 (socket says 172.21.15.19:37364) 2024-04-25T10:29:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.348+0000 7f9bfcc00640 1 -- 172.21.15.19:0/1079624038 learned_addr learned my addr 172.21.15.19:0/1079624038 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:29:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.348+0000 7f9bfd600640 1 --2- 172.21.15.19:0/1079624038 >> v2:172.21.15.19:3300/0 conn(0x7f9bf8156850 0x7f9bf815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.348+0000 7f9bfe000640 1 --2- 172.21.15.19:0/1079624038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf8074460 0x7f9bf80ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.348+0000 7f9bf7e00640 1 -- 172.21.15.19:0/1079624038 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 197443972 0 0) 0x7f9bf80af780 con 0x7f9bf80cdde0 2024-04-25T10:29:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.348+0000 7f9bf7e00640 1 -- 172.21.15.19:0/1079624038 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9be0003520 con 0x7f9bf80cdde0 2024-04-25T10:29:43.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.348+0000 7f9bfe000640 1 -- 172.21.15.19:0/1079624038 >> v2:172.21.15.19:3300/0 conn(0x7f9bf8156850 msgr2=0x7f9bf815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:29:43.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.348+0000 7f9bfe000640 1 --2- 172.21.15.19:0/1079624038 >> v2:172.21.15.19:3300/0 conn(0x7f9bf8156850 0x7f9bf815d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.348+0000 7f9bfe000640 1 -- 172.21.15.19:0/1079624038 >> v1:172.21.15.112:6789/0 conn(0x7f9bf80cdde0 legacy=0x7f9bf8073d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.348+0000 7f9bfe000640 1 -- 172.21.15.19:0/1079624038 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf80af1c0 con 0x7f9bf8074460 2024-04-25T10:29:43.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.350+0000 7f9bfe000640 1 --2- 172.21.15.19:0/1079624038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf8074460 0x7f9bf80ce1f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009d90 tx=0x7f9bf002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66f0f5590f352890 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:43.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.350+0000 7f9bf7e00640 1 -- 172.21.15.19:0/1079624038 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0007740 con 0x7f9bf8074460 2024-04-25T10:29:43.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.350+0000 7f9bf7e00640 1 -- 172.21.15.19:0/1079624038 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9bf00078e0 con 0x7f9bf8074460 2024-04-25T10:29:43.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.350+0000 7f9bf7e00640 1 -- 172.21.15.19:0/1079624038 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0007c90 con 0x7f9bf8074460 2024-04-25T10:29:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.351+0000 7f9c00000640 1 -- 172.21.15.19:0/1079624038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf8074460 msgr2=0x7f9bf80ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.351+0000 7f9c00000640 1 --2- 172.21.15.19:0/1079624038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf8074460 0x7f9bf80ce1f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009d90 tx=0x7f9bf002a6f0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.351+0000 7f9c00000640 1 -- 172.21.15.19:0/1079624038 shutdown_connections 2024-04-25T10:29:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.351+0000 7f9c00000640 1 --2- 172.21.15.19:0/1079624038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf8074460 0x7f9bf80ce1f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.351+0000 7f9c00000640 1 --2- 172.21.15.19:0/1079624038 >> v2:172.21.15.19:3300/0 conn(0x7f9bf8156850 0x7f9bf815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.351+0000 7f9c00000640 1 -- 172.21.15.19:0/1079624038 >> 172.21.15.19:0/1079624038 conn(0x7f9bf806f1f0 msgr2=0x7f9bf806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.351+0000 7f9c00000640 1 -- 172.21.15.19:0/1079624038 shutdown_connections 2024-04-25T10:29:43.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.351+0000 7f9c00000640 1 -- 172.21.15.19:0/1079624038 wait complete. 2024-04-25T10:29:43.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.354+0000 7f9c00000640 1 Processor -- start 2024-04-25T10:29:43.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.354+0000 7f9c00000640 1 -- start start 2024-04-25T10:29:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.355+0000 7f9c00000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bf8074460 0x7f9bf81f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.355+0000 7f9c00000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf80cdde0 0x7f9bf80b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.355+0000 7f9c00000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf8156850 0x7f9bf8155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.355+0000 7f9c00000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf8073550 con 0x7f9bf8074460 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.355+0000 7f9c00000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf8073270 con 0x7f9bf8156850 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.355+0000 7f9c00000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf8073830 con 0x7f9bf80cdde0 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.356+0000 7f9bfcc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf80cdde0 0x7f9bf80b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.356+0000 7f9bfe000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf8156850 0x7f9bf8155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.356+0000 7f9bfe000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf8156850 0x7f9bf8155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:60182/0 (socket says 172.21.15.19:60182) 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.356+0000 7f9bfe000640 1 -- 172.21.15.19:0/1226819085 learned_addr learned my addr 172.21.15.19:0/1226819085 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.356+0000 7f9bfd600640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bf8074460 0x7f9bf81f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.356+0000 7f9bfe000640 1 -- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf80cdde0 msgr2=0x7f9bf80b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.356+0000 7f9bfe000640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf80cdde0 0x7f9bf80b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.356+0000 7f9bfe000640 1 -- 172.21.15.19:0/1226819085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bf8074460 msgr2=0x7f9bf81f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.356+0000 7f9bfe000640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bf8074460 0x7f9bf81f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.356+0000 7f9bfe000640 1 -- 172.21.15.19:0/1226819085 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf8153360 con 0x7f9bf8156850 2024-04-25T10:29:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.356+0000 7f9bfcc00640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf80cdde0 0x7f9bf80b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.357+0000 7f9bfe000640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf8156850 0x7f9bf8155330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009d90 tx=0x7f9bf0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.357+0000 7f9bf5600640 1 -- 172.21.15.19:0/1226819085 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0009450 con 0x7f9bf8156850 2024-04-25T10:29:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.357+0000 7f9bf5600640 1 -- 172.21.15.19:0/1226819085 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9bf0043070 con 0x7f9bf8156850 2024-04-25T10:29:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.357+0000 7f9c00000640 1 -- 172.21.15.19:0/1226819085 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf80b17e0 con 0x7f9bf8156850 2024-04-25T10:29:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.357+0000 7f9bf5600640 1 -- 172.21.15.19:0/1226819085 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00044a0 con 0x7f9bf8156850 2024-04-25T10:29:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.357+0000 7f9c00000640 1 -- 172.21.15.19:0/1226819085 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf80b07c0 con 0x7f9bf8156850 2024-04-25T10:29:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.358+0000 7f9c00000640 1 -- 172.21.15.19:0/1226819085 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf8076520 con 0x7f9bf8156850 2024-04-25T10:29:43.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.359+0000 7f9bf5600640 1 -- 172.21.15.19:0/1226819085 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9bf0004640 con 0x7f9bf8156850 2024-04-25T10:29:43.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.360+0000 7f9bf5600640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9bd80744e0 0x7f9bd80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:43.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.360+0000 7f9bf5600640 1 -- 172.21.15.19:0/1226819085 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f9bf00b66b0 con 0x7f9bf8156850 2024-04-25T10:29:43.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.361+0000 7f9bfd600640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9bd80744e0 0x7f9bd80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:43.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.361+0000 7f9bfd600640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9bd80744e0 0x7f9bd80769f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009aa0 tx=0x7f9bec009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:43.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.365+0000 7f9bf5600640 1 -- 172.21.15.19:0/1226819085 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9bf8153360 con 0x7f9bf8156850 2024-04-25T10:29:43.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.609+0000 7f9c00000640 1 -- 172.21.15.19:0/1226819085 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bf814d3d0 con 0x7f9bf8156850 2024-04-25T10:29:43.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.610+0000 7f9bf5600640 1 -- 172.21.15.19:0/1226819085 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6877 (secure 0 0 0) 0x7f9bf0080380 con 0x7f9bf8156850 2024-04-25T10:29:43.613 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:29:43.613 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/103564411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":103564411},{"type":"v1","addr":"172.21.15.112:6837","nonce":103564411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:28:02.709081+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":42,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309,4288,4282]},"id":1}]} 2024-04-25T10:29:43.613 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 20 2024-04-25T10:29:43.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.612+0000 7f9c00000640 1 -- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9bd80744e0 msgr2=0x7f9bd80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.612+0000 7f9c00000640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9bd80744e0 0x7f9bd80769f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009aa0 tx=0x7f9bec009190 comp rx=0 tx=0).stop 2024-04-25T10:29:43.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.612+0000 7f9c00000640 1 -- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf8156850 msgr2=0x7f9bf8155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.612+0000 7f9c00000640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf8156850 0x7f9bf8155330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009d90 tx=0x7f9bf0004a40 comp rx=0 tx=0).stop 2024-04-25T10:29:43.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.612+0000 7f9c00000640 1 -- 172.21.15.19:0/1226819085 shutdown_connections 2024-04-25T10:29:43.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.612+0000 7f9c00000640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf8156850 0x7f9bf8155330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.612+0000 7f9c00000640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f9bd80744e0 0x7f9bd80769f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.612+0000 7f9c00000640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9bf80cdde0 0x7f9bf80b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.612+0000 7f9c00000640 1 --2- 172.21.15.19:0/1226819085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bf8074460 0x7f9bf81f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.612+0000 7f9c00000640 1 -- 172.21.15.19:0/1226819085 >> 172.21.15.19:0/1226819085 conn(0x7f9bf806f1f0 msgr2=0x7f9bf80cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:43.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.613+0000 7f9c00000640 1 -- 172.21.15.19:0/1226819085 shutdown_connections 2024-04-25T10:29:43.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.613+0000 7f9c00000640 1 -- 172.21.15.19:0/1226819085 wait complete. 2024-04-25T10:29:43.640 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:29:43.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.914+0000 7f4d11200640 1 Processor -- start 2024-04-25T10:29:43.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.914+0000 7f4d11200640 1 -- start start 2024-04-25T10:29:43.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.917+0000 7f4d11200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d0c0c9810 0x7f4d0c165e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:43.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.917+0000 7f4d11200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c158010 con 0x7f4d0c15b2c0 2024-04-25T10:29:43.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.917+0000 7f4d11200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c074970 con 0x7f4d0c073160 2024-04-25T10:29:43.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.917+0000 7f4d11200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c0c8600 con 0x7f4d0c0c9810 2024-04-25T10:29:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.917+0000 7f4d09e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4d0c15b2c0 0x7f4d0c15e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40234/0 (socket says 172.21.15.19:40234) 2024-04-25T10:29:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.917+0000 7f4d09e00640 1 -- 172.21.15.19:0/986357723 learned_addr learned my addr 172.21.15.19:0/986357723 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:29:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.917+0000 7f4d0a800640 1 --2- 172.21.15.19:0/986357723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d0c0c9810 0x7f4d0c165e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.917+0000 7f4d09400640 1 -- 172.21.15.19:0/986357723 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463186104 0 0) 0x7f4d0c074970 con 0x7f4d0c073160 2024-04-25T10:29:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.917+0000 7f4d09400640 1 -- 172.21.15.19:0/986357723 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf0003520 con 0x7f4d0c073160 2024-04-25T10:29:43.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.918+0000 7f4d09400640 1 -- 172.21.15.19:0/986357723 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 228613012 0 0) 0x7f4d0c158010 con 0x7f4d0c15b2c0 2024-04-25T10:29:43.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.918+0000 7f4d09400640 1 -- 172.21.15.19:0/986357723 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d0c074970 con 0x7f4d0c15b2c0 2024-04-25T10:29:43.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.918+0000 7f4d0a800640 1 -- 172.21.15.19:0/986357723 >> v1:172.21.15.112:6789/0 conn(0x7f4d0c073160 legacy=0x7f4d0c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.918+0000 7f4d0a800640 1 -- 172.21.15.19:0/986357723 >> v1:172.21.15.19:6789/0 conn(0x7f4d0c15b2c0 legacy=0x7f4d0c15e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.918+0000 7f4d0a800640 1 -- 172.21.15.19:0/986357723 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c0c88e0 con 0x7f4d0c0c9810 2024-04-25T10:29:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.919+0000 7f4d0a800640 1 --2- 172.21.15.19:0/986357723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d0c0c9810 0x7f4d0c165e30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009dc0 tx=0x7f4d0402a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb8b7d49377e428 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.919+0000 7f4d09400640 1 -- 172.21.15.19:0/986357723 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04007740 con 0x7f4d0c0c9810 2024-04-25T10:29:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.919+0000 7f4d09400640 1 -- 172.21.15.19:0/986357723 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4d040078e0 con 0x7f4d0c0c9810 2024-04-25T10:29:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.919+0000 7f4d09400640 1 -- 172.21.15.19:0/986357723 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04007cd0 con 0x7f4d0c0c9810 2024-04-25T10:29:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.920+0000 7f4d11200640 1 -- 172.21.15.19:0/986357723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d0c0c9810 msgr2=0x7f4d0c165e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.920+0000 7f4d11200640 1 --2- 172.21.15.19:0/986357723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d0c0c9810 0x7f4d0c165e30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009dc0 tx=0x7f4d0402a760 comp rx=0 tx=0).stop 2024-04-25T10:29:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.920+0000 7f4d11200640 1 -- 172.21.15.19:0/986357723 shutdown_connections 2024-04-25T10:29:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.920+0000 7f4d11200640 1 --2- 172.21.15.19:0/986357723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d0c0c9810 0x7f4d0c165e30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.920+0000 7f4d11200640 1 -- 172.21.15.19:0/986357723 >> 172.21.15.19:0/986357723 conn(0x7f4d0c06f1f0 msgr2=0x7f4d0c06f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.920+0000 7f4d11200640 1 -- 172.21.15.19:0/986357723 shutdown_connections 2024-04-25T10:29:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.920+0000 7f4d11200640 1 -- 172.21.15.19:0/986357723 wait complete. 2024-04-25T10:29:43.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.922+0000 7f4d11200640 1 Processor -- start 2024-04-25T10:29:43.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.923+0000 7f4d11200640 1 -- start start 2024-04-25T10:29:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.924+0000 7f4d11200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d0c073160 0x7f4d0c152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.924+0000 7f4d11200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d0c0c9810 0x7f4d0c156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.924+0000 7f4d11200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d0c15b6a0 0x7f4d0c0c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.924+0000 7f4d11200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c06d4c0 con 0x7f4d0c0c9810 2024-04-25T10:29:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.924+0000 7f4d11200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c15a580 con 0x7f4d0c073160 2024-04-25T10:29:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.924+0000 7f4d11200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c15e930 con 0x7f4d0c15b6a0 2024-04-25T10:29:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.924+0000 7f4d03e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d0c0c9810 0x7f4d0c156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.924+0000 7f4d03e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d0c0c9810 0x7f4d0c156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56770/0 (socket says 172.21.15.19:56770) 2024-04-25T10:29:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.924+0000 7f4d03e00640 1 -- 172.21.15.19:0/567161495 learned_addr learned my addr 172.21.15.19:0/567161495 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:43.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.924+0000 7f4d09e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d0c073160 0x7f4d0c152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:43.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.924+0000 7f4d0a800640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d0c15b6a0 0x7f4d0c0c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.925+0000 7f4d03e00640 1 -- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d0c15b6a0 msgr2=0x7f4d0c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.925+0000 7f4d03e00640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d0c15b6a0 0x7f4d0c0c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.925+0000 7f4d03e00640 1 -- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d0c073160 msgr2=0x7f4d0c152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.925+0000 7f4d03e00640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d0c073160 0x7f4d0c152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.925+0000 7f4d03e00640 1 -- 172.21.15.19:0/567161495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c153280 con 0x7f4d0c0c9810 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.925+0000 7f4d09e00640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d0c073160 0x7f4d0c152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.925+0000 7f4d03e00640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d0c0c9810 0x7f4d0c156910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c430 tx=0x7f4cf400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.926+0000 7f4d02000640 1 -- 172.21.15.19:0/567161495 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4017070 con 0x7f4d0c0c9810 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.926+0000 7f4d02000640 1 -- 172.21.15.19:0/567161495 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4cf40052d0 con 0x7f4d0c0c9810 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.926+0000 7f4d02000640 1 -- 172.21.15.19:0/567161495 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4003850 con 0x7f4d0c0c9810 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.926+0000 7f4d11200640 1 -- 172.21.15.19:0/567161495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c15cdf0 con 0x7f4d0c0c9810 2024-04-25T10:29:43.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.926+0000 7f4d11200640 1 -- 172.21.15.19:0/567161495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0c15d3b0 con 0x7f4d0c0c9810 2024-04-25T10:29:43.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.927+0000 7f4d11200640 1 -- 172.21.15.19:0/567161495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0c155160 con 0x7f4d0c0c9810 2024-04-25T10:29:43.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.928+0000 7f4d02000640 1 -- 172.21.15.19:0/567161495 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4cf401a070 con 0x7f4d0c0c9810 2024-04-25T10:29:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.929+0000 7f4d02000640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ce80744b0 0x7f4ce80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:43.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.929+0000 7f4d02000640 1 -- 172.21.15.19:0/567161495 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7f4cf4094ab0 con 0x7f4d0c0c9810 2024-04-25T10:29:43.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.930+0000 7f4d09e00640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ce80744b0 0x7f4ce80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:43.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.930+0000 7f4d09e00640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ce80744b0 0x7f4ce80769c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0011e0 tx=0x7f4cfc007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:43.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:43.934+0000 7f4d02000640 1 -- 172.21.15.19:0/567161495 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4cf405e840 con 0x7f4d0c0c9810 2024-04-25T10:29:44.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.177+0000 7f4d11200640 1 -- 172.21.15.19:0/567161495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d0c076520 con 0x7f4d0c0c9810 2024-04-25T10:29:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.179+0000 7f4d02000640 1 -- 172.21.15.19:0/567161495 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6877 (secure 0 0 0) 0x7f4cf4062b40 con 0x7f4d0c0c9810 2024-04-25T10:29:44.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:29:44.182 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1773190450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1773190450},{"type":"v1","addr":"172.21.15.19:6837","nonce":1773190450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/2830282623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2830282623},{"type":"v1","addr":"172.21.15.19:6833","nonce":2830282623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/103564411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":103564411},{"type":"v1","addr":"172.21.15.112:6837","nonce":103564411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:25:36.724799+0000","modified":"2024-04-25T10:28:02.709081+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4288,"mds_2":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":42,"addr":"172.21.15.112:6835/3446267878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3446267878},{"type":"v1","addr":"172.21.15.112:6835","nonce":3446267878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6839/3638094761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":3638094761},{"type":"v1","addr":"172.21.15.112:6839","nonce":3638094761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4309":{"gid":4309,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6835/1037719859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1037719859},{"type":"v1","addr":"172.21.15.19:6835","nonce":1037719859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309,4288,4282]},"id":1}]} 2024-04-25T10:29:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 20 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 -- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ce80744b0 msgr2=0x7f4ce80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ce80744b0 0x7f4ce80769c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0011e0 tx=0x7f4cfc007d30 comp rx=0 tx=0).stop 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 -- 172.21.15.19:0/567161495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d0c0c9810 msgr2=0x7f4d0c156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d0c0c9810 0x7f4d0c156910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c430 tx=0x7f4cf400c8f0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 -- 172.21.15.19:0/567161495 shutdown_connections 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7f4ce80744b0 0x7f4ce80769c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d0c15b6a0 0x7f4d0c0c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d0c0c9810 0x7f4d0c156910 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 --2- 172.21.15.19:0/567161495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d0c073160 0x7f4d0c152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 -- 172.21.15.19:0/567161495 >> 172.21.15.19:0/567161495 conn(0x7f4d0c06f1f0 msgr2=0x7f4d0c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 -- 172.21.15.19:0/567161495 shutdown_connections 2024-04-25T10:29:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.182+0000 7f4d11200640 1 -- 172.21.15.19:0/567161495 wait complete. 2024-04-25T10:29:44.215 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:29:44.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.476+0000 7fbfa7e00640 1 Processor -- start 2024-04-25T10:29:44.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.476+0000 7fbfa7e00640 1 -- start start 2024-04-25T10:29:44.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.478+0000 7fbfa7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbfa80c4f90 0x7fbfa8071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:44.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.478+0000 7fbfa7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfa8164cd0 0x7fbfa81670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:44.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.478+0000 7fbfa7e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa8156ba0 con 0x7fbfa8160580 2024-04-25T10:29:44.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.478+0000 7fbfa7e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa8071670 con 0x7fbfa80c4f90 2024-04-25T10:29:44.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.478+0000 7fbfa7e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa80ca850 con 0x7fbfa8164cd0 2024-04-25T10:29:44.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.478+0000 7fbf9e000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbfa80c4f90 0x7fbfa8071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:44.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.478+0000 7fbfa6a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbfa8160580 0x7fbfa806e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:37384/0 (socket says 172.21.15.19:37384) 2024-04-25T10:29:44.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.478+0000 7fbfa6a00640 1 -- 172.21.15.19:0/2318302751 learned_addr learned my addr 172.21.15.19:0/2318302751 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:29:44.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.478+0000 7fbfa7400640 1 --2- 172.21.15.19:0/2318302751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfa8164cd0 0x7fbfa81670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:44.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.479+0000 7fbf9e000640 1 -- 172.21.15.19:0/2318302751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfa8164cd0 msgr2=0x7fbfa81670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:29:44.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.479+0000 7fbf9e000640 1 --2- 172.21.15.19:0/2318302751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfa8164cd0 0x7fbfa81670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.479+0000 7fbf9e000640 1 -- 172.21.15.19:0/2318302751 >> v1:172.21.15.112:6789/0 conn(0x7fbfa8160580 legacy=0x7fbfa806e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:44.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.479+0000 7fbf9e000640 1 -- 172.21.15.19:0/2318302751 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa808d760 con 0x7fbfa80c4f90 2024-04-25T10:29:44.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.479+0000 7fbfa6000640 1 -- 172.21.15.19:0/2318302751 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937050504 0 0) 0x7fbfa8156ba0 con 0x7fbfa8160580 2024-04-25T10:29:44.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.480+0000 7fbf9e000640 1 --2- 172.21.15.19:0/2318302751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa80c4f90 0x7fbfa8071130 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbf900097a0 tx=0x7fbf9002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9b407cdce0c7dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:44.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.480+0000 7fbfa6000640 1 -- 172.21.15.19:0/2318302751 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90037070 con 0x7fbfa80c4f90 2024-04-25T10:29:44.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.480+0000 7fbfa6000640 1 -- 172.21.15.19:0/2318302751 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbf90032440 con 0x7fbfa80c4f90 2024-04-25T10:29:44.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.480+0000 7fbfa6000640 1 -- 172.21.15.19:0/2318302751 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90032830 con 0x7fbfa80c4f90 2024-04-25T10:29:44.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.481+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2318302751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa80c4f90 msgr2=0x7fbfa8071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:44.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.481+0000 7fbfa7e00640 1 --2- 172.21.15.19:0/2318302751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa80c4f90 0x7fbfa8071130 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbf900097a0 tx=0x7fbf9002a180 comp rx=0 tx=0).stop 2024-04-25T10:29:44.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.481+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2318302751 shutdown_connections 2024-04-25T10:29:44.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.481+0000 7fbfa7e00640 1 --2- 172.21.15.19:0/2318302751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfa8164cd0 0x7fbfa81670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.481+0000 7fbfa7e00640 1 --2- 172.21.15.19:0/2318302751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa80c4f90 0x7fbfa8071130 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.481+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2318302751 >> 172.21.15.19:0/2318302751 conn(0x7fbfa8068fc0 msgr2=0x7fbfa8072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:44.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.481+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2318302751 shutdown_connections 2024-04-25T10:29:44.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.481+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2318302751 wait complete. 2024-04-25T10:29:44.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.483+0000 7fbfa7e00640 1 Processor -- start 2024-04-25T10:29:44.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.484+0000 7fbfa7e00640 1 -- start start 2024-04-25T10:29:44.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.485+0000 7fbfa7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa80c4f90 0x7fbfa8152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:44.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.485+0000 7fbfa7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfa8160580 0x7fbfa8157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:44.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.485+0000 7fbfa7e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfa8164cd0 0x7fbfa8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:44.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.485+0000 7fbfa7e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa80ca570 con 0x7fbfa8164cd0 2024-04-25T10:29:44.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.485+0000 7fbfa7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa81600f0 con 0x7fbfa80c4f90 2024-04-25T10:29:44.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.485+0000 7fbfa7e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa815faa0 con 0x7fbfa8160580 2024-04-25T10:29:44.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.485+0000 7fbfa7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfa8164cd0 0x7fbfa8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:44.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.485+0000 7fbfa7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfa8164cd0 0x7fbfa8157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56786/0 (socket says 172.21.15.19:56786) 2024-04-25T10:29:44.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.485+0000 7fbfa7400640 1 -- 172.21.15.19:0/2737746188 learned_addr learned my addr 172.21.15.19:0/2737746188 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:44.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.485+0000 7fbfa6a00640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa80c4f90 0x7fbfa8152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:44.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.485+0000 7fbf9e000640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfa8160580 0x7fbfa8157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:44.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.486+0000 7fbfa7400640 1 -- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfa8160580 msgr2=0x7fbfa8157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:44.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.486+0000 7fbfa7400640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfa8160580 0x7fbfa8157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.486+0000 7fbfa7400640 1 -- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa80c4f90 msgr2=0x7fbfa8152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:44.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.486+0000 7fbfa7400640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa80c4f90 0x7fbfa8152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.486+0000 7fbfa7400640 1 -- 172.21.15.19:0/2737746188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa815dd30 con 0x7fbfa8164cd0 2024-04-25T10:29:44.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.486+0000 7fbfa7400640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfa8164cd0 0x7fbfa8157e70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000e7c0 tx=0x7fbfa000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:44.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.486+0000 7fbf9f400640 1 -- 172.21.15.19:0/2737746188 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0017070 con 0x7fbfa8164cd0 2024-04-25T10:29:44.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.486+0000 7fbf9f400640 1 -- 172.21.15.19:0/2737746188 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbfa000c6d0 con 0x7fbfa8164cd0 2024-04-25T10:29:44.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.486+0000 7fbf9f400640 1 -- 172.21.15.19:0/2737746188 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa000cae0 con 0x7fbfa8164cd0 2024-04-25T10:29:44.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.486+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2737746188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa81f5ee0 con 0x7fbfa8164cd0 2024-04-25T10:29:44.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.487+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2737746188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa81f2b70 con 0x7fbfa8164cd0 2024-04-25T10:29:44.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.488+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2737746188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa8050740 con 0x7fbfa8164cd0 2024-04-25T10:29:44.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.489+0000 7fbf9f400640 1 -- 172.21.15.19:0/2737746188 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbfa001a070 con 0x7fbfa8164cd0 2024-04-25T10:29:44.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.490+0000 7fbf9f400640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf840744b0 0x7fbf840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:44.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.491+0000 7fbf9f400640 1 -- 172.21.15.19:0/2737746188 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7fbfa00956b0 con 0x7fbfa8164cd0 2024-04-25T10:29:44.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.491+0000 7fbfa6a00640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf840744b0 0x7fbf840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:44.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.492+0000 7fbfa6a00640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf840744b0 0x7fbf840769c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbf980012e0 tx=0x7fbf98004d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:44.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.495+0000 7fbf9f400640 1 -- 172.21.15.19:0/2737746188 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbfa005f410 con 0x7fbfa8164cd0 2024-04-25T10:29:44.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.695+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2737746188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfa815fd70 con 0x7fbfa8164cd0 2024-04-25T10:29:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.699+0000 7fbf9f400640 1 -- 172.21.15.19:0/2737746188 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18745 (secure 0 0 0) 0x7fbfa0063710 con 0x7fbfa8164cd0 2024-04-25T10:29:44.701 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-04-25T10:29:44.702 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"03c2053f-8374-429e-9fda-d77b86219935","created":"2024-04-25T10:25:12.395349+0000","modified":"2024-04-25T10:27:42.417364+0000","last_up_change":"2024-04-25T10:25:23.753026+0000","last_in_change":"2024-04-25T10:25:14.782322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:25:24.611615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:25:34.760347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:25:35.692430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:25:39.212157+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6023414-347e-4b8d-b8d1-262e4ab0c784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6825","nonce":3943322367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6827","nonce":3943322367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6831","nonce":3943322367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3943322367},{"type":"v1","addr":"172.21.15.19:6829","nonce":3943322367}]},"public_addr":"172.21.15.19:6825/3943322367","cluster_addr":"172.21.15.19:6827/3943322367","heartbeat_back_addr":"172.21.15.19:6831/3943322367","heartbeat_front_addr":"172.21.15.19:6829/3943322367","state":["exists","up"]},{"osd":1,"uuid":"2c84598b-be53-4b76-8dea-b8f0221b1005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6809","nonce":2909216045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6811","nonce":2909216045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6815","nonce":2909216045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2909216045},{"type":"v1","addr":"172.21.15.19:6813","nonce":2909216045}]},"public_addr":"172.21.15.19:6809/2909216045","cluster_addr":"172.21.15.19:6811/2909216045","heartbeat_back_addr":"172.21.15.19:6815/2909216045","heartbeat_front_addr":"172.21.15.19:6813/2909216045","state":["exists","up"]},{"osd":2,"uuid":"d9b4e5c7-a6bd-4d44-a557-e236e9c3b424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6817","nonce":1878337170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6819","nonce":1878337170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6823","nonce":1878337170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1878337170},{"type":"v1","addr":"172.21.15.19:6821","nonce":1878337170}]},"public_addr":"172.21.15.19:6817/1878337170","cluster_addr":"172.21.15.19:6819/1878337170","heartbeat_back_addr":"172.21.15.19:6823/1878337170","heartbeat_front_addr":"172.21.15.19:6821/1878337170","state":["exists","up"]},{"osd":3,"uuid":"60a7a433-9130-4eec-af44-a7967414087b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6801","nonce":2283064072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6803","nonce":2283064072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6807","nonce":2283064072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2283064072},{"type":"v1","addr":"172.21.15.19:6805","nonce":2283064072}]},"public_addr":"172.21.15.19:6801/2283064072","cluster_addr":"172.21.15.19:6803/2283064072","heartbeat_back_addr":"172.21.15.19:6807/2283064072","heartbeat_front_addr":"172.21.15.19:6805/2283064072","state":["exists","up"]},{"osd":4,"uuid":"d5abf043-a82d-4eb7-a7d5-efd167704fc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6801","nonce":2833374228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6803","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6805","nonce":2833374228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6813","nonce":2833374228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6807","nonce":2833374228},{"type":"v1","addr":"172.21.15.112:6809","nonce":2833374228}]},"public_addr":"172.21.15.112:6801/2833374228","cluster_addr":"172.21.15.112:6805/2833374228","heartbeat_back_addr":"172.21.15.112:6813/2833374228","heartbeat_front_addr":"172.21.15.112:6809/2833374228","state":["exists","up"]},{"osd":5,"uuid":"955a9181-d839-4d55-baa6-5cf01cc4ae36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6817","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6819","nonce":667240234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6821","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6823","nonce":667240234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6831","nonce":667240234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6825","nonce":667240234},{"type":"v1","addr":"172.21.15.112:6827","nonce":667240234}]},"public_addr":"172.21.15.112:6819/667240234","cluster_addr":"172.21.15.112:6823/667240234","heartbeat_back_addr":"172.21.15.112:6831/667240234","heartbeat_front_addr":"172.21.15.112:6827/667240234","state":["exists","up"]},{"osd":6,"uuid":"d8d79c2f-4134-4bb6-915c-c500aacfe833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6818","nonce":1243277585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6822","nonce":1243277585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6829","nonce":1243277585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1243277585},{"type":"v1","addr":"172.21.15.112:6826","nonce":1243277585}]},"public_addr":"172.21.15.112:6818/1243277585","cluster_addr":"172.21.15.112:6822/1243277585","heartbeat_back_addr":"172.21.15.112:6829/1243277585","heartbeat_front_addr":"172.21.15.112:6826/1243277585","state":["exists","up"]},{"osd":7,"uuid":"d2b10694-e52d-4edc-a833-036b2a3af16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6804","nonce":1243256197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6808","nonce":1243256197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6815","nonce":1243256197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1243256197},{"type":"v1","addr":"172.21.15.112:6812","nonce":1243256197}]},"public_addr":"172.21.15.112:6804/1243256197","cluster_addr":"172.21.15.112:6808/1243256197","heartbeat_back_addr":"172.21.15.112:6815/1243256197","heartbeat_front_addr":"172.21.15.112:6812/1243256197","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.308246+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.273842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.289063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.052756+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:20.030527+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.985223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.938254+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:25:19.894373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/3008138931":"2024-04-26T10:27:42.417214+0000","172.21.15.112:6836/3008138931":"2024-04-26T10:27:42.417214+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:29:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf840744b0 msgr2=0x7fbf840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:44.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf840744b0 0x7fbf840769c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbf980012e0 tx=0x7fbf98004d40 comp rx=0 tx=0).stop 2024-04-25T10:29:44.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2737746188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfa8164cd0 msgr2=0x7fbfa8157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:44.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfa8164cd0 0x7fbfa8157e70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000e7c0 tx=0x7fbfa000ec80 comp rx=0 tx=0).stop 2024-04-25T10:29:44.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2737746188 shutdown_connections 2024-04-25T10:29:44.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfa8164cd0 0x7fbfa8157e70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf840744b0 0x7fbf840769c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfa8160580 0x7fbfa8157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 --2- 172.21.15.19:0/2737746188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa80c4f90 0x7fbfa8152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:44.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2737746188 >> 172.21.15.19:0/2737746188 conn(0x7fbfa8068fc0 msgr2=0x7fbfa80ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:44.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2737746188 shutdown_connections 2024-04-25T10:29:44.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:44.701+0000 7fbfa7e00640 1 -- 172.21.15.19:0/2737746188 wait complete. 2024-04-25T10:29:44.731 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:29:45.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.011+0000 7fdeb4600640 1 Processor -- start 2024-04-25T10:29:45.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.012+0000 7fdeb4600640 1 -- start start 2024-04-25T10:29:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.014+0000 7fdeb4600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15b2c0 0x7fdeac0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.014+0000 7fdeb4600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeac158010 con 0x7fdeac073160 2024-04-25T10:29:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.014+0000 7fdeb4600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeac074970 con 0x7fdeac0cdde0 2024-04-25T10:29:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.014+0000 7fdeb4600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdeac0c8600 con 0x7fdeac15b2c0 2024-04-25T10:29:45.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.015+0000 7fdeb1200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdeac073160 0x7fdeac15e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40240/0 (socket says 172.21.15.19:40240) 2024-04-25T10:29:45.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.015+0000 7fdeb1200640 1 -- 172.21.15.19:0/304397873 learned_addr learned my addr 172.21.15.19:0/304397873 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:29:45.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.015+0000 7fdeb1c00640 1 --2- 172.21.15.19:0/304397873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15b2c0 0x7fdeac0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:45.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.015+0000 7fdeabe00640 1 -- 172.21.15.19:0/304397873 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579147953 0 0) 0x7fdeac074970 con 0x7fdeac0cdde0 2024-04-25T10:29:45.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.015+0000 7fdeabe00640 1 -- 172.21.15.19:0/304397873 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde94003520 con 0x7fdeac0cdde0 2024-04-25T10:29:45.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.015+0000 7fdeabe00640 1 -- 172.21.15.19:0/304397873 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209484028 0 0) 0x7fdeac158010 con 0x7fdeac073160 2024-04-25T10:29:45.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.015+0000 7fdeabe00640 1 -- 172.21.15.19:0/304397873 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeac074970 con 0x7fdeac073160 2024-04-25T10:29:45.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.015+0000 7fdeb1c00640 1 -- 172.21.15.19:0/304397873 >> v1:172.21.15.112:6789/0 conn(0x7fdeac0cdde0 legacy=0x7fdeac164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:45.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.015+0000 7fdeb1c00640 1 -- 172.21.15.19:0/304397873 >> v1:172.21.15.19:6789/0 conn(0x7fdeac073160 legacy=0x7fdeac15e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:45.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.015+0000 7fdeb1c00640 1 -- 172.21.15.19:0/304397873 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac0c88e0 con 0x7fdeac15b2c0 2024-04-25T10:29:45.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.016+0000 7fdeb1c00640 1 --2- 172.21.15.19:0/304397873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15b2c0 0x7fdeac0c9810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009dc0 tx=0x7fdea002a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bf094686f7d207d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:45.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.017+0000 7fdeabe00640 1 -- 172.21.15.19:0/304397873 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea0007740 con 0x7fdeac15b2c0 2024-04-25T10:29:45.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.017+0000 7fdeabe00640 1 -- 172.21.15.19:0/304397873 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdea00078e0 con 0x7fdeac15b2c0 2024-04-25T10:29:45.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.017+0000 7fdeabe00640 1 -- 172.21.15.19:0/304397873 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea0007cd0 con 0x7fdeac15b2c0 2024-04-25T10:29:45.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.018+0000 7fdeb4600640 1 -- 172.21.15.19:0/304397873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15b2c0 msgr2=0x7fdeac0c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:45.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.018+0000 7fdeb4600640 1 --2- 172.21.15.19:0/304397873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15b2c0 0x7fdeac0c9810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009dc0 tx=0x7fdea002a760 comp rx=0 tx=0).stop 2024-04-25T10:29:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.018+0000 7fdeb4600640 1 -- 172.21.15.19:0/304397873 shutdown_connections 2024-04-25T10:29:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.018+0000 7fdeb4600640 1 --2- 172.21.15.19:0/304397873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15b2c0 0x7fdeac0c9810 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.018+0000 7fdeb4600640 1 -- 172.21.15.19:0/304397873 >> 172.21.15.19:0/304397873 conn(0x7fdeac06f1f0 msgr2=0x7fdeac06f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.018+0000 7fdeb4600640 1 -- 172.21.15.19:0/304397873 shutdown_connections 2024-04-25T10:29:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.018+0000 7fdeb4600640 1 -- 172.21.15.19:0/304397873 wait complete. 2024-04-25T10:29:45.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.020+0000 7fdeb4600640 1 Processor -- start 2024-04-25T10:29:45.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.021+0000 7fdeb4600640 1 -- start start 2024-04-25T10:29:45.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.022+0000 7fdeb4600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac073160 0x7fdeac15c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:45.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.022+0000 7fdeb4600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac0cdde0 0x7fdeac1f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.022+0000 7fdeb4600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac070d90 0x7fdeac0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.022+0000 7fdeb4600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac06d4c0 con 0x7fdeac070d90 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.022+0000 7fdeb4600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac15a580 con 0x7fdeac073160 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.022+0000 7fdeb4600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdeac15e930 con 0x7fdeac0cdde0 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.022+0000 7fdeb1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac073160 0x7fdeac15c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.022+0000 7fdeb1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac073160 0x7fdeac15c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:60210/0 (socket says 172.21.15.19:60210) 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.022+0000 7fdeb1c00640 1 -- 172.21.15.19:0/794603046 learned_addr learned my addr 172.21.15.19:0/794603046 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.022+0000 7fdeb1200640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac0cdde0 0x7fdeac1f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.022+0000 7fdeb2600640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac070d90 0x7fdeac0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.023+0000 7fdeb1c00640 1 -- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac0cdde0 msgr2=0x7fdeac1f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.023+0000 7fdeb1c00640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac0cdde0 0x7fdeac1f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.023+0000 7fdeb1c00640 1 -- 172.21.15.19:0/794603046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac070d90 msgr2=0x7fdeac0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:45.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.023+0000 7fdeb1c00640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac070d90 0x7fdeac0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.023+0000 7fdeb1c00640 1 -- 172.21.15.19:0/794603046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac1f3390 con 0x7fdeac073160 2024-04-25T10:29:45.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.023+0000 7fdeb1c00640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac073160 0x7fdeac15c0f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdea002a7a0 tx=0x7fdea0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:45.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.024+0000 7fdea9600640 1 -- 172.21.15.19:0/794603046 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea0040030 con 0x7fdeac073160 2024-04-25T10:29:45.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.024+0000 7fdea9600640 1 -- 172.21.15.19:0/794603046 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdea0031a40 con 0x7fdeac073160 2024-04-25T10:29:45.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.024+0000 7fdea9600640 1 -- 172.21.15.19:0/794603046 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea0009450 con 0x7fdeac073160 2024-04-25T10:29:45.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.024+0000 7fdeb4600640 1 -- 172.21.15.19:0/794603046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeac1f2690 con 0x7fdeac073160 2024-04-25T10:29:45.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.024+0000 7fdeb4600640 1 -- 172.21.15.19:0/794603046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeac0cd440 con 0x7fdeac073160 2024-04-25T10:29:45.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.025+0000 7fdeb4600640 1 -- 172.21.15.19:0/794603046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeac1f2480 con 0x7fdeac073160 2024-04-25T10:29:45.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.026+0000 7fdea9600640 1 -- 172.21.15.19:0/794603046 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdea0043030 con 0x7fdeac073160 2024-04-25T10:29:45.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.027+0000 7fdea9600640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fde8c0744e0 0x7fde8c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:45.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.027+0000 7fdea9600640 1 -- 172.21.15.19:0/794603046 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6676+0+0 (secure 0 0 0) 0x7fdea00b6490 con 0x7fdeac073160 2024-04-25T10:29:45.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.028+0000 7fdeb1200640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fde8c0744e0 0x7fde8c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:45.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.028+0000 7fdeb1200640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fde8c0744e0 0x7fde8c0769f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fde98005880 tx=0x7fde98009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:45.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.032+0000 7fdea9600640 1 -- 172.21.15.19:0/794603046 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdea0080160 con 0x7fdeac073160 2024-04-25T10:29:45.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.283+0000 7fdeb4600640 1 -- 172.21.15.19:0/794603046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdeac076520 con 0x7fdeac073160 2024-04-25T10:29:45.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.298+0000 7fdea9600640 1 -- 172.21.15.19:0/794603046 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7fdea0084460 con 0x7fdeac073160 2024-04-25T10:29:45.301 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:29:45.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.300+0000 7fdeb4600640 1 -- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fde8c0744e0 msgr2=0x7fde8c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:45.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.300+0000 7fdeb4600640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fde8c0744e0 0x7fde8c0769f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fde98005880 tx=0x7fde98009040 comp rx=0 tx=0).stop 2024-04-25T10:29:45.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.300+0000 7fdeb4600640 1 -- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac073160 msgr2=0x7fdeac15c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:45.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.300+0000 7fdeb4600640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac073160 0x7fdeac15c0f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdea002a7a0 tx=0x7fdea0004a40 comp rx=0 tx=0).stop 2024-04-25T10:29:45.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.301+0000 7fdeb4600640 1 -- 172.21.15.19:0/794603046 shutdown_connections 2024-04-25T10:29:45.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.301+0000 7fdeb4600640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac070d90 0x7fdeac0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.301+0000 7fdeb4600640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fde8c0744e0 0x7fde8c0769f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.301+0000 7fdeb4600640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac0cdde0 0x7fdeac1f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.301+0000 7fdeb4600640 1 --2- 172.21.15.19:0/794603046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac073160 0x7fdeac15c0f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.301+0000 7fdeb4600640 1 -- 172.21.15.19:0/794603046 >> 172.21.15.19:0/794603046 conn(0x7fdeac06f1f0 msgr2=0x7fdeac0ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:45.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.301+0000 7fdeb4600640 1 -- 172.21.15.19:0/794603046 shutdown_connections 2024-04-25T10:29:45.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.301+0000 7fdeb4600640 1 -- 172.21.15.19:0/794603046 wait complete. 2024-04-25T10:29:45.332 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:29:45.333 INFO:tasks.ceph.mds.a.smithi019.stderr: -9269> 2024-04-25T10:28:07.136+0000 7fb28c600640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-25T10:29:45.357 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2024-04-25T10:29:45.358 INFO:tasks.ceph.mds.f.smithi112.stdout:starting mds.f at 2024-04-25T10:29:45.493 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-04-25T10:29:45.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.606+0000 7fb20d200640 1 Processor -- start 2024-04-25T10:29:45.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.606+0000 7fb20d200640 1 -- start start 2024-04-25T10:29:45.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.608+0000 7fb20d200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2080c38e0 0x7fb208161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:45.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.608+0000 7fb20d200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb20816b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:45.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.608+0000 7fb20d200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb20806f880 con 0x7fb20815a8e0 2024-04-25T10:29:45.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.608+0000 7fb20d200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb2080c8020 con 0x7fb2080c38e0 2024-04-25T10:29:45.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.608+0000 7fb20d200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb2080c27e0 con 0x7fb20806f470 2024-04-25T10:29:45.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.608+0000 7fb207e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb20816b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:45.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.608+0000 7fb207400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2080c38e0 0x7fb208161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:45.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.608+0000 7fb206a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb20815a8e0 0x7fb20806ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.19:37406/0 (socket says 172.21.15.19:37406) 2024-04-25T10:29:45.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.608+0000 7fb207e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb20816b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:42522/0 (socket says 172.21.15.19:42522) 2024-04-25T10:29:45.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.608+0000 7fb206a00640 1 -- 172.21.15.19:0/3126548034 learned_addr learned my addr 172.21.15.19:0/3126548034 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:29:45.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.608+0000 7fb207400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2080c38e0 0x7fb208161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:60236/0 (socket says 172.21.15.19:60236) 2024-04-25T10:29:45.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.609+0000 7fb207400640 1 -- 172.21.15.19:0/3126548034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 msgr2=0x7fb20816b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:29:45.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.609+0000 7fb207400640 1 --2- 172.21.15.19:0/3126548034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb20816b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.609+0000 7fb207400640 1 -- 172.21.15.19:0/3126548034 >> v1:172.21.15.112:6789/0 conn(0x7fb20815a8e0 legacy=0x7fb20806ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:45.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.609+0000 7fb207400640 1 -- 172.21.15.19:0/3126548034 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2080c8270 con 0x7fb2080c38e0 2024-04-25T10:29:45.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.609+0000 7fb207e00640 1 --2- 172.21.15.19:0/3126548034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb20816b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:45.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.609+0000 7fb206000640 1 -- 172.21.15.19:0/3126548034 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458972154 0 0) 0x7fb20806f880 con 0x7fb20815a8e0 2024-04-25T10:29:45.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.610+0000 7fb207400640 1 --2- 172.21.15.19:0/3126548034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2080c38e0 0x7fb208161000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80097a0 tx=0x7fb1f802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b4c41a2a9a328d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:45.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.610+0000 7fb206000640 1 -- 172.21.15.19:0/3126548034 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8037070 con 0x7fb2080c38e0 2024-04-25T10:29:45.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.610+0000 7fb206000640 1 -- 172.21.15.19:0/3126548034 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb1f8032440 con 0x7fb2080c38e0 2024-04-25T10:29:45.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.610+0000 7fb206000640 1 -- 172.21.15.19:0/3126548034 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8032830 con 0x7fb2080c38e0 2024-04-25T10:29:45.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.611+0000 7fb20d200640 1 -- 172.21.15.19:0/3126548034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2080c38e0 msgr2=0x7fb208161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:45.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.611+0000 7fb20d200640 1 --2- 172.21.15.19:0/3126548034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2080c38e0 0x7fb208161000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80097a0 tx=0x7fb1f802a180 comp rx=0 tx=0).stop 2024-04-25T10:29:45.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.611+0000 7fb20d200640 1 -- 172.21.15.19:0/3126548034 shutdown_connections 2024-04-25T10:29:45.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.611+0000 7fb20d200640 1 --2- 172.21.15.19:0/3126548034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb20816b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.611+0000 7fb20d200640 1 --2- 172.21.15.19:0/3126548034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2080c38e0 0x7fb208161000 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.611+0000 7fb20d200640 1 -- 172.21.15.19:0/3126548034 >> 172.21.15.19:0/3126548034 conn(0x7fb2080ca120 msgr2=0x7fb2080ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:45.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.611+0000 7fb20d200640 1 -- 172.21.15.19:0/3126548034 shutdown_connections 2024-04-25T10:29:45.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.611+0000 7fb20d200640 1 -- 172.21.15.19:0/3126548034 wait complete. 2024-04-25T10:29:45.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.614+0000 7fb20d200640 1 Processor -- start 2024-04-25T10:29:45.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.614+0000 7fb20d200640 1 -- start start 2024-04-25T10:29:45.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.615+0000 7fb20d200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb2080c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:45.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.615+0000 7fb20d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2080c38e0 0x7fb2081557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:45.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.615+0000 7fb20d200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb20815a8e0 0x7fb20814e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:45.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.615+0000 7fb20d200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb2080c8550 con 0x7fb2080c38e0 2024-04-25T10:29:45.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.615+0000 7fb20d200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb208160ae0 con 0x7fb20815a8e0 2024-04-25T10:29:45.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.615+0000 7fb20d200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb208073010 con 0x7fb20806f470 2024-04-25T10:29:45.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.615+0000 7fb207400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb2080c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:45.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.615+0000 7fb206a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2080c38e0 0x7fb2081557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:45.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb207e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb20815a8e0 0x7fb20814e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:45.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb207e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb20815a8e0 0x7fb20814e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.19:60246/0 (socket says 172.21.15.19:60246) 2024-04-25T10:29:45.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb207e00640 1 -- 172.21.15.19:0/2742678412 learned_addr learned my addr 172.21.15.19:0/2742678412 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:45.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb206a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2080c38e0 0x7fb2081557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56824/0 (socket says 172.21.15.19:56824) 2024-04-25T10:29:45.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb207400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb2080c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:42538/0 (socket says 172.21.15.19:42538) 2024-04-25T10:29:45.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb207400640 1 -- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb20815a8e0 msgr2=0x7fb20814e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:45.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb207400640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb20815a8e0 0x7fb20814e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb207400640 1 -- 172.21.15.19:0/2742678412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2080c38e0 msgr2=0x7fb2081557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:45.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb207400640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2080c38e0 0x7fb2081557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:45.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb207400640 1 -- 172.21.15.19:0/2742678412 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2080c5ae0 con 0x7fb20806f470 2024-04-25T10:29:45.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb206a00640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2080c38e0 0x7fb2081557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:45.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.616+0000 7fb207400640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb2080c4c00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8031000 tx=0x7fb1f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:45.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.617+0000 7fb1ff400640 1 -- 172.21.15.19:0/2742678412 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8041030 con 0x7fb20806f470 2024-04-25T10:29:45.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.617+0000 7fb1ff400640 1 -- 172.21.15.19:0/2742678412 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb1f8030540 con 0x7fb20806f470 2024-04-25T10:29:45.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.617+0000 7fb1ff400640 1 -- 172.21.15.19:0/2742678412 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8037040 con 0x7fb20806f470 2024-04-25T10:29:45.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.617+0000 7fb20d200640 1 -- 172.21.15.19:0/2742678412 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2080c5d80 con 0x7fb20806f470 2024-04-25T10:29:45.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.617+0000 7fb20d200640 1 -- 172.21.15.19:0/2742678412 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2080c7130 con 0x7fb20806f470 2024-04-25T10:29:45.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.618+0000 7fb20d200640 1 -- 172.21.15.19:0/2742678412 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb208070680 con 0x7fb20806f470 2024-04-25T10:29:45.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.620+0000 7fb1ff400640 1 -- 172.21.15.19:0/2742678412 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb1f8044070 con 0x7fb20806f470 2024-04-25T10:29:45.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.621+0000 7fb1ff400640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb1e40744b0 0x7fb1e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:45.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.621+0000 7fb1ff400640 1 -- 172.21.15.19:0/2742678412 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6934+0+0 (secure 0 0 0) 0x7fb1f80b5b80 con 0x7fb20806f470 2024-04-25T10:29:45.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.621+0000 7fb206a00640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb1e40744b0 0x7fb1e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:45.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.622+0000 7fb206a00640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb1e40744b0 0x7fb1e40769c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb208164980 tx=0x7fb1f0007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:45.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.625+0000 7fb1ff400640 1 -- 172.21.15.19:0/2742678412 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb208070680 con 0x7fb20806f470 2024-04-25T10:29:45.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:45.873+0000 7fb20d200640 1 -- 172.21.15.19:0/2742678412 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb20815adb0 con 0x7fb20806f470 2024-04-25T10:29:46.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.295+0000 7fb1ff400640 1 -- 172.21.15.19:0/2742678412 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7fb20815adb0 con 0x7fb20806f470 2024-04-25T10:29:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 -- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb1e40744b0 msgr2=0x7fb1e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb1e40744b0 0x7fb1e40769c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb208164980 tx=0x7fb1f0007de0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 -- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 msgr2=0x7fb2080c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb2080c4c00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8031000 tx=0x7fb1f80046c0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 -- 172.21.15.19:0/2742678412 shutdown_connections 2024-04-25T10:29:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb20815a8e0 0x7fb20814e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2080c38e0 0x7fb2081557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb1e40744b0 0x7fb1e40769c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 --2- 172.21.15.19:0/2742678412 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb20806f470 0x7fb2080c4c00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 -- 172.21.15.19:0/2742678412 >> 172.21.15.19:0/2742678412 conn(0x7fb2080ca120 msgr2=0x7fb208150c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 -- 172.21.15.19:0/2742678412 shutdown_connections 2024-04-25T10:29:46.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.298+0000 7fb20d200640 1 -- 172.21.15.19:0/2742678412 wait complete. 2024-04-25T10:29:46.334 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:29:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.620+0000 7ff858c00640 1 Processor -- start 2024-04-25T10:29:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.620+0000 7ff858c00640 1 -- start start 2024-04-25T10:29:46.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.622+0000 7ff858c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8540c4930 0x7ff8541534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:46.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.622+0000 7ff858c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff854159b80 0x7ff854159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:46.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.622+0000 7ff858c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8540742c0 0x7ff8540746d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:46.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.622+0000 7ff858c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7ff8541596f0 con 0x7ff8540c4930 2024-04-25T10:29:46.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.622+0000 7ff858c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff8540b07c0 con 0x7ff8540742c0 2024-04-25T10:29:46.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.622+0000 7ff858c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff8540b2600 con 0x7ff854159b80 2024-04-25T10:29:46.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff851400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff854159b80 0x7ff854159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:46.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff852800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8540742c0 0x7ff8540746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:46.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff851400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff854159b80 0x7ff854159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.19:42550/0 (socket says 172.21.15.19:42550) 2024-04-25T10:29:46.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff851400640 1 -- 172.21.15.19:0/4271263461 learned_addr learned my addr 172.21.15.19:0/4271263461 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:46.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff851e00640 1 --2- 172.21.15.19:0/4271263461 >> v2:172.21.15.19:3300/0 conn(0x7ff8540c4930 0x7ff8541534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:46.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff852800640 1 -- 172.21.15.19:0/4271263461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff854159b80 msgr2=0x7ff854159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:29:46.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff852800640 1 --2- 172.21.15.19:0/4271263461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff854159b80 0x7ff854159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff852800640 1 -- 172.21.15.19:0/4271263461 >> v2:172.21.15.19:3300/0 conn(0x7ff8540c4930 msgr2=0x7ff8541534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:29:46.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff852800640 1 --2- 172.21.15.19:0/4271263461 >> v2:172.21.15.19:3300/0 conn(0x7ff8540c4930 0x7ff8541534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff852800640 1 -- 172.21.15.19:0/4271263461 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8540b28e0 con 0x7ff8540742c0 2024-04-25T10:29:46.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff851400640 1 --2- 172.21.15.19:0/4271263461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff854159b80 0x7ff854159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:46.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.623+0000 7ff851e00640 1 --2- 172.21.15.19:0/4271263461 >> v2:172.21.15.19:3300/0 conn(0x7ff8540c4930 0x7ff8541534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:29:46.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.625+0000 7ff852800640 1 --2- 172.21.15.19:0/4271263461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8540742c0 0x7ff8540746d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff8540731b0 tx=0x7ff84c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dbbefb4c3fd4979 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:46.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.625+0000 7ff850a00640 1 -- 172.21.15.19:0/4271263461 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c031600 con 0x7ff8540742c0 2024-04-25T10:29:46.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.625+0000 7ff850a00640 1 -- 172.21.15.19:0/4271263461 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff84c0317a0 con 0x7ff8540742c0 2024-04-25T10:29:46.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.625+0000 7ff850a00640 1 -- 172.21.15.19:0/4271263461 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c031b90 con 0x7ff8540742c0 2024-04-25T10:29:46.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.625+0000 7ff858c00640 1 -- 172.21.15.19:0/4271263461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8540742c0 msgr2=0x7ff8540746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:46.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.625+0000 7ff858c00640 1 --2- 172.21.15.19:0/4271263461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8540742c0 0x7ff8540746d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff8540731b0 tx=0x7ff84c02a5d0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.626+0000 7ff858c00640 1 -- 172.21.15.19:0/4271263461 shutdown_connections 2024-04-25T10:29:46.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.626+0000 7ff858c00640 1 --2- 172.21.15.19:0/4271263461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff854159b80 0x7ff854159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.626+0000 7ff858c00640 1 --2- 172.21.15.19:0/4271263461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8540742c0 0x7ff8540746d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.626+0000 7ff858c00640 1 --2- 172.21.15.19:0/4271263461 >> v2:172.21.15.19:3300/0 conn(0x7ff8540c4930 0x7ff8541534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.626+0000 7ff858c00640 1 -- 172.21.15.19:0/4271263461 >> 172.21.15.19:0/4271263461 conn(0x7ff85406f1f0 msgr2=0x7ff85406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:46.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.626+0000 7ff858c00640 1 -- 172.21.15.19:0/4271263461 shutdown_connections 2024-04-25T10:29:46.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.626+0000 7ff858c00640 1 -- 172.21.15.19:0/4271263461 wait complete. 2024-04-25T10:29:46.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.628+0000 7ff858c00640 1 Processor -- start 2024-04-25T10:29:46.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.628+0000 7ff858c00640 1 -- start start 2024-04-25T10:29:46.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.630+0000 7ff858c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8540742c0 0x7ff8541545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:46.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.630+0000 7ff858c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8540c4930 0x7ff8541463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:46.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.630+0000 7ff858c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854159b80 0x7ff854146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:46.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.630+0000 7ff858c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff85415c900 con 0x7ff854159b80 2024-04-25T10:29:46.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.630+0000 7ff858c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff8540b2ea0 con 0x7ff8540c4930 2024-04-25T10:29:46.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.630+0000 7ff858c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff854153a30 con 0x7ff8540742c0 2024-04-25T10:29:46.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.630+0000 7ff852800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854159b80 0x7ff854146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:46.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.630+0000 7ff851e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8540742c0 0x7ff8541545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:46.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.630+0000 7ff851400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8540c4930 0x7ff8541463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:46.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.630+0000 7ff852800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854159b80 0x7ff854146920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56846/0 (socket says 172.21.15.19:56846) 2024-04-25T10:29:46.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.630+0000 7ff852800640 1 -- 172.21.15.19:0/3401474872 learned_addr learned my addr 172.21.15.19:0/3401474872 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.631+0000 7ff851400640 1 -- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8540742c0 msgr2=0x7ff8541545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.631+0000 7ff851400640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8540742c0 0x7ff8541545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.631+0000 7ff851400640 1 -- 172.21.15.19:0/3401474872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854159b80 msgr2=0x7ff854146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.631+0000 7ff851400640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854159b80 0x7ff854146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.631+0000 7ff851400640 1 -- 172.21.15.19:0/3401474872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8540aae60 con 0x7ff8540c4930 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.631+0000 7ff852800640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854159b80 0x7ff854146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.631+0000 7ff851400640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8540c4930 0x7ff8541463e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff84000e860 tx=0x7ff84000ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.631+0000 7ff84a000640 1 -- 172.21.15.19:0/3401474872 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840004030 con 0x7ff8540c4930 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.631+0000 7ff84a000640 1 -- 172.21.15.19:0/3401474872 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff8400041d0 con 0x7ff8540c4930 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.631+0000 7ff84a000640 1 -- 172.21.15.19:0/3401474872 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84000c940 con 0x7ff8540c4930 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.632+0000 7ff858c00640 1 -- 172.21.15.19:0/3401474872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff854146e60 con 0x7ff8540c4930 2024-04-25T10:29:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.632+0000 7ff858c00640 1 -- 172.21.15.19:0/3401474872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8540ab120 con 0x7ff8540c4930 2024-04-25T10:29:46.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.633+0000 7ff858c00640 1 -- 172.21.15.19:0/3401474872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff854076520 con 0x7ff8540c4930 2024-04-25T10:29:46.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.634+0000 7ff84a000640 1 -- 172.21.15.19:0/3401474872 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff84000cae0 con 0x7ff8540c4930 2024-04-25T10:29:46.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.635+0000 7ff84a000640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8340744b0 0x7ff8340769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:46.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.635+0000 7ff84a000640 1 -- 172.21.15.19:0/3401474872 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6934+0+0 (secure 0 0 0) 0x7ff840095720 con 0x7ff8540c4930 2024-04-25T10:29:46.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.636+0000 7ff851e00640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8340744b0 0x7ff8340769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:46.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.636+0000 7ff851e00640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8340744b0 0x7ff8340769c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff844006fd0 tx=0x7ff844008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.640+0000 7ff84a000640 1 -- 172.21.15.19:0/3401474872 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff840017020 con 0x7ff8540c4930 2024-04-25T10:29:46.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:46.850+0000 7ff858c00640 1 -- 172.21.15.19:0/3401474872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff854152d80 con 0x7ff8540c4930 2024-04-25T10:29:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.305+0000 7ff84a000640 1 -- 172.21.15.19:0/3401474872 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7ff84005f2f0 con 0x7ff8540c4930 2024-04-25T10:29:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:29:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.312+0000 7ff858c00640 1 -- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8340744b0 msgr2=0x7ff8340769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.312+0000 7ff858c00640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8340744b0 0x7ff8340769c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff844006fd0 tx=0x7ff844008040 comp rx=0 tx=0).stop 2024-04-25T10:29:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.312+0000 7ff858c00640 1 -- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8540c4930 msgr2=0x7ff8541463e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.312+0000 7ff858c00640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8540c4930 0x7ff8541463e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff84000e860 tx=0x7ff84000ed20 comp rx=0 tx=0).stop 2024-04-25T10:29:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.312+0000 7ff858c00640 1 -- 172.21.15.19:0/3401474872 shutdown_connections 2024-04-25T10:29:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.312+0000 7ff858c00640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854159b80 0x7ff854146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.312+0000 7ff858c00640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8540c4930 0x7ff8541463e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.312+0000 7ff858c00640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7ff8340744b0 0x7ff8340769c0 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff844006fd0 tx=0x7ff844008040 comp rx=0 tx=0).stop 2024-04-25T10:29:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.312+0000 7ff858c00640 1 --2- 172.21.15.19:0/3401474872 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8540742c0 0x7ff8541545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.312+0000 7ff858c00640 1 -- 172.21.15.19:0/3401474872 >> 172.21.15.19:0/3401474872 conn(0x7ff85406f1f0 msgr2=0x7ff85415cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.313+0000 7ff858c00640 1 -- 172.21.15.19:0/3401474872 shutdown_connections 2024-04-25T10:29:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.314+0000 7ff858c00640 1 -- 172.21.15.19:0/3401474872 wait complete. 2024-04-25T10:29:47.348 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:29:47.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.622+0000 7fbf87200640 1 Processor -- start 2024-04-25T10:29:47.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.622+0000 7fbf87200640 1 -- start start 2024-04-25T10:29:47.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.624+0000 7fbf87200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf80154500 0x7fbf80072f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:47.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.624+0000 7fbf87200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf800c7d50 0x7fbf8015a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:47.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.624+0000 7fbf87200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf800c8680 con 0x7fbf800c8160 2024-04-25T10:29:47.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.624+0000 7fbf87200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 -- 0x7fbf800c8940 con 0x7fbf80154500 2024-04-25T10:29:47.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.624+0000 7fbf87200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbf800c8c20 con 0x7fbf800c7d50 2024-04-25T10:29:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.625+0000 7fbf85e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf80154500 0x7fbf80072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.625+0000 7fbf85e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf80154500 0x7fbf80072f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56856/0 (socket says 172.21.15.19:56856) 2024-04-25T10:29:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.625+0000 7fbf85e00640 1 -- 172.21.15.19:0/1466543357 learned_addr learned my addr 172.21.15.19:0/1466543357 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.625+0000 7fbf85400640 1 --2- 172.21.15.19:0/1466543357 >> v2:172.21.15.112:3300/0 conn(0x7fbf800c7d50 0x7fbf8015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.625+0000 7fbf85e00640 1 -- 172.21.15.19:0/1466543357 >> v2:172.21.15.112:3300/0 conn(0x7fbf800c7d50 msgr2=0x7fbf8015a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:29:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.625+0000 7fbf85e00640 1 --2- 172.21.15.19:0/1466543357 >> v2:172.21.15.112:3300/0 conn(0x7fbf800c7d50 0x7fbf8015a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.625+0000 7fbf85e00640 1 -- 172.21.15.19:0/1466543357 >> v1:172.21.15.112:6789/0 conn(0x7fbf800c8160 legacy=0x7fbf800ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.625+0000 7fbf85e00640 1 -- 172.21.15.19:0/1466543357 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf800c8f00 con 0x7fbf80154500 2024-04-25T10:29:47.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.626+0000 7fbf85e00640 1 --2- 172.21.15.19:0/1466543357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf80154500 0x7fbf80072f40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbf800c6e80 tx=0x7fbf7402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d7a4dcd1b421a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:47.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.627+0000 7fbf84a00640 1 -- 172.21.15.19:0/1466543357 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74037070 con 0x7fbf80154500 2024-04-25T10:29:47.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.627+0000 7fbf84a00640 1 -- 172.21.15.19:0/1466543357 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbf7402ae50 con 0x7fbf80154500 2024-04-25T10:29:47.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.627+0000 7fbf84a00640 1 -- 172.21.15.19:0/1466543357 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74032880 con 0x7fbf80154500 2024-04-25T10:29:47.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.628+0000 7fbf87200640 1 -- 172.21.15.19:0/1466543357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf80154500 msgr2=0x7fbf80072f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.628+0000 7fbf87200640 1 --2- 172.21.15.19:0/1466543357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf80154500 0x7fbf80072f40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbf800c6e80 tx=0x7fbf7402a300 comp rx=0 tx=0).stop 2024-04-25T10:29:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.628+0000 7fbf87200640 1 -- 172.21.15.19:0/1466543357 shutdown_connections 2024-04-25T10:29:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.628+0000 7fbf87200640 1 --2- 172.21.15.19:0/1466543357 >> v2:172.21.15.112:3300/0 conn(0x7fbf800c7d50 0x7fbf8015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.628+0000 7fbf87200640 1 --2- 172.21.15.19:0/1466543357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf80154500 0x7fbf80072f40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:47.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.628+0000 7fbf87200640 1 -- 172.21.15.19:0/1466543357 >> 172.21.15.19:0/1466543357 conn(0x7fbf80070d10 msgr2=0x7fbf80071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:47.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.628+0000 7fbf87200640 1 -- 172.21.15.19:0/1466543357 shutdown_connections 2024-04-25T10:29:47.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.628+0000 7fbf87200640 1 -- 172.21.15.19:0/1466543357 wait complete. 2024-04-25T10:29:47.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.630+0000 7fbf87200640 1 Processor -- start 2024-04-25T10:29:47.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.630+0000 7fbf87200640 1 -- start start 2024-04-25T10:29:47.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.632+0000 7fbf87200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf800c7d50 0x7fbf801565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:47.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.632+0000 7fbf87200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf80154500 0x7fbf8015d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:47.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.632+0000 7fbf87200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf80157330 0x7fbf801418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:47.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.632+0000 7fbf87200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbf800ca7a0 con 0x7fbf80157330 2024-04-25T10:29:47.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.632+0000 7fbf87200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf80073480 con 0x7fbf80154500 2024-04-25T10:29:47.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.632+0000 7fbf87200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbf800ca920 con 0x7fbf800c7d50 2024-04-25T10:29:47.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.632+0000 7fbf86800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf80157330 0x7fbf801418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:47.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.632+0000 7fbf85400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf80154500 0x7fbf8015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:47.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.632+0000 7fbf85e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf800c7d50 0x7fbf801565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:47.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.632+0000 7fbf86800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf80157330 0x7fbf801418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56858/0 (socket says 172.21.15.19:56858) 2024-04-25T10:29:47.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.632+0000 7fbf86800640 1 -- 172.21.15.19:0/2626195162 learned_addr learned my addr 172.21.15.19:0/2626195162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:47.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.633+0000 7fbf85e00640 1 -- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf80154500 msgr2=0x7fbf8015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:47.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.633+0000 7fbf85e00640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf80154500 0x7fbf8015d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:47.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.633+0000 7fbf85e00640 1 -- 172.21.15.19:0/2626195162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf80157330 msgr2=0x7fbf801418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:47.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.633+0000 7fbf85e00640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf80157330 0x7fbf801418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:47.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.633+0000 7fbf85e00640 1 -- 172.21.15.19:0/2626195162 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8015d7b0 con 0x7fbf800c7d50 2024-04-25T10:29:47.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.633+0000 7fbf85400640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf80154500 0x7fbf8015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:29:47.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.633+0000 7fbf85e00640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf800c7d50 0x7fbf801565d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf74031000 tx=0x7fbf740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:47.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.633+0000 7fbf7a000640 1 -- 172.21.15.19:0/2626195162 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74041020 con 0x7fbf800c7d50 2024-04-25T10:29:47.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.634+0000 7fbf7a000640 1 -- 172.21.15.19:0/2626195162 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbf7403c870 con 0x7fbf800c7d50 2024-04-25T10:29:47.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.634+0000 7fbf7a000640 1 -- 172.21.15.19:0/2626195162 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74037040 con 0x7fbf800c7d50 2024-04-25T10:29:47.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.634+0000 7fbf87200640 1 -- 172.21.15.19:0/2626195162 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf800cdf50 con 0x7fbf800c7d50 2024-04-25T10:29:47.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.634+0000 7fbf87200640 1 -- 172.21.15.19:0/2626195162 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf80155ae0 con 0x7fbf800c7d50 2024-04-25T10:29:47.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.635+0000 7fbf87200640 1 -- 172.21.15.19:0/2626195162 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf80050740 con 0x7fbf800c7d50 2024-04-25T10:29:47.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.636+0000 7fbf7a000640 1 -- 172.21.15.19:0/2626195162 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbf74044020 con 0x7fbf800c7d50 2024-04-25T10:29:47.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.637+0000 7fbf7a000640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf640744e0 0x7fbf640769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:47.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.638+0000 7fbf7a000640 1 -- 172.21.15.19:0/2626195162 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6496+0+0 (secure 0 0 0) 0x7fbf740b6120 con 0x7fbf800c7d50 2024-04-25T10:29:47.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.638+0000 7fbf85400640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf640744e0 0x7fbf640769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:47.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.638+0000 7fbf85400640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf640744e0 0x7fbf640769f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbf800b3020 tx=0x7fbf70009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.641+0000 7fbf7a000640 1 -- 172.21.15.19:0/2626195162 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf7404b030 con 0x7fbf800c7d50 2024-04-25T10:29:47.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:47.847+0000 7fbf87200640 1 -- 172.21.15.19:0/2626195162 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbf800737f0 con 0x7fbf800c7d50 2024-04-25T10:29:48.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.311+0000 7fbf7a000640 1 -- 172.21.15.19:0/2626195162 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7fbf74032e20 con 0x7fbf800c7d50 2024-04-25T10:29:48.314 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-04-25T10:29:48.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.314+0000 7fbf87200640 1 -- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf640744e0 msgr2=0x7fbf640769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.314+0000 7fbf87200640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf640744e0 0x7fbf640769f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbf800b3020 tx=0x7fbf70009190 comp rx=0 tx=0).stop 2024-04-25T10:29:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.314+0000 7fbf87200640 1 -- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf800c7d50 msgr2=0x7fbf801565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.314+0000 7fbf87200640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf800c7d50 0x7fbf801565d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf74031000 tx=0x7fbf740046c0 comp rx=0 tx=0).stop 2024-04-25T10:29:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.315+0000 7fbf87200640 1 -- 172.21.15.19:0/2626195162 shutdown_connections 2024-04-25T10:29:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.315+0000 7fbf87200640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf80157330 0x7fbf801418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.315+0000 7fbf87200640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf80154500 0x7fbf8015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.315+0000 7fbf87200640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fbf640744e0 0x7fbf640769f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.315+0000 7fbf87200640 1 --2- 172.21.15.19:0/2626195162 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf800c7d50 0x7fbf801565d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.315+0000 7fbf87200640 1 -- 172.21.15.19:0/2626195162 >> 172.21.15.19:0/2626195162 conn(0x7fbf80070d10 msgr2=0x7fbf800ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.315+0000 7fbf87200640 1 -- 172.21.15.19:0/2626195162 shutdown_connections 2024-04-25T10:29:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.315+0000 7fbf87200640 1 -- 172.21.15.19:0/2626195162 wait complete. 2024-04-25T10:29:48.354 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T10:29:48.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.649+0000 7fb2cca00640 1 Processor -- start 2024-04-25T10:29:48.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.649+0000 7fb2cca00640 1 -- start start 2024-04-25T10:29:48.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.652+0000 7fb2cca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2c80c4930 0x7fb2c81534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:48.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.653+0000 7fb2cca00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c80b07c0 con 0x7fb2c8159f90 2024-04-25T10:29:48.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.653+0000 7fb2cca00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c80b2600 con 0x7fb2c8159b80 2024-04-25T10:29:48.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.653+0000 7fb2cca00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c81596f0 con 0x7fb2c80c4930 2024-04-25T10:29:48.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.653+0000 7fb2c6800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb2c8159f90 0x7fb2c80c2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58270/0 (socket says 172.21.15.19:58270) 2024-04-25T10:29:48.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.653+0000 7fb2c6800640 1 -- 172.21.15.19:0/3790540366 learned_addr learned my addr 172.21.15.19:0/3790540366 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-04-25T10:29:48.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.653+0000 7fb2c5e00640 1 --2- 172.21.15.19:0/3790540366 >> v2:172.21.15.112:3300/0 conn(0x7fb2c80c4930 0x7fb2c81534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:48.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.654+0000 7fb2c5e00640 1 -- 172.21.15.19:0/3790540366 >> v1:172.21.15.112:6789/0 conn(0x7fb2c8159b80 legacy=0x7fb2c80742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:48.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.654+0000 7fb2c5e00640 1 -- 172.21.15.19:0/3790540366 >> v1:172.21.15.19:6789/0 conn(0x7fb2c8159f90 legacy=0x7fb2c80c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:48.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.654+0000 7fb2c4a00640 1 -- 172.21.15.19:0/3790540366 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3455531206 0 0) 0x7fb2c80b07c0 con 0x7fb2c8159f90 2024-04-25T10:29:48.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.654+0000 7fb2c5e00640 1 -- 172.21.15.19:0/3790540366 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c80b28e0 con 0x7fb2c80c4930 2024-04-25T10:29:48.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.655+0000 7fb2c5e00640 1 --2- 172.21.15.19:0/3790540366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c80c4930 0x7fb2c81534f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009d90 tx=0x7fb2b802a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e898d2e9701eb81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:48.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.655+0000 7fb2c4a00640 1 -- 172.21.15.19:0/3790540366 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8007740 con 0x7fb2c80c4930 2024-04-25T10:29:48.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.655+0000 7fb2c4a00640 1 -- 172.21.15.19:0/3790540366 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb2b80078e0 con 0x7fb2c80c4930 2024-04-25T10:29:48.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.655+0000 7fb2c4a00640 1 -- 172.21.15.19:0/3790540366 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8007cd0 con 0x7fb2c80c4930 2024-04-25T10:29:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.656+0000 7fb2cca00640 1 -- 172.21.15.19:0/3790540366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c80c4930 msgr2=0x7fb2c81534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.656+0000 7fb2cca00640 1 --2- 172.21.15.19:0/3790540366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c80c4930 0x7fb2c81534f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009d90 tx=0x7fb2b802a610 comp rx=0 tx=0).stop 2024-04-25T10:29:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.656+0000 7fb2cca00640 1 -- 172.21.15.19:0/3790540366 shutdown_connections 2024-04-25T10:29:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.656+0000 7fb2cca00640 1 --2- 172.21.15.19:0/3790540366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c80c4930 0x7fb2c81534f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.656+0000 7fb2cca00640 1 -- 172.21.15.19:0/3790540366 >> 172.21.15.19:0/3790540366 conn(0x7fb2c806f1f0 msgr2=0x7fb2c806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.656+0000 7fb2cca00640 1 -- 172.21.15.19:0/3790540366 shutdown_connections 2024-04-25T10:29:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.656+0000 7fb2cca00640 1 -- 172.21.15.19:0/3790540366 wait complete. 2024-04-25T10:29:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.659+0000 7fb2cca00640 1 Processor -- start 2024-04-25T10:29:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.659+0000 7fb2cca00640 1 -- start start 2024-04-25T10:29:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2cca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2c80c4930 0x7fb2c8149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2cca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c8159b80 0x7fb2c814fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2cca00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8159f90 0x7fb2c8144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2cca00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c815c900 con 0x7fb2c8159f90 2024-04-25T10:29:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2cca00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c80b2ea0 con 0x7fb2c8159b80 2024-04-25T10:29:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2cca00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c8153a30 con 0x7fb2c80c4930 2024-04-25T10:29:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2c6800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8159f90 0x7fb2c8144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2c6800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8159f90 0x7fb2c8144430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59126/0 (socket says 172.21.15.19:59126) 2024-04-25T10:29:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2c6800640 1 -- 172.21.15.19:0/3220938989 learned_addr learned my addr 172.21.15.19:0/3220938989 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-04-25T10:29:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2c5e00640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2c80c4930 0x7fb2c8149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2c5400640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c8159b80 0x7fb2c814fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2c6800640 1 -- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2c80c4930 msgr2=0x7fb2c8149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.661+0000 7fb2c6800640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2c80c4930 0x7fb2c8149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.662+0000 7fb2c6800640 1 -- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c8159b80 msgr2=0x7fb2c814fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.662+0000 7fb2c6800640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c8159b80 0x7fb2c814fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.662+0000 7fb2c6800640 1 -- 172.21.15.19:0/3220938989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c8149ac0 con 0x7fb2c8159f90 2024-04-25T10:29:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.662+0000 7fb2c6800640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8159f90 0x7fb2c8144430 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000c410 tx=0x7fb2c000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.662+0000 7fb2be000640 1 -- 172.21.15.19:0/3220938989 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00074e0 con 0x7fb2c8159f90 2024-04-25T10:29:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.662+0000 7fb2be000640 1 -- 172.21.15.19:0/3220938989 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb2c00047e0 con 0x7fb2c8159f90 2024-04-25T10:29:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.662+0000 7fb2be000640 1 -- 172.21.15.19:0/3220938989 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0004bf0 con 0x7fb2c8159f90 2024-04-25T10:29:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.662+0000 7fb2cca00640 1 -- 172.21.15.19:0/3220938989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c81f5b20 con 0x7fb2c8159f90 2024-04-25T10:29:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.662+0000 7fb2cca00640 1 -- 172.21.15.19:0/3220938989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c81f5dc0 con 0x7fb2c8159f90 2024-04-25T10:29:48.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.663+0000 7fb2cca00640 1 -- 172.21.15.19:0/3220938989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c8076520 con 0x7fb2c8159f90 2024-04-25T10:29:48.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.665+0000 7fb2be000640 1 -- 172.21.15.19:0/3220938989 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb2c0011070 con 0x7fb2c8159f90 2024-04-25T10:29:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.666+0000 7fb2be000640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744e0 0x7fb2a40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:29:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.666+0000 7fb2be000640 1 -- 172.21.15.19:0/3220938989 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6053+0+0 (secure 0 0 0) 0x7fb2c0094e40 con 0x7fb2c8159f90 2024-04-25T10:29:48.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.666+0000 7fb2c5e00640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744e0 0x7fb2a40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:29:48.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.667+0000 7fb2c5e00640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744e0 0x7fb2a40769f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8034000 tx=0x7fb2b802f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:29:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.671+0000 7fb2be000640 1 -- 172.21.15.19:0/3220938989 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2c005ee20 con 0x7fb2c8159f90 2024-04-25T10:29:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:48.896+0000 7fb2cca00640 1 -- 172.21.15.19:0/3220938989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb2c815cb10 con 0x7fb2c8159f90 2024-04-25T10:29:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.325+0000 7fb2be000640 1 -- 172.21.15.19:0/3220938989 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7fb2c0063120 con 0x7fb2c8159f90 2024-04-25T10:29:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data_ec' removed 2024-04-25T10:29:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.329+0000 7fb2cca00640 1 -- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744e0 msgr2=0x7fb2a40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.329+0000 7fb2cca00640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744e0 0x7fb2a40769f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8034000 tx=0x7fb2b802f000 comp rx=0 tx=0).stop 2024-04-25T10:29:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.329+0000 7fb2cca00640 1 -- 172.21.15.19:0/3220938989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8159f90 msgr2=0x7fb2c8144430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:29:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.329+0000 7fb2cca00640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8159f90 0x7fb2c8144430 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000c410 tx=0x7fb2c000c8d0 comp rx=0 tx=0).stop 2024-04-25T10:29:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.330+0000 7fb2cca00640 1 -- 172.21.15.19:0/3220938989 shutdown_connections 2024-04-25T10:29:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.330+0000 7fb2cca00640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8159f90 0x7fb2c8144430 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.330+0000 7fb2cca00640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2c8159b80 0x7fb2c814fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.330+0000 7fb2cca00640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:6832/228103152,v1:172.21.15.112:6833/228103152] conn(0x7fb2a40744e0 0x7fb2a40769f0 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8034000 tx=0x7fb2b802f000 comp rx=0 tx=0).stop 2024-04-25T10:29:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.330+0000 7fb2cca00640 1 --2- 172.21.15.19:0/3220938989 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2c80c4930 0x7fb2c8149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:29:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.330+0000 7fb2cca00640 1 -- 172.21.15.19:0/3220938989 >> 172.21.15.19:0/3220938989 conn(0x7fb2c806f1f0 msgr2=0x7fb2c80cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:29:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.332+0000 7fb2cca00640 1 -- 172.21.15.19:0/3220938989 shutdown_connections 2024-04-25T10:29:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-04-25T10:29:49.333+0000 7fb2cca00640 1 -- 172.21.15.19:0/3220938989 wait complete. 2024-04-25T10:29:49.369 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T10:29:49.370 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:29:49.370 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:49.411 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:29:49.412 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:29:49.412 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:49.451 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:29:49.452 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-25T10:29:49.452 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:49.525 INFO:tasks.ceph.mds.e:Stopped 2024-04-25T10:29:49.525 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:29:49.525 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:49.540 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:29:49.540 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:29:49.540 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:49.591 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:29:49.592 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-25T10:29:49.592 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:49.645 INFO:tasks.ceph.mds.f:Stopped 2024-04-25T10:29:49.646 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T10:29:49.646 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T10:29:49.646 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:49.718 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T10:29:49.719 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T10:29:49.719 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:49.774 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T10:29:49.774 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T10:29:49.774 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:49.847 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T10:29:49.847 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T10:29:49.847 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:49.917 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T10:29:49.917 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T10:29:49.917 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:49.948 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T10:29:49.948 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T10:29:49.948 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:50.014 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T10:29:50.015 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T10:29:50.015 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:50.081 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T10:29:50.081 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T10:29:50.081 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:50.163 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T10:29:50.163 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T10:29:50.164 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T10:29:50.164 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:54.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-04-25T10:29:56.266 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T10:29:56.267 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T10:29:56.267 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:56.297 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T10:29:56.297 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T10:29:56.298 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T10:29:56.298 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:56.364 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T10:29:56.365 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T10:29:56.365 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:56.378 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T10:29:56.378 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T10:29:56.378 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:29:56.431 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T10:29:56.431 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T10:29:56.431 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v 'Replacing daemon mds' | head -n 1 2024-04-25T10:29:56.564 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:29:56.564 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T10:29:56.836 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:29:56.836 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T10:29:56.984 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:29:56.984 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T10:29:57.113 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:29:57.114 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T10:29:57.268 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T10:29:57.268 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T10:29:57.693 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T10:29:57.693 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T10:29:57.780 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T10:29:57.780 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T10:29:57.838 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T10:29:57.839 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T10:29:57.895 INFO:tasks.ceph:Archiving mon data... 2024-04-25T10:29:57.896 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067/data/mon.a.tgz 2024-04-25T10:29:57.897 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-04-25T10:29:57.956 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.LgrwXgPXYy 2024-04-25T10:29:57.956 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.LgrwXgPXYy 2024-04-25T10:29:58.130 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.LgrwXgPXYy 2024-04-25T10:29:58.279 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.LgrwXgPXYy is 309KB 2024-04-25T10:29:58.393 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.LgrwXgPXYy 2024-04-25T10:29:58.453 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067/data/mon.b.tgz 2024-04-25T10:29:58.454 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-04-25T10:29:58.472 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.SeFw1JLOJK 2024-04-25T10:29:58.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SeFw1JLOJK 2024-04-25T10:29:58.644 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.SeFw1JLOJK 2024-04-25T10:29:58.725 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.SeFw1JLOJK is 415KB 2024-04-25T10:29:58.822 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.SeFw1JLOJK 2024-04-25T10:29:58.836 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067/data/mon.c.tgz 2024-04-25T10:29:58.836 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-04-25T10:29:58.890 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.ZQGyJROHZl 2024-04-25T10:29:58.890 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ZQGyJROHZl 2024-04-25T10:29:59.031 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.ZQGyJROHZl 2024-04-25T10:29:59.111 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.ZQGyJROHZl is 415KB 2024-04-25T10:29:59.209 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.ZQGyJROHZl 2024-04-25T10:29:59.223 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T10:29:59.223 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T10:29:59.232 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T10:29:59.373 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T10:29:59.388 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T10:29:59.388 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T10:29:59.391 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067/remote/smithi019/crash 2024-04-25T10:29:59.392 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T10:29:59.479 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067/remote/smithi112/crash 2024-04-25T10:29:59.480 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T10:29:59.503 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T10:29:59.504 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:29:59.512 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:29:59.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T10:29:59.723 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T10:29:59.747 INFO:tasks.ceph:Compressing logs... 2024-04-25T10:29:59.747 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T10:29:59.753 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T10:29:59.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-04-25T10:29:59.814 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34491.log 2024-04-25T10:29:59.814 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T10:29:59.814 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34444.log 2024-04-25T10:29:59.814 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34491.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-25T10:29:59.814 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34491.log.gz 2024-04-25T10:29:59.814 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34444.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T10:29:59.814 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.f.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34444.log.gz 2024-04-25T10:29:59.814 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34400.log 2024-04-25T10:29:59.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T10:29:59.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34400.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T10:29:59.815 INFO:teuthology.orchestra.run.smithi112.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34400.log.gz 2024-04-25T10:29:59.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T10:29:59.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T10:29:59.815 INFO:teuthology.orchestra.run.smithi112.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T10:29:59.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T10:29:59.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T10:29:59.815 INFO:teuthology.orchestra.run.smithi112.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T10:29:59.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T10:29:59.815 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34531.log 2024-04-25T10:29:59.826 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34571.log 2024-04-25T10:29:59.827 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34531.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34531.log.gz 2024-04-25T10:29:59.833 INFO:teuthology.orchestra.run.smithi112.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T10:29:59.834 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34651.log 2024-04-25T10:29:59.835 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39154.log 2024-04-25T10:29:59.835 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42854.log 2024-04-25T10:29:59.838 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34571.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34571.log.gz 2024-04-25T10:29:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34360.log 2024-04-25T10:29:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34651.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34651.log.gz 2024-04-25T10:29:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34611.log 2024-04-25T10:29:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34360.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34360.log.gz 2024-04-25T10:29:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T10:29:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34611.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34611.log.gz 2024-04-25T10:29:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T10:29:59.839 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.d.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-25T10:29:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44969.log 2024-04-25T10:29:59.841 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39154.log.gz 2024-04-25T10:29:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45306.log 2024-04-25T10:29:59.841 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42854.log.gz 2024-04-25T10:29:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42392.log 2024-04-25T10:29:59.842 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44969.log.gz 2024-04-25T10:29:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45306.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45306.log.gz 2024-04-25T10:29:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43730.log 2024-04-25T10:29:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41693.log 2024-04-25T10:29:59.842 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42392.log.gz 2024-04-25T10:29:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38533.log 2024-04-25T10:29:59.843 INFO:teuthology.orchestra.run.smithi112.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T10:29:59.843 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43730.log.gz 2024-04-25T10:29:59.843 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41693.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41693.log.gz 2024-04-25T10:29:59.843 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41006.log 2024-04-25T10:29:59.843 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46155.log 2024-04-25T10:29:59.844 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38533.log.gz 2024-04-25T10:29:59.844 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45805.log 2024-04-25T10:29:59.845 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41006.log.gz 2024-04-25T10:29:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46155.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46155.log.gz 2024-04-25T10:29:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45763.log 2024-04-25T10:29:59.847 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41676.log 2024-04-25T10:29:59.847 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45805.log.gz 2024-04-25T10:29:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44885.log 2024-04-25T10:29:59.848 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45763.log.gz 2024-04-25T10:29:59.849 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45011.log 2024-04-25T10:29:59.849 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41676.log.gz 2024-04-25T10:29:59.850 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44885.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44885.log.gz 2024-04-25T10:29:59.850 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40796.log 2024-04-25T10:29:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41977.log 2024-04-25T10:29:59.851 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45011.log.gz 2024-04-25T10:29:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46670.log 2024-04-25T10:29:59.853 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40796.log.gz 2024-04-25T10:29:59.853 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38803.log 2024-04-25T10:29:59.854 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41977.log.gz 2024-04-25T10:29:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41090.log 2024-04-25T10:29:59.855 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46670.log.gz 2024-04-25T10:29:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38803.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T10:29:59.856 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38803.log.gz 2024-04-25T10:29:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42036.log 2024-04-25T10:29:59.857 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41090.log.gz 2024-04-25T10:29:59.858 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44486.log 2024-04-25T10:29:59.859 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42770.log 2024-04-25T10:29:59.859 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42036.log.gz 2024-04-25T10:29:59.860 INFO:teuthology.orchestra.run.smithi019.stderr: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T10:29:59.860 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45095.log 2024-04-25T10:29:59.860 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44486.log.gz 2024-04-25T10:29:59.861 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42812.log 2024-04-25T10:29:59.861 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42770.log.gz 2024-04-25T10:29:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44402.log 2024-04-25T10:29:59.862 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45095.log.gz 2024-04-25T10:29:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45053.log 2024-04-25T10:29:59.864 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42812.log.gz 2024-04-25T10:29:59.864 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44402.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44402.log.gz 2024-04-25T10:29:59.864 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43772.log 2024-04-25T10:29:59.866 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45053.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T10:29:59.866 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45053.log.gz 2024-04-25T10:29:59.866 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46376.log 2024-04-25T10:29:59.867 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43772.log.gz 2024-04-25T10:29:59.867 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2024-04-25T10:29:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47250.log 2024-04-25T10:29:59.869 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46376.log.gz 2024-04-25T10:29:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47124.log 2024-04-25T10:29:59.870 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2024-04-25T10:29:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47250.log: gzip -5 --verbose 88.8% -- /var/log/ceph/ceph-client.admin.47395.log -- replaced with /var/log/ceph/ceph-client.admin.47250.log.gz 2024-04-25T10:29:59.871 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-04-25T10:29:59.872 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44108.log 2024-04-25T10:29:59.872 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47124.log.gz 2024-04-25T10:29:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41341.log 2024-04-25T10:29:59.874 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47395.log.gz 2024-04-25T10:29:59.875 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44108.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz 2024-04-25T10:29:59.875 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44234.log 2024-04-25T10:29:59.875 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.b.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T10:29:59.876 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41337.log 2024-04-25T10:29:59.876 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41341.log.gz 2024-04-25T10:29:59.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41132.log 2024-04-25T10:29:59.877 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44234.log.gz 2024-04-25T10:29:59.878 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T10:29:59.879 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41337.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.41337.log.gz 2024-04-25T10:29:59.879 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41132.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41132.log.gz 2024-04-25T10:29:59.880 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46112.log 2024-04-25T10:29:59.881 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46460.log 2024-04-25T10:29:59.882 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41649.log 2024-04-25T10:29:59.882 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T10:29:59.882 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46460.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46112.log.gz 2024-04-25T10:29:59.883 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46460.log.gz 2024-04-25T10:29:59.883 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42518.log 2024-04-25T10:29:59.884 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44801.log 2024-04-25T10:29:59.884 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41649.log.gz 2024-04-25T10:29:59.885 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38677.log 2024-04-25T10:29:59.886 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42518.log.gz 2024-04-25T10:29:59.886 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47166.log 2024-04-25T10:29:59.887 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44801.log.gz 2024-04-25T10:29:59.888 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47311.log 2024-04-25T10:29:59.888 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38677.log.gz 2024-04-25T10:29:59.889 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40168.log 2024-04-25T10:29:59.889 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47166.log.gz 2024-04-25T10:29:59.890 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47311.log: gzip 89.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.47311.log.gz -- 2024-04-25T10:29:59.890 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.46208.log 2024-04-25T10:29:59.891 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33273.log 2024-04-25T10:29:59.891 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40168.log.gz 2024-04-25T10:29:59.892 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46028.log 2024-04-25T10:29:59.893 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46208.log.gz 2024-04-25T10:29:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40670.log 2024-04-25T10:29:59.893 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33273.log.gz 2024-04-25T10:29:59.894 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2024-04-25T10:29:59.895 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46028.log.gz 2024-04-25T10:29:59.895 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40520.log 2024-04-25T10:29:59.896 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40670.log.gz 2024-04-25T10:29:59.897 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41632.log 2024-04-25T10:29:59.897 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2024-04-25T10:29:59.898 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40520.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T10:29:59.898 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40520.log.gz 2024-04-25T10:29:59.899 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38933.log 2024-04-25T10:29:59.899 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41632.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41632.log.gz 2024-04-25T10:29:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42350.log 2024-04-25T10:29:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33644.log 2024-04-25T10:29:59.901 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38933.log.gz 2024-04-25T10:29:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41964.log 2024-04-25T10:29:59.903 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42350.log.gz 2024-04-25T10:29:59.904 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33644.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33644.log.gz 2024-04-25T10:29:59.904 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44528.log 2024-04-25T10:29:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41929.log 2024-04-25T10:29:59.905 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41964.log.gz 2024-04-25T10:29:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44528.log: gzip 89.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.44528.log.gz --verbose 2024-04-25T10:29:59.906 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.46838.log 2024-04-25T10:29:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41349.log 2024-04-25T10:29:59.908 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41929.log.gz 2024-04-25T10:29:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46838.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46838.log.gz 2024-04-25T10:29:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40880.log 2024-04-25T10:29:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43898.log 2024-04-25T10:29:59.910 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41349.log.gz 2024-04-25T10:29:59.911 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46586.log 2024-04-25T10:29:59.912 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40880.log.gz 2024-04-25T10:29:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33540.log 2024-04-25T10:29:59.913 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43898.log.gz 2024-04-25T10:29:59.914 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46586.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46586.log.gz 2024-04-25T10:29:59.914 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38889.log 2024-04-25T10:29:59.915 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33540.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T10:29:59.915 INFO:teuthology.orchestra.run.smithi019.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33540.log.gz 2024-04-25T10:29:59.916 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41356.log 2024-04-25T10:29:59.916 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38889.log.gz 2024-04-25T10:29:59.917 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41350.log 2024-04-25T10:29:59.919 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41356.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41356.log.gz 2024-04-25T10:29:59.919 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41048.log 2024-04-25T10:29:59.920 INFO:teuthology.orchestra.run.smithi019.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T10:29:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44843.log 2024-04-25T10:29:59.921 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41350.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41350.log.gz 2024-04-25T10:29:59.922 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44318.log 2024-04-25T10:29:59.923 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41048.log.gz 2024-04-25T10:29:59.923 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44843.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T10:29:59.923 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44843.log.gz 2024-04-25T10:29:59.924 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38719.log 2024-04-25T10:29:59.925 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44318.log.gz 2024-04-25T10:29:59.926 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40394.log 2024-04-25T10:29:59.928 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38719.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38719.log.gz 2024-04-25T10:29:59.928 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T10:29:59.929 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46418.log 2024-04-25T10:29:59.930 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40394.log.gz 2024-04-25T10:29:59.931 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46292.log 2024-04-25T10:29:59.932 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46418.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46418.log.gz 2024-04-25T10:29:59.933 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45222.log 2024-04-25T10:29:59.934 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46292.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T10:29:59.934 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46292.log.gz 2024-04-25T10:29:59.935 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45222.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45222.log.gz 2024-04-25T10:29:59.936 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40210.log 2024-04-25T10:29:59.937 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39111.log 2024-04-25T10:29:59.938 INFO:teuthology.orchestra.run.smithi019.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T10:29:59.939 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41344.log 2024-04-25T10:29:59.939 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40210.log.gz 2024-04-25T10:29:59.940 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39069.log 2024-04-25T10:29:59.940 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39111.log.gz 2024-04-25T10:29:59.941 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42308.log 2024-04-25T10:29:59.942 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41344.log.gz 2024-04-25T10:29:59.943 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38761.log 2024-04-25T10:29:59.943 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39069.log.gz 2024-04-25T10:29:59.944 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45137.log 2024-04-25T10:29:59.944 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42308.log.gz 2024-04-25T10:29:59.945 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40126.log 2024-04-25T10:29:59.945 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38761.log.gz 2024-04-25T10:29:59.947 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43982.log 2024-04-25T10:29:59.947 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45137.log.gz 2024-04-25T10:29:59.948 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39280.log 2024-04-25T10:29:59.948 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40126.log.gz 2024-04-25T10:29:59.950 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41353.log 2024-04-25T10:29:59.950 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43982.log.gz 2024-04-25T10:29:59.951 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46712.log 2024-04-25T10:29:59.951 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39280.log.gz 2024-04-25T10:29:59.952 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43216.log 2024-04-25T10:29:59.952 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41353.log.gz 2024-04-25T10:29:59.953 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41664.log 2024-04-25T10:29:59.954 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46712.log.gz 2024-04-25T10:29:59.954 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2024-04-25T10:29:59.955 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43216.log.gz 2024-04-25T10:29:59.956 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41664.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T10:29:59.956 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41664.log.gz 2024-04-25T10:29:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42644.log 2024-04-25T10:29:59.957 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2024-04-25T10:29:59.959 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38632.log 2024-04-25T10:29:59.960 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40563.log 2024-04-25T10:29:59.960 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42644.log.gz 2024-04-25T10:29:59.962 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40252.log 2024-04-25T10:29:59.962 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38632.log.gz 2024-04-25T10:29:59.963 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40436.log 2024-04-25T10:29:59.963 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40563.log.gz 2024-04-25T10:29:59.964 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44276.log 2024-04-25T10:29:59.964 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40252.log.gz 2024-04-25T10:29:59.965 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40436.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40436.log.gz 2024-04-25T10:29:59.966 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45366.log 2024-04-25T10:29:59.967 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44276.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44276.log.gz 2024-04-25T10:29:59.967 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39859.log 2024-04-25T10:29:59.969 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41355.log 2024-04-25T10:29:59.969 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45366.log.gz 2024-04-25T10:29:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45889.log 2024-04-25T10:29:59.971 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41355.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41355.log.gz 2024-04-25T10:29:59.973 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.45889.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.39859.log.gz 2024-04-25T10:29:59.973 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44192.log 2024-04-25T10:29:59.973 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45889.log.gz 2024-04-25T10:29:59.973 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46628.log 2024-04-25T10:29:59.975 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40478.log 2024-04-25T10:29:59.975 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44192.log.gz 2024-04-25T10:29:59.976 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46628.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46628.log.gz 2024-04-25T10:29:59.977 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44444.log 2024-04-25T10:29:59.978 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40478.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40478.log.gz 2024-04-25T10:29:59.978 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2024-04-25T10:29:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47208.log 2024-04-25T10:29:59.980 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44444.log.gz 2024-04-25T10:29:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43940.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2024-04-25T10:29:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45679.log 2024-04-25T10:29:59.982 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47208.log.gz 2024-04-25T10:29:59.983 INFO:teuthology.orchestra.run.smithi112.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T10:29:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40964.log 2024-04-25T10:29:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46754.log 2024-04-25T10:29:59.984 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45679.log.gz 2024-04-25T10:29:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40964.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40964.log.gz 2024-04-25T10:29:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45412.log 2024-04-25T10:29:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46754.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46754.log.gz 2024-04-25T10:29:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46502.log 2024-04-25T10:29:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38983.log 2024-04-25T10:29:59.989 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45412.log.gz 2024-04-25T10:29:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46502.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46502.log.gz 2024-04-25T10:29:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42896.log 2024-04-25T10:29:59.992 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38983.log.gz 2024-04-25T10:29:59.992 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40922.log 2024-04-25T10:29:59.994 INFO:teuthology.orchestra.run.smithi112.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T10:29:59.994 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38418.log 2024-04-25T10:29:59.995 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42896.log.gz 2024-04-25T10:29:59.995 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39322.log 2024-04-25T10:29:59.995 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40922.log.gz 2024-04-25T10:29:59.997 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42266.log 2024-04-25T10:29:59.997 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38418.log.gz 2024-04-25T10:29:59.998 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42224.log 2024-04-25T10:29:59.998 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39322.log.gz 2024-04-25T10:29:59.999 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40352.log 2024-04-25T10:29:59.999 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42266.log.gz 2024-04-25T10:30:00.001 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40754.log 2024-04-25T10:30:00.001 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42224.log.gz 2024-04-25T10:30:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39364.log 2024-04-25T10:30:00.002 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40352.log.gz 2024-04-25T10:30:00.003 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41675.log 2024-04-25T10:30:00.003 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40754.log.gz 2024-04-25T10:30:00.005 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43004.log 2024-04-25T10:30:00.005 INFO:teuthology.orchestra.run.smithi019.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.39364.log.gz/var/log/ceph/ceph-client.admin.41675.log: 2024-04-25T10:30:00.006 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41675.log.gz 2024-04-25T10:30:00.008 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43004.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43004.log.gz 2024-04-25T10:30:00.009 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46544.log 2024-04-25T10:30:00.010 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38845.log 2024-04-25T10:30:00.012 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38319.log 2024-04-25T10:30:00.012 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46544.log.gz 2024-04-25T10:30:00.013 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38845.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38845.log.gz 2024-04-25T10:30:00.013 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40712.log 2024-04-25T10:30:00.014 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38319.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-25T10:30:00.015 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38319.log.gz 2024-04-25T10:30:00.016 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47082.log 2024-04-25T10:30:00.016 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40712.log.gz 2024-04-25T10:30:00.018 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.47082.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-25T10:30:00.018 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47082.log.gz 2024-04-25T10:30:00.019 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43856.log 2024-04-25T10:30:00.020 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47040.log 2024-04-25T10:30:00.022 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42434.log 2024-04-25T10:30:00.022 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43856.log.gz 2024-04-25T10:30:00.024 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47040.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47040.log.gz 2024-04-25T10:30:00.024 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42728.log 2024-04-25T10:30:00.025 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42434.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39434.log 2024-04-25T10:30:00.025 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42434.log.gz 2024-04-25T10:30:00.026 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46070.log 2024-04-25T10:30:00.026 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42728.log.gz 2024-04-25T10:30:00.028 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46796.log 2024-04-25T10:30:00.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39434.log.gz 2024-04-25T10:30:00.029 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41651.log 2024-04-25T10:30:00.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46070.log.gz 2024-04-25T10:30:00.030 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42560.log 2024-04-25T10:30:00.030 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46796.log.gz 2024-04-25T10:30:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46250.log 2024-04-25T10:30:00.032 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41651.log.gz 2024-04-25T10:30:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44927.log 2024-04-25T10:30:00.033 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42560.log.gz 2024-04-25T10:30:00.034 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47000.log 2024-04-25T10:30:00.035 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46250.log.gz 2024-04-25T10:30:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44927.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44927.log.gz 2024-04-25T10:30:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47000.log: -- /var/log/ceph/ceph-client.admin.42476.log 2024-04-25T10:30:00.037 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47000.log.gz 2024-04-25T10:30:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46940.log 2024-04-25T10:30:00.042 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46334.log 2024-04-25T10:30:00.043 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42476.log.gz 2024-04-25T10:30:00.043 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46940.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46940.log.gz 2024-04-25T10:30:00.043 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39025.log 2024-04-25T10:30:00.043 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45264.log 2024-04-25T10:30:00.043 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46334.log.gz 2024-04-25T10:30:00.044 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43535.log 2024-04-25T10:30:00.044 INFO:teuthology.orchestra.run.smithi019.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39025.log.gz 2024-04-25T10:30:00.045 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45264.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45264.log.gz 2024-04-25T10:30:00.045 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44657.log 2024-04-25T10:30:00.046 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.43535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43535.log.gz 2024-04-25T10:30:00.047 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44741.log 2024-04-25T10:30:00.048 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45180.log 2024-04-25T10:30:00.048 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44657.log.gz 2024-04-25T10:30:00.050 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44741.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44741.log.gz 2024-04-25T10:30:00.050 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47353.log 2024-04-25T10:30:00.052 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45180.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45180.log.gz 2024-04-25T10:30:00.052 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44699.log 2024-04-25T10:30:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47353.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47353.log.gz 2024-04-25T10:30:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44360.log 2024-04-25T10:30:00.054 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44699.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T10:30:00.054 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44699.log.gz 2024-04-25T10:30:00.056 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44360.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44360.log.gz 2024-04-25T10:30:00.056 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41970.log 2024-04-25T10:30:00.058 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42019.log 2024-04-25T10:30:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41970.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41970.log.gz 2024-04-25T10:30:00.060 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42019.log: -- /var/log/ceph/ceph-client.admin.40084.log 2024-04-25T10:30:00.061 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42019.log.gz 2024-04-25T10:30:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39238.log 2024-04-25T10:30:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40084.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40084.log.gz 2024-04-25T10:30:00.064 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42003.log 2024-04-25T10:30:00.065 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39238.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39238.log.gz 2024-04-25T10:30:00.065 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2024-04-25T10:30:00.067 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42003.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42003.log.gz 2024-04-25T10:30:00.068 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42938.log 2024-04-25T10:30:00.069 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42686.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2024-04-25T10:30:00.070 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.25665.log 2024-04-25T10:30:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42938.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42938.log.gz 2024-04-25T10:30:00.072 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose --/var/log/ceph/ceph.tmp-client.admin.25665.log: /var/log/ceph/ceph-client.admin.39196.log 2024-04-25T10:30:00.072 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.25665.log.gz 2024-04-25T10:30:00.073 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45721.log 2024-04-25T10:30:00.075 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39196.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39196.log.gz 2024-04-25T10:30:00.076 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40294.log 2024-04-25T10:30:00.077 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45721.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45721.log.gz 2024-04-25T10:30:00.078 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40294.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40294.log.gz 2024-04-25T10:30:00.079 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41174.log 2024-04-25T10:30:00.080 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46898.log 2024-04-25T10:30:00.082 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41174.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41174.log.gz 2024-04-25T10:30:00.083 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41652.log 2024-04-25T10:30:00.083 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46898.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46898.log.gz 2024-04-25T10:30:00.084 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45847.log 2024-04-25T10:30:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41652.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41652.log.gz 2024-04-25T10:30:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44024.log 2024-04-25T10:30:00.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2024-04-25T10:30:00.088 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45847.log.gz 2024-04-25T10:30:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44024.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44024.log.gz 2024-04-25T10:30:00.091 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43088.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-04-25T10:30:00.092 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42004.log 2024-04-25T10:30:00.093 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40838.log 2024-04-25T10:30:00.095 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42004.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42004.log.gz 2024-04-25T10:30:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42602.log 2024-04-25T10:30:00.097 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40838.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40838.log.gz 2024-04-25T10:30:00.097 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2024-04-25T10:30:00.098 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42602.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42602.log.gz 2024-04-25T10:30:00.100 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44150.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2024-04-25T10:30:00.152 INFO:teuthology.orchestra.run.smithi019.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T10:30:00.307 INFO:teuthology.orchestra.run.smithi019.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T10:30:00.493 INFO:teuthology.orchestra.run.smithi112.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T10:30:00.504 INFO:teuthology.orchestra.run.smithi112.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T10:30:00.535 INFO:teuthology.orchestra.run.smithi112.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T10:30:00.566 INFO:teuthology.orchestra.run.smithi112.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T10:30:00.568 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-04-25T10:30:00.568 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m0.768s 2024-04-25T10:30:00.568 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m3.186s 2024-04-25T10:30:00.568 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m0.129s 2024-04-25T10:30:00.665 INFO:teuthology.orchestra.run.smithi019.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T10:30:00.746 INFO:teuthology.orchestra.run.smithi019.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T10:30:00.767 INFO:teuthology.orchestra.run.smithi019.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T10:30:00.851 INFO:teuthology.orchestra.run.smithi019.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T10:30:00.855 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-04-25T10:30:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m1.055s 2024-04-25T10:30:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m3.642s 2024-04-25T10:30:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.867s 2024-04-25T10:30:00.857 INFO:tasks.ceph:Archiving logs... 2024-04-25T10:30:00.857 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067/remote/smithi019/log 2024-04-25T10:30:00.858 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T10:30:01.530 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067/remote/smithi112/log 2024-04-25T10:30:01.531 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T10:30:02.015 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T10:30:02.026 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T10:30:02.026 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T10:30:02.034 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T10:30:02.166 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T10:30:02.175 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T10:30:02.175 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:30:02.182 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:30:02.198 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-04-25T10:30:02.203 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T10:30:02.203 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-04-25T10:30:02.203 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 +1193us[+1199us] +/- 55ms 2024-04-25T10:30:02.203 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 -807us[ -801us] +/- 61ms 2024-04-25T10:30:02.203 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 -678us[ -678us] +/- 74ms 2024-04-25T10:30:02.203 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:30:02.231 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-04-25T10:30:02.242 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T10:30:02.242 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-04-25T10:30:02.242 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv01.front.sepia.ceph.com 3 6 377 0 +1190us[+1195us] +/- 56ms 2024-04-25T10:30:02.242 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -805us[ -800us] +/- 61ms 2024-04-25T10:30:02.242 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 -670us[ -665us] +/- 74ms 2024-04-25T10:30:02.242 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:30:02.244 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T10:30:02.253 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T10:30:02.254 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T10:30:02.265 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T10:30:02.478 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T10:30:02.542 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T10:30:02.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:30:02.643 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T10:30:02.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:30:02.670 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T10:30:02.679 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T10:30:02.722 INFO:teuthology.task.internal:Duration was 772.048311 seconds 2024-04-25T10:30:02.723 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T10:30:02.733 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T10:30:02.733 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T10:30:02.741 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T10:30:02.779 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T10:30:02.869 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T10:30:03.165 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T10:30:03.165 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-04-25T10:30:03.165 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T10:30:03.243 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T10:30:03.244 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T10:30:03.270 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T10:30:03.271 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T10:30:03.276 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T10:30:03.362 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T10:30:03.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T10:30:03.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T10:30:03.540 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T10:30:03.550 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T10:30:03.550 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T10:30:03.638 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T10:30:03.662 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T10:30:03.672 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:30:03.679 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:30:03.724 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-04-25T10:30:03.774 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-04-25T10:30:03.820 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:30:03.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:30:03.873 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:30:03.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:30:03.887 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T10:30:03.898 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T10:30:03.899 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067/remote/smithi019 2024-04-25T10:30:03.899 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T10:30:03.993 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673067/remote/smithi112 2024-04-25T10:30:03.993 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T10:30:04.024 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T10:30:04.024 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T10:30:04.032 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T10:30:04.085 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T10:30:04.097 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T10:30:04.098 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T10:30:04.113 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T10:30:04.113 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T10:30:04.121 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T10:30:04.134 INFO:teuthology.orchestra.run.smithi112.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 10:30 /home/ubuntu/cephtest 2024-04-25T10:30:04.172 INFO:teuthology.orchestra.run.smithi019.stdout: 393809 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 10:30 /home/ubuntu/cephtest 2024-04-25T10:30:04.175 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T10:30:04.186 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T10:30:04.248 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} duration: 772.0483112335205 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T10:30:04.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T10:30:04.325 INFO:teuthology.run:pass